Jul 15 13:09:12.732302 ip-10-0-128-159 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 15 13:09:12.732315 ip-10-0-128-159 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 15 13:09:12.732325 ip-10-0-128-159 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 15 13:09:12.732662 ip-10-0-128-159 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 15 13:09:22.745382 ip-10-0-128-159 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 15 13:09:22.745400 ip-10-0-128-159 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 76f04c38ce3245daa271b90a4492a6f6 --
Jul 15 13:11:19.804509 ip-10-0-128-159 systemd[1]: Starting Kubernetes Kubelet...
Jul 15 13:11:20.163489 ip-10-0-128-159 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 13:11:20.163489 ip-10-0-128-159 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 15 13:11:20.163489 ip-10-0-128-159 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 13:11:20.163489 ip-10-0-128-159 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 15 13:11:20.163489 ip-10-0-128-159 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 13:11:20.164125 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.163491    2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 15 13:11:20.166808 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166793    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 13:11:20.166808 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166808    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 13:11:20.166871 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166813    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 13:11:20.166871 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166816    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 13:11:20.166871 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166821    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 13:11:20.166871 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166825    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 13:11:20.166871 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166828    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 13:11:20.166871 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166831    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 13:11:20.166871 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166834    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 13:11:20.166871 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166838    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 13:11:20.166871 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166842    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 13:11:20.166871 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166845    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 13:11:20.166871 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166848    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 13:11:20.166871 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166851    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 13:11:20.166871 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166854    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 13:11:20.166871 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166856    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 13:11:20.166871 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166859    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 13:11:20.166871 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166861    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 13:11:20.166871 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166864    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 13:11:20.166871 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166866    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 13:11:20.166871 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166869    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 13:11:20.167358 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166871    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 13:11:20.167358 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166874    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 13:11:20.167358 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166877    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 13:11:20.167358 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166880    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 13:11:20.167358 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166883    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 13:11:20.167358 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166886    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 13:11:20.167358 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166889    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 13:11:20.167358 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166894    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 13:11:20.167358 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166897    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 13:11:20.167358 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166900    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 13:11:20.167358 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166903    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 13:11:20.167358 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166905    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 13:11:20.167358 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166908    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 13:11:20.167358 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166910    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 13:11:20.167358 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166913    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 13:11:20.167358 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166917    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 13:11:20.167358 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166919    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 13:11:20.167358 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166922    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 13:11:20.167358 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166924    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 13:11:20.167358 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166927    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 13:11:20.167830 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166929    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 13:11:20.167830 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166931    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 13:11:20.167830 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166934    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 13:11:20.167830 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166936    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 13:11:20.167830 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166939    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 13:11:20.167830 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166941    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 13:11:20.167830 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166944    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 13:11:20.167830 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166947    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 13:11:20.167830 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166949    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 13:11:20.167830 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166952    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 13:11:20.167830 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166954    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 13:11:20.167830 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166957    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 13:11:20.167830 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166959    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 13:11:20.167830 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166963    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 13:11:20.167830 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166966    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 13:11:20.167830 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166969    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 13:11:20.167830 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166971    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 13:11:20.167830 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166974    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 13:11:20.167830 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166976    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 13:11:20.167830 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166979    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 13:11:20.168327 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166981    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 13:11:20.168327 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166984    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 13:11:20.168327 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166986    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 13:11:20.168327 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166989    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 13:11:20.168327 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166991    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 13:11:20.168327 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166993    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 13:11:20.168327 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166996    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 13:11:20.168327 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.166998    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 13:11:20.168327 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.167001    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 13:11:20.168327 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.167003    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 13:11:20.168327 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.167006    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 13:11:20.168327 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.167008    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 13:11:20.168327 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.167011    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 13:11:20.168327 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.167013    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 13:11:20.168327 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.167016    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 13:11:20.168327 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.167019    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 13:11:20.168327 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.167021    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 13:11:20.168327 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.167024    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 13:11:20.168327 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.167026    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 13:11:20.168327 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.167029    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 13:11:20.168788 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.167032    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 13:11:20.168788 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.167034    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 13:11:20.168788 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.167036    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 13:11:20.168788 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.167039    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 13:11:20.168788 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.167042    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 13:11:20.168788 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.167044    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 13:11:20.168788 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.167047    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 13:11:20.168788 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.167050    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 13:11:20.168788 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.167052    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 13:11:20.168788 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.167055    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 13:11:20.168788 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.167057    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 13:11:20.168788 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.167060    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 13:11:20.168788 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.167063    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 13:11:20.168788 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.167065    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 13:11:20.168788 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.167068    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 13:11:20.168788 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.167070    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 13:11:20.168788 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.167074    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 13:11:20.168788 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.167078    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 13:11:20.169346 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169334    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 13:11:20.169346 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169345    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 13:11:20.169401 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169349    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 13:11:20.169401 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169353    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 13:11:20.169401 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169356    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 13:11:20.169401 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169359    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 13:11:20.169401 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169362    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 13:11:20.169401 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169366    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 13:11:20.169401 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169369    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 13:11:20.169401 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169371    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 13:11:20.169401 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169374    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 13:11:20.169401 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169376    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 13:11:20.169401 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169379    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 13:11:20.169401 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169381    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 13:11:20.169401 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169385    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 13:11:20.169401 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169388    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 13:11:20.169401 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169390    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 13:11:20.169401 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169392    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 13:11:20.169401 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169395    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 13:11:20.169401 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169398    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 13:11:20.169401 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169400    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 13:11:20.169401 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169403    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 13:11:20.169913 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169405    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 13:11:20.169913 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169408    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 13:11:20.169913 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169411    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 13:11:20.169913 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169414    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 13:11:20.169913 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169416    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 13:11:20.169913 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169419    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 13:11:20.169913 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169421    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 13:11:20.169913 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169424    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 13:11:20.169913 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169426    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 13:11:20.169913 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169429    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 13:11:20.169913 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169431    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 13:11:20.169913 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169434    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 13:11:20.169913 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169436    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 13:11:20.169913 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169439    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 13:11:20.169913 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169441    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 13:11:20.169913 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169444    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 13:11:20.169913 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169446    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 13:11:20.169913 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169449    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 13:11:20.169913 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169451    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 13:11:20.169913 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169453    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 13:11:20.170405 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169456    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 13:11:20.170405 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169458    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 13:11:20.170405 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169461    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 13:11:20.170405 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169463    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 13:11:20.170405 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169466    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 13:11:20.170405 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169469    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 13:11:20.170405 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169471    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 13:11:20.170405 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169474    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 13:11:20.170405 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169476    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 13:11:20.170405 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169479    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 13:11:20.170405 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169482    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 13:11:20.170405 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169484    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 13:11:20.170405 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169487    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 13:11:20.170405 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169490    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 13:11:20.170405 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169492    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 13:11:20.170405 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169495    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 13:11:20.170405 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169497    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 13:11:20.170405 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169501    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 13:11:20.170405 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169504    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 13:11:20.170847 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169508    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 13:11:20.170847 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169511    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 13:11:20.170847 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169513    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 13:11:20.170847 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169516    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 13:11:20.170847 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169518    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 13:11:20.170847 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169522    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 13:11:20.170847 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169524    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 13:11:20.170847 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169527    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 13:11:20.170847 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169529    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 13:11:20.170847 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169532    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 13:11:20.170847 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169534    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 13:11:20.170847 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169536    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 13:11:20.170847 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169539    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 13:11:20.170847 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169542    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 13:11:20.170847 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169544    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 13:11:20.170847 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169546    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 13:11:20.170847 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169549    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 13:11:20.170847 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169551    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 13:11:20.170847 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169554    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 13:11:20.170847 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169557    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 13:11:20.171329 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169559    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 13:11:20.171329 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169562    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 13:11:20.171329 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169565    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 13:11:20.171329 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169567    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 13:11:20.171329 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169570    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 13:11:20.171329 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169572    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 13:11:20.171329 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169576    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 13:11:20.171329 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169579    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 13:11:20.171329 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169581    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 13:11:20.171329 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169584    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 13:11:20.171329 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169587    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 13:11:20.171329 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169590    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 13:11:20.171329 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169593    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 13:11:20.171329 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169595    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 13:11:20.171329 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169598    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 13:11:20.171329 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169602    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 13:11:20.171329 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169605    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 13:11:20.171329 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169610    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 13:11:20.171329 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169982    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 13:11:20.171884 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169987    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 13:11:20.171884 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169991    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 13:11:20.171884 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169994    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 13:11:20.171884 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.169998    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 13:11:20.171884 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170000    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 13:11:20.171884 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170003    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 13:11:20.171884 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170006    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 13:11:20.171884 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170008    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 13:11:20.171884 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170011    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 13:11:20.171884 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170013    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 13:11:20.171884 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170016    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 13:11:20.171884 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170018    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 13:11:20.171884 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170021    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 13:11:20.171884 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170024    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 13:11:20.171884 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170028    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 13:11:20.171884 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170030    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 13:11:20.171884 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170033    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 13:11:20.171884 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170035    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 13:11:20.171884 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170038    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 13:11:20.171884 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170041    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 13:11:20.172385 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170044    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 13:11:20.172385 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170046    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 13:11:20.172385 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170049    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 13:11:20.172385 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170051    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 13:11:20.172385 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170054    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 13:11:20.172385 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170057    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 13:11:20.172385 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170059    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 13:11:20.172385 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170061    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 13:11:20.172385 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170064    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 13:11:20.172385 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170066    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 13:11:20.172385 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170069    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 13:11:20.172385 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170071    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 13:11:20.172385 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170074    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 13:11:20.172385 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170076    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 13:11:20.172385 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170079    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 13:11:20.172385 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170081    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 13:11:20.172385 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170084    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 13:11:20.172385 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170086    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 13:11:20.172385 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170089    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 13:11:20.172826 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170093    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 13:11:20.172826 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170096    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 13:11:20.172826 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170099    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 13:11:20.172826 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170103    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 13:11:20.172826 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170106    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 13:11:20.172826 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170109    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 13:11:20.172826 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170112    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 13:11:20.172826 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170114    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 13:11:20.172826 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170117    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 13:11:20.172826 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170120    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 13:11:20.172826 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170122    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 13:11:20.172826 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170125    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 13:11:20.172826 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170128    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 13:11:20.172826 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170130    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 13:11:20.172826 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170133    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 13:11:20.172826 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170135    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 13:11:20.172826 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170138    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 13:11:20.172826 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170140    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 13:11:20.172826 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170143    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 13:11:20.173307 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170145    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 13:11:20.173307 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170147    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 13:11:20.173307 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170150    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 13:11:20.173307 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170152    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 13:11:20.173307 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170155    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 13:11:20.173307 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170157    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 13:11:20.173307 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170160    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 13:11:20.173307 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170162    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 13:11:20.173307 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170165    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 13:11:20.173307 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170167    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 13:11:20.173307 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170170    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 13:11:20.173307 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170172    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 13:11:20.173307 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170175    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 13:11:20.173307 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170177    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 13:11:20.173307 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170180    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 13:11:20.173307 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170182    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 13:11:20.173307 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170185    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 13:11:20.173307 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170189    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 13:11:20.173307 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170192    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 13:11:20.173753 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170195    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 13:11:20.173753 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170198    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 13:11:20.173753 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170215    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 13:11:20.173753 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170218    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 13:11:20.173753 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170220    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 13:11:20.173753 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170223    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 13:11:20.173753 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170226    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 13:11:20.173753 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170229    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 13:11:20.173753 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170234    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 13:11:20.173753 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170238    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 13:11:20.173753 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170241    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 13:11:20.173753 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170244    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 13:11:20.173753 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170246    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 13:11:20.173753 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170249    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 13:11:20.173753 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170251    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 13:11:20.173753 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170254    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 13:11:20.173753 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170256    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 13:11:20.173753 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170259    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 13:11:20.173753 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170261    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 13:11:20.173753 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170264    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 13:11:20.174231 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170267    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 13:11:20.174231 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170343    2578 flags.go:64] FLAG: --address="0.0.0.0"
Jul 15 13:11:20.174231 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170353    2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 15 13:11:20.174231 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170361    2578 flags.go:64] FLAG: --anonymous-auth="true"
Jul 15 13:11:20.174231 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170367    2578 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 15 13:11:20.174231 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170373    2578 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 15 13:11:20.174231 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170378    2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 15 13:11:20.174231 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170384    2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 15 13:11:20.174231 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170390    2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 15 13:11:20.174231 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170394    2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 15 13:11:20.174231 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170397    2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 15 13:11:20.174231 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170400    2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 15 13:11:20.174231 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170403    2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 15 13:11:20.174231 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170407    2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 15 13:11:20.174231 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170411    2578 flags.go:64] FLAG: --cgroup-root=""
Jul 15 13:11:20.174231 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170414    2578 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 15 13:11:20.174231 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170417    2578 flags.go:64] FLAG: --client-ca-file=""
Jul 15 13:11:20.174231 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170420    2578 flags.go:64] FLAG: --cloud-provider="external"
Jul 15 13:11:20.174231 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170423    2578 flags.go:64] FLAG: --cluster-dns="[]"
Jul 15 13:11:20.174231 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170427    2578 flags.go:64] FLAG: --cluster-domain=""
Jul 15 13:11:20.174231 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170430    2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 15 13:11:20.174231 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170433    2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 15 13:11:20.174231 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170436    2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 15 13:11:20.174231 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170439    2578 flags.go:64] FLAG: --container-log-max-files="5"
Jul 15 13:11:20.174821 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170443    2578 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 15 13:11:20.174821 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170446    2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 15 13:11:20.174821 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170449    2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 15 13:11:20.174821 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170452    2578 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 15 13:11:20.174821 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170455    2578 flags.go:64] FLAG: --contention-profiling="false"
Jul 15 13:11:20.174821 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170458    2578 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 15 13:11:20.174821 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170461    2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 15 13:11:20.174821 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170464    2578 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 15 13:11:20.174821 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170467    2578 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 15 13:11:20.174821 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170471    2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 15 13:11:20.174821 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170474    2578 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 15 13:11:20.174821 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170477    2578 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 15 13:11:20.174821 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170480    2578 flags.go:64] FLAG: --enable-load-reader="false"
Jul 15 13:11:20.174821 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170483    2578 flags.go:64] FLAG: --enable-server="true"
Jul 15 13:11:20.174821 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170485    2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 15 13:11:20.174821 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170489    2578 flags.go:64] FLAG: --event-burst="100"
Jul 15 13:11:20.174821 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170492    2578 flags.go:64] FLAG: --event-qps="50"
Jul 15 13:11:20.174821 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170495    2578 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 15 13:11:20.174821 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170498    2578 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 15 13:11:20.174821 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170501    2578 flags.go:64] FLAG: --eviction-hard=""
Jul 15 13:11:20.174821 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170505    2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 15 13:11:20.174821 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170510    2578 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 15 13:11:20.174821 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170512    2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 15 13:11:20.174821 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170516    2578 flags.go:64] FLAG: --eviction-soft=""
Jul 15 13:11:20.174821 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170519    2578 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 15 13:11:20.175407 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170523    2578 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 15 13:11:20.175407 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170526    2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 15 13:11:20.175407 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170529    2578 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 15 13:11:20.175407 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170532    2578 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 15 13:11:20.175407 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170535    2578 flags.go:64] FLAG: --fail-swap-on="true"
Jul 15 13:11:20.175407 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170538    2578 flags.go:64] FLAG: --feature-gates=""
Jul 15 13:11:20.175407 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170541    2578 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 15 13:11:20.175407 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170544    2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 15 13:11:20.175407 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170547    2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 15 13:11:20.175407 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170550    2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 15 13:11:20.175407 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170553    2578 flags.go:64] FLAG: --healthz-port="10248"
Jul 15 13:11:20.175407 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170556    2578 flags.go:64] FLAG: --help="false"
Jul 15 13:11:20.175407 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170559    2578 flags.go:64] FLAG: --hostname-override="ip-10-0-128-159.ec2.internal"
Jul 15 13:11:20.175407 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170562    2578 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 15 13:11:20.175407 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170565    2578 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 15 13:11:20.175407 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170568    2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 15 13:11:20.175407 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170571    2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 15 13:11:20.175407 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170575    2578 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 15 13:11:20.175407 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170578    2578 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 15 13:11:20.175407 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170580    2578 flags.go:64] FLAG: --image-service-endpoint=""
Jul 15 13:11:20.175407 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170583    2578 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 15 13:11:20.175407 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170586    2578 flags.go:64] FLAG: --kube-api-burst="100"
Jul 15 13:11:20.175407 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170589    2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 15 13:11:20.175973 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170592    2578 flags.go:64] FLAG: --kube-api-qps="50"
Jul 15 13:11:20.175973 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170595    2578 flags.go:64] FLAG: --kube-reserved=""
Jul 15 13:11:20.175973 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170597    2578 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 15 13:11:20.175973 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170601    2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 15 13:11:20.175973 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170604    2578 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 15 13:11:20.175973 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170608    2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 15 13:11:20.175973 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170611    2578 flags.go:64] FLAG: --lock-file=""
Jul 15 13:11:20.175973 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170614    2578 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 15 13:11:20.175973 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170622    2578 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 15 13:11:20.175973 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170626    2578 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 15 13:11:20.175973 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170631    2578 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 15 13:11:20.175973 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170634    2578 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 15 13:11:20.175973 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170637    2578 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 15 13:11:20.175973 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170641    2578 flags.go:64] FLAG: --logging-format="text"
Jul 15 13:11:20.175973 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170644    2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 15 13:11:20.175973 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170647    2578 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 15 13:11:20.175973 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170650    2578 flags.go:64] FLAG: --manifest-url=""
Jul 15 13:11:20.175973 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170653    2578 flags.go:64] FLAG: --manifest-url-header=""
Jul 15 13:11:20.175973 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170657    2578 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 15 13:11:20.175973 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170660    2578 flags.go:64] FLAG: --max-open-files="1000000"
Jul 15 13:11:20.175973 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170664    2578 flags.go:64] FLAG: --max-pods="110"
Jul 15 13:11:20.175973 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170667    2578 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 15 13:11:20.175973 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170670    2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 15 13:11:20.175973 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170673    2578 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 15 13:11:20.175973 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170676    2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 15 13:11:20.176587 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170679    2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 15 13:11:20.176587 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170682    2578 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 15 13:11:20.176587 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170684    2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 15 13:11:20.176587 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170691    2578 flags.go:64] FLAG: --node-status-max-images="50"
Jul 15 13:11:20.176587 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170695    2578 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 15 13:11:20.176587 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170697    2578 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 15 13:11:20.176587 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170701    2578 flags.go:64] FLAG: --pod-cidr=""
Jul 15 13:11:20.176587 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170703    2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 15 13:11:20.176587 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170708    2578 flags.go:64] FLAG: --pod-manifest-path=""
Jul 15 13:11:20.176587 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170711    2578 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 15 13:11:20.176587 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170714    2578 flags.go:64] FLAG: --pods-per-core="0"
Jul 15 13:11:20.176587 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170717    2578 flags.go:64] FLAG: --port="10250"
Jul 15 13:11:20.176587 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170720    2578 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 15 13:11:20.176587 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170725    2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-012463860a08c7ac0"
Jul 15 13:11:20.176587 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170728    2578 flags.go:64] FLAG: --qos-reserved=""
Jul 15 13:11:20.176587 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170731    2578 flags.go:64] FLAG: --read-only-port="10255"
Jul 15 13:11:20.176587 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170736    2578 flags.go:64] FLAG: --register-node="true"
Jul 15 13:11:20.176587 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170739    2578 flags.go:64] FLAG: --register-with-taints=""
Jul 15 13:11:20.176587 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170742    2578 flags.go:64] FLAG: --registry-burst="10"
Jul 15 13:11:20.176587 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170745    2578 flags.go:64] FLAG: --registry-qps="5"
Jul 15 13:11:20.176587 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170748    2578 flags.go:64] FLAG: --reserved-cpus=""
Jul 15 13:11:20.176587 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170751    2578 flags.go:64] FLAG: --reserved-memory=""
Jul 15 13:11:20.176587 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170754    2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 15 13:11:20.176587 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170757    2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 15 13:11:20.176587 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170760    2578 flags.go:64] FLAG: --rotate-certificates="false"
Jul 15 13:11:20.177180 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170763    2578 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 15 13:11:20.177180 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170765    2578 flags.go:64] FLAG: --runonce="false"
Jul 15 13:11:20.177180 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170768    2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 15 13:11:20.177180 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170771    2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 15 13:11:20.177180 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170774    2578 flags.go:64] FLAG: --seccomp-default="false"
Jul 15 13:11:20.177180 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170777    2578 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 15 13:11:20.177180 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170779    2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 15 13:11:20.177180 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170783    2578 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 15 13:11:20.177180 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170786    2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 15 13:11:20.177180 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170789    2578 flags.go:64] FLAG: --storage-driver-password="root"
Jul 15 13:11:20.177180 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170792    2578 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 15 13:11:20.177180 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170794    2578 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 15 13:11:20.177180 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170797    2578 flags.go:64] FLAG: --storage-driver-user="root"
Jul 15 13:11:20.177180 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170800    2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 15 13:11:20.177180 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170803    2578 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 15 13:11:20.177180 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170806    2578 flags.go:64] FLAG: --system-cgroups=""
Jul 15 13:11:20.177180 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170808    2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 15 13:11:20.177180 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170814    2578 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 15 13:11:20.177180 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170816    2578 flags.go:64] FLAG: --tls-cert-file=""
Jul 15 13:11:20.177180 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170819    2578 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 15 13:11:20.177180 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170825    2578 flags.go:64] FLAG: --tls-min-version=""
Jul 15 13:11:20.177180 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170828    2578 flags.go:64] FLAG: --tls-private-key-file=""
Jul 15 13:11:20.177180 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170831    2578 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 15 13:11:20.177180 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170835    2578 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 15 13:11:20.177180 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170839    2578 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 15 13:11:20.177832 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170842    2578 flags.go:64] FLAG: --v="2"
Jul 15 13:11:20.177832 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170846    2578 flags.go:64] FLAG: --version="false"
Jul 15 13:11:20.177832 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170850    2578 flags.go:64] FLAG: --vmodule=""
Jul 15 13:11:20.177832 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170853    2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 15 13:11:20.177832 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.170857    2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 15 13:11:20.177832 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170964    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 13:11:20.177832 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170968    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 13:11:20.177832 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170971    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 13:11:20.177832 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170974    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 13:11:20.177832 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170977    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 13:11:20.177832 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170982    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 13:11:20.177832 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170985    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 13:11:20.177832 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170988    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 13:11:20.177832 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170991    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 13:11:20.177832 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170993    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 13:11:20.177832 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170996    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 13:11:20.177832 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.170999    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 13:11:20.177832 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171001    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 13:11:20.177832 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171004    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 13:11:20.177832 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171006    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 13:11:20.178362 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171009    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 13:11:20.178362 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171011    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 13:11:20.178362 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171014    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 13:11:20.178362 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171016    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 13:11:20.178362 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171018    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 13:11:20.178362 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171021    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 13:11:20.178362 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171023    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 13:11:20.178362 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171027    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 13:11:20.178362 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171030    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 13:11:20.178362 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171032    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 13:11:20.178362 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171036    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 13:11:20.178362 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171040    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 13:11:20.178362 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171044    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 13:11:20.178362 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171047    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 13:11:20.178362 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171050    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 13:11:20.178362 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171052    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 13:11:20.178362 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171055    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 13:11:20.178362 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171057    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 13:11:20.178362 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171060    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 13:11:20.178803 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171063    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 13:11:20.178803 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171065    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 13:11:20.178803 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171069    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 13:11:20.178803 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171073    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 13:11:20.178803 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171075    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 13:11:20.178803 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171078    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 13:11:20.178803 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171080    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 13:11:20.178803 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171082    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 13:11:20.178803 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171085    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 13:11:20.178803 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171088    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 13:11:20.178803 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171090    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 13:11:20.178803 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171093    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 13:11:20.178803 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171095    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 13:11:20.178803 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171098    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 13:11:20.178803 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171100    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 13:11:20.178803 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171103    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 13:11:20.178803 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171105    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 13:11:20.178803 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171108    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 13:11:20.178803 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171111    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 13:11:20.178803 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171113    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 13:11:20.179295 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171117    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 13:11:20.179295 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171120    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 13:11:20.179295 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171122    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 13:11:20.179295 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171126    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 13:11:20.179295 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171129    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 13:11:20.179295 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171131    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 13:11:20.179295 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171134    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 13:11:20.179295 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171136    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 13:11:20.179295 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171139    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 13:11:20.179295 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171142    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 13:11:20.179295 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171144    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 13:11:20.179295 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171147    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 13:11:20.179295 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171149    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 13:11:20.179295 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171152    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 13:11:20.179295 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171154    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 13:11:20.179295 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171157    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 13:11:20.179295 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171160    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 13:11:20.179295 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171162    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 13:11:20.179295 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171164    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 13:11:20.179295 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171167    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 13:11:20.179771 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171169    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 13:11:20.179771 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171172    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 13:11:20.179771 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171174    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 13:11:20.179771 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171177    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 13:11:20.179771 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171180    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 13:11:20.179771 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171183    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 13:11:20.179771 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171185    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 13:11:20.179771 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171188    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 13:11:20.179771 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171190    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 13:11:20.179771 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171193    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 13:11:20.179771 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171195    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 13:11:20.179771 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171197    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 13:11:20.179771 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171214    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 13:11:20.179771 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171217    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 13:11:20.179771 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171220    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 13:11:20.179771 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171224    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 13:11:20.179771 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171226    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 13:11:20.179771 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171229    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 13:11:20.179771 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171231    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 13:11:20.179771 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171234    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 13:11:20.180279 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171237    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 13:11:20.180279 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171240    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 13:11:20.180279 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171243    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 13:11:20.180279 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171246    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 13:11:20.180279 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.171248    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 13:11:20.180279 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.171623    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 13:11:20.180279 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.178874    2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 15 13:11:20.180279 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.178888    2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 15 13:11:20.180279 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.179592    2578 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 15 13:11:20.180279 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.179603    2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 15 13:11:20.180279 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179658    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 13:11:20.180279 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179665    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 13:11:20.180279 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179669    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 13:11:20.180279 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179673    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 13:11:20.180618 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179677    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 13:11:20.180618 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179680    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 13:11:20.180618 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179683    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 13:11:20.180618 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179686    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 13:11:20.180618 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179689    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 13:11:20.180618 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179692    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 13:11:20.180618 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179695    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 13:11:20.180618 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179698    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 13:11:20.180618 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179700    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 13:11:20.180618 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179703    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 13:11:20.180618 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179706    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 13:11:20.180618 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179708    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 13:11:20.180618 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179711    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 13:11:20.180618 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179713    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 13:11:20.180618 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179716    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 13:11:20.180618 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179718    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 13:11:20.180618 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179721    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 13:11:20.180618 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179723    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 13:11:20.180618 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179726    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 13:11:20.181071 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179728    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 13:11:20.181071 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179731    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 13:11:20.181071 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179733    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 13:11:20.181071 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179736    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 13:11:20.181071 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179738    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 13:11:20.181071 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179741    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 13:11:20.181071 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179746    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 13:11:20.181071 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179748    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 13:11:20.181071 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179751    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 13:11:20.181071 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179754    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 13:11:20.181071 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179756    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 13:11:20.181071 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179759    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 13:11:20.181071 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179762    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 13:11:20.181071 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179764    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 13:11:20.181071 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179767    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 13:11:20.181071 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179769    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 13:11:20.181071 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179772    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 13:11:20.181071 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179775    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 13:11:20.181071 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179778    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 13:11:20.181071 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179780    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 13:11:20.181624 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179783    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 13:11:20.181624 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179785    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 13:11:20.181624 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179788    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 13:11:20.181624 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179791    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 13:11:20.181624 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179793    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 13:11:20.181624 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179796    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 13:11:20.181624 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179798    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 13:11:20.181624 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179801    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 13:11:20.181624 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179803    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 13:11:20.181624 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179806    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 13:11:20.181624 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179809    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 13:11:20.181624 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179811    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 13:11:20.181624 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179813    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 13:11:20.181624 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179816    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 13:11:20.181624 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179818    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 13:11:20.181624 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179821    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 13:11:20.181624 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179824    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 13:11:20.181624 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179826    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 13:11:20.181624 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179829    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 13:11:20.181624 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179833    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 13:11:20.182093 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179835    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 13:11:20.182093 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179838    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 13:11:20.182093 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179840    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 13:11:20.182093 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179843    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 13:11:20.182093 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179845    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 13:11:20.182093 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179848    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 13:11:20.182093 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179850    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 13:11:20.182093 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179853    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 13:11:20.182093 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179855    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 13:11:20.182093 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179858    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 13:11:20.182093 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179860    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 13:11:20.182093 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179863    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 13:11:20.182093 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179865    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 13:11:20.182093 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179868    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 13:11:20.182093 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179870    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 13:11:20.182093 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179873    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 13:11:20.182093 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179876    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 13:11:20.182093 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179878    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 13:11:20.182093 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179881    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 13:11:20.182093 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179883    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 13:11:20.182571 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179886    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 13:11:20.182571 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179888    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 13:11:20.182571 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179891    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 13:11:20.182571 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179893    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 13:11:20.182571 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179896    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 13:11:20.182571 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179898    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 13:11:20.182571 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179900    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 13:11:20.182571 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179903    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 13:11:20.182571 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179905    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 13:11:20.182571 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179908    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 13:11:20.182571 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179911    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 13:11:20.182571 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179913    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 13:11:20.182571 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179916    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 13:11:20.182571 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179919    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 13:11:20.182571 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179923    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 13:11:20.182571 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.179927    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 13:11:20.182954 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.179933    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 13:11:20.182954 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180041    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 13:11:20.182954 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180046    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 13:11:20.182954 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180049    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 13:11:20.182954 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180052    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 13:11:20.182954 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180055    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 13:11:20.182954 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180058    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 13:11:20.182954 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180061    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 13:11:20.182954 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180064    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 13:11:20.182954 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180066    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 13:11:20.182954 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180069    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 13:11:20.182954 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180072    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 13:11:20.182954 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180074    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 13:11:20.182954 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180077    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 13:11:20.182954 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180080    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 13:11:20.183331 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180082    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 13:11:20.183331 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180085    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 13:11:20.183331 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180087    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 13:11:20.183331 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180090    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 13:11:20.183331 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180092    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 13:11:20.183331 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180095    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 13:11:20.183331 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180097    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 13:11:20.183331 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180100    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 13:11:20.183331 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180102    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 13:11:20.183331 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180105    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 13:11:20.183331 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180107    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 13:11:20.183331 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180110    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 13:11:20.183331 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180113    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 13:11:20.183331 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180115    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 13:11:20.183331 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180118    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 13:11:20.183331 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180121    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 13:11:20.183331 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180123    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 13:11:20.183331 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180126    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 13:11:20.183331 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180128    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 13:11:20.183331 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180131    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 13:11:20.183829 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180133    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 13:11:20.183829 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180136    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 13:11:20.183829 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180138    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 13:11:20.183829 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180140    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 13:11:20.183829 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180143    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 13:11:20.183829 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180145    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 13:11:20.183829 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180148    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 13:11:20.183829 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180150    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 13:11:20.183829 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180153    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 13:11:20.183829 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180155    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 13:11:20.183829 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180158    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 13:11:20.183829 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180160    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 13:11:20.183829 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180163    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 13:11:20.183829 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180165    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 13:11:20.183829 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180168    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 13:11:20.183829 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180170    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 13:11:20.183829 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180173    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 13:11:20.183829 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180175    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 13:11:20.183829 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180179    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 13:11:20.184294 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180182    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 13:11:20.184294 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180185    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 13:11:20.184294 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180187    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 13:11:20.184294 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180191    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 13:11:20.184294 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180195    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 13:11:20.184294 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180198    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 13:11:20.184294 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180214    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 13:11:20.184294 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180217    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 13:11:20.184294 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180221    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 13:11:20.184294 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180223    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 13:11:20.184294 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180226    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 13:11:20.184294 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180228    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 13:11:20.184294 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180231    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 13:11:20.184294 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180233    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 13:11:20.184294 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180237    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 13:11:20.184294 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180240    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 13:11:20.184294 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180243    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 13:11:20.184294 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180246    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 13:11:20.184294 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180249    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 13:11:20.184294 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180251    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 13:11:20.184769 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180254    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 13:11:20.184769 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180256    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 13:11:20.184769 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180259    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 13:11:20.184769 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180262    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 13:11:20.184769 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180264    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 13:11:20.184769 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180267    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 13:11:20.184769 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180270    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 13:11:20.184769 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180272    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 13:11:20.184769 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180275    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 13:11:20.184769 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180277    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 13:11:20.184769 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180280    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 13:11:20.184769 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180282    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 13:11:20.184769 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180285    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 13:11:20.184769 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180288    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 13:11:20.184769 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180291    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 13:11:20.184769 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180294    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 13:11:20.184769 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180296    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 13:11:20.184769 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180299    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 13:11:20.184769 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180302    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 13:11:20.184769 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180304    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 13:11:20.185308 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180307    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 13:11:20.185308 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180310    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 13:11:20.185308 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180312    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 13:11:20.185308 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180315    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 13:11:20.185308 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180317    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 13:11:20.185308 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:20.180320    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 13:11:20.185308 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.180325    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 13:11:20.185308 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.180422    2578 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 15 13:11:20.185308 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.182312    2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 15 13:11:20.185308 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.183489    2578 server.go:1019] "Starting client certificate rotation"
Jul 15 13:11:20.185308 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.183584    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 13:11:20.185308 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.183613    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 13:11:20.185815 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.185802    2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 13:11:20.190046 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.190032    2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 13:11:20.200644 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.200620    2578 log.go:25] "Validated CRI v1 runtime API"
Jul 15 13:11:20.202579 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.202562    2578 log.go:25] "Validated CRI v1 image API"
Jul 15 13:11:20.203398 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.203384    2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 15 13:11:20.207250 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.207224    2578 fs.go:135] Filesystem UUIDs: map[544d6c72-dcbb-41a5-add5-b01d4e028343:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 d58f262e-4b42-499b-9ff9-8d9e515cc93a:/dev/nvme0n1p3]
Jul 15 13:11:20.207318 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.207250    2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 15 13:11:20.212911 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.212803    2578 manager.go:216] Machine: {Timestamp:2026-07-15 13:11:20.211556764 +0000 UTC m=+0.299343696 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098721 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2794b3be8bc265fb529d14c6e575d7 SystemUUID:ec2794b3-be8b-c265-fb52-9d14c6e575d7 BootID:76f04c38-ce32-45da-a271-b90a4492a6f6 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:0f:88:59:3e:87 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:0f:88:59:3e:87 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b2:d6:2d:ba:4f:8d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 15 13:11:20.212911 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.212901    2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 15 13:11:20.213023 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.212983    2578 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 15 13:11:20.215710 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.215684    2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 15 13:11:20.215835 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.215714    2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-159.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 15 13:11:20.216407 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.216397    2578 topology_manager.go:138] "Creating topology manager with none policy"
Jul 15 13:11:20.216446 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.216408    2578 container_manager_linux.go:309] "Creating device plugin manager"
Jul 15 13:11:20.216446 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.216415    2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 13:11:20.217138 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.217128    2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 13:11:20.217835 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.217822    2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 15 13:11:20.218310 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.218297    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 13:11:20.220408 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.220397    2578 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 13:11:20.220540 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.220529    2578 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 15 13:11:20.220578 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.220561    2578 kubelet.go:486] "Attempting to sync node with API server"
Jul 15 13:11:20.220578 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.220572    2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 15 13:11:20.220636 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.220586    2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 15 13:11:20.220636 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.220595    2578 kubelet.go:398] "Adding apiserver pod source"
Jul 15 13:11:20.220636 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.220604    2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 15 13:11:20.220944 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.220933    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 13:11:20.220982 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.220952    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 13:11:20.224176 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.224160    2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 15 13:11:20.225383 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.225370    2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 15 13:11:20.225427 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.225400    2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 15 13:11:20.225912 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.225902    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 15 13:11:20.225954 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.225917    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 15 13:11:20.225954 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.225924    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 15 13:11:20.225954 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.225929    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 15 13:11:20.225954 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.225937    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 15 13:11:20.225954 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.225942    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 15 13:11:20.226117 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.226108    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 15 13:11:20.226117 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.226117    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 15 13:11:20.226175 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.226124    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 15 13:11:20.226175 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.226129    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 15 13:11:20.226175 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.226145    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 15 13:11:20.226175 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.226152    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 15 13:11:20.226175 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.226173    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 15 13:11:20.226175 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.226179    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 15 13:11:20.229137 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.229124    2578 server.go:1268] "Started kubelet"
Jul 15 13:11:20.229292 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.229238    2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 15 13:11:20.229386 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.229339    2578 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 15 13:11:20.229450 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.229397    2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 15 13:11:20.229946 ip-10-0-128-159 systemd[1]: Started Kubernetes Kubelet.
Jul 15 13:11:20.232021 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.232004    2578 server.go:310] "Adding debug handlers to kubelet server"
Jul 15 13:11:20.233764 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.233735    2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 15 13:11:20.234731 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:20.234708    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 15 13:11:20.234826 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.234813    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-159.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 15 13:11:20.234961 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:20.234933    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-159.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 15 13:11:20.235855 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:20.235832    2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 15 13:11:20.237043 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.237025    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 15 13:11:20.237430 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.237414    2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 15 13:11:20.237595 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:20.237539    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-159.ec2.internal\" not found"
Jul 15 13:11:20.238076 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.238058    2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 15 13:11:20.238076 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.238060    2578 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 15 13:11:20.238218 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.238085    2578 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 15 13:11:20.238218 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.238101    2578 factory.go:55] Registering systemd factory
Jul 15 13:11:20.238218 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.238117    2578 factory.go:223] Registration of the systemd container factory successfully
Jul 15 13:11:20.238218 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.238188    2578 reconstruct.go:97] "Volume reconstruction finished"
Jul 15 13:11:20.238218 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.238220    2578 reconciler.go:29] "Reconciler: start to sync state"
Jul 15 13:11:20.238453 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.238371    2578 factory.go:153] Registering CRI-O factory
Jul 15 13:11:20.238453 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.238383    2578 factory.go:223] Registration of the crio container factory successfully
Jul 15 13:11:20.238453 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.238423    2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 15 13:11:20.238453 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.238446    2578 factory.go:103] Registering Raw factory
Jul 15 13:11:20.238577 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.238459    2578 manager.go:1196] Started watching for new ooms in manager
Jul 15 13:11:20.239122 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:20.238176    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-159.ec2.internal.18c278ab77577389  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-159.ec2.internal,UID:ip-10-0-128-159.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-159.ec2.internal,},FirstTimestamp:2026-07-15 13:11:20.229098377 +0000 UTC m=+0.316885310,LastTimestamp:2026-07-15 13:11:20.229098377 +0000 UTC m=+0.316885310,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-159.ec2.internal,}"
Jul 15 13:11:20.239301 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.239288    2578 manager.go:349] Starting recovery of all containers
Jul 15 13:11:20.245401 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:20.245372    2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-159.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 15 13:11:20.245528 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:20.245507    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 15 13:11:20.249555 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.249540    2578 manager.go:354] Recovery completed
Jul 15 13:11:20.254062 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.254050    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 13:11:20.255798 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.255781    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-159.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 13:11:20.255861 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.255809    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-159.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 13:11:20.255861 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.255845    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-159.ec2.internal" event="NodeHasSufficientPID"
Jul 15 13:11:20.256421 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.256406    2578 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 15 13:11:20.256477 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.256422    2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 15 13:11:20.256477 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.256429    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 13:11:20.256477 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.256439    2578 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 13:11:20.257125 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.257111    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-159.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 13:11:20.257171 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.257150    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-159.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 13:11:20.257171 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.257163    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-159.ec2.internal" event="NodeHasSufficientPID"
Jul 15 13:11:20.257545 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.257533    2578 policy_none.go:49] "None policy: Start"
Jul 15 13:11:20.257607 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.257560    2578 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 15 13:11:20.257607 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.257575    2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 15 13:11:20.258495 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:20.258433    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-159.ec2.internal.18c278ab78eed20c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-159.ec2.internal,UID:ip-10-0-128-159.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-159.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-159.ec2.internal,},FirstTimestamp:2026-07-15 13:11:20.255795724 +0000 UTC m=+0.343582659,LastTimestamp:2026-07-15 13:11:20.255795724 +0000 UTC m=+0.343582659,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-159.ec2.internal,}"
Jul 15 13:11:20.258631 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.258619    2578 policy_none.go:47] "Start"
Jul 15 13:11:20.270059 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.269900    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-285hh"
Jul 15 13:11:20.270337 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:20.270180    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-159.ec2.internal.18c278ab78ef205e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-159.ec2.internal,UID:ip-10-0-128-159.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-159.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-159.ec2.internal,},FirstTimestamp:2026-07-15 13:11:20.255815774 +0000 UTC m=+0.343602707,LastTimestamp:2026-07-15 13:11:20.255815774 +0000 UTC m=+0.343602707,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-159.ec2.internal,}"
Jul 15 13:11:20.278566 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:20.278486    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-159.ec2.internal.18c278ab78efac3f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-159.ec2.internal,UID:ip-10-0-128-159.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-159.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-159.ec2.internal,},FirstTimestamp:2026-07-15 13:11:20.255851583 +0000 UTC m=+0.343638517,LastTimestamp:2026-07-15 13:11:20.255851583 +0000 UTC m=+0.343638517,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-159.ec2.internal,}"
Jul 15 13:11:20.281669 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.281650    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-285hh"
Jul 15 13:11:20.292734 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.292720    2578 manager.go:337] "Starting Device Plugin manager"
Jul 15 13:11:20.292804 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:20.292755    2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 15 13:11:20.292804 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.292764    2578 server.go:87] "Starting device plugin registration server"
Jul 15 13:11:20.292974 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.292963    2578 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 15 13:11:20.293046 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.292977    2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 15 13:11:20.293131 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.293112    2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 15 13:11:20.293221 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.293194    2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 15 13:11:20.293221 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.293221    2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 15 13:11:20.293646 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:20.293627    2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 15 13:11:20.293733 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:20.293667    2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-159.ec2.internal\" not found"
Jul 15 13:11:20.367527 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.367495    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 15 13:11:20.368747 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.368729    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 15 13:11:20.368842 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.368765    2578 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 15 13:11:20.368842 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.368787    2578 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 15 13:11:20.368842 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:20.368826    2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 15 13:11:20.372212 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.372193    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 13:11:20.393668 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.393654    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 13:11:20.394538 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.394522    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-159.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 13:11:20.394616 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.394550    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-159.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 13:11:20.394616 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.394561    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-159.ec2.internal" event="NodeHasSufficientPID"
Jul 15 13:11:20.394616 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.394581    2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-159.ec2.internal"
Jul 15 13:11:20.404833 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.404809    2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-159.ec2.internal"
Jul 15 13:11:20.404902 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:20.404837    2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-159.ec2.internal\": node \"ip-10-0-128-159.ec2.internal\" not found"
Jul 15 13:11:20.446908 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:20.446852    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-159.ec2.internal\" not found"
Jul 15 13:11:20.469665 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.469646    2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-159.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-159.ec2.internal"]
Jul 15 13:11:20.469719 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.469702    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 13:11:20.470556 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.470539    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-159.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 13:11:20.470640 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.470572    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-159.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 13:11:20.470640 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.470585    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-159.ec2.internal" event="NodeHasSufficientPID"
Jul 15 13:11:20.471809 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.471796    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 13:11:20.471962 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.471949    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-159.ec2.internal"
Jul 15 13:11:20.472019 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.471979    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 13:11:20.472543 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.472528    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-159.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 13:11:20.472628 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.472554    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-159.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 13:11:20.472628 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.472575    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-159.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 13:11:20.472628 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.472587    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-159.ec2.internal" event="NodeHasSufficientPID"
Jul 15 13:11:20.472628 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.472558    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-159.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 13:11:20.472770 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.472645    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-159.ec2.internal" event="NodeHasSufficientPID"
Jul 15 13:11:20.473950 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.473928    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-159.ec2.internal"
Jul 15 13:11:20.473950 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.473954    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 13:11:20.474698 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.474676    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-159.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 13:11:20.474698 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.474701    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-159.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 13:11:20.474850 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.474715    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-159.ec2.internal" event="NodeHasSufficientPID"
Jul 15 13:11:20.498073 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:20.498054    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-159.ec2.internal\" not found" node="ip-10-0-128-159.ec2.internal"
Jul 15 13:11:20.502904 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:20.502886    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-159.ec2.internal\" not found" node="ip-10-0-128-159.ec2.internal"
Jul 15 13:11:20.540117 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.540095    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1165be53751c04520f8a3ebe54bb29b3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-159.ec2.internal\" (UID: \"1165be53751c04520f8a3ebe54bb29b3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-159.ec2.internal"
Jul 15 13:11:20.540194 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.540122    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1165be53751c04520f8a3ebe54bb29b3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-159.ec2.internal\" (UID: \"1165be53751c04520f8a3ebe54bb29b3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-159.ec2.internal"
Jul 15 13:11:20.540194 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.540140    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/176fec2e1fa731a8b2c054cee79a9e44-config\") pod \"kube-apiserver-proxy-ip-10-0-128-159.ec2.internal\" (UID: \"176fec2e1fa731a8b2c054cee79a9e44\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-159.ec2.internal"
Jul 15 13:11:20.547579 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:20.547562    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-159.ec2.internal\" not found"
Jul 15 13:11:20.641337 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.641309    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/176fec2e1fa731a8b2c054cee79a9e44-config\") pod \"kube-apiserver-proxy-ip-10-0-128-159.ec2.internal\" (UID: \"176fec2e1fa731a8b2c054cee79a9e44\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-159.ec2.internal"
Jul 15 13:11:20.641445 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.641371    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/176fec2e1fa731a8b2c054cee79a9e44-config\") pod \"kube-apiserver-proxy-ip-10-0-128-159.ec2.internal\" (UID: \"176fec2e1fa731a8b2c054cee79a9e44\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-159.ec2.internal"
Jul 15 13:11:20.641445 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.641407    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1165be53751c04520f8a3ebe54bb29b3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-159.ec2.internal\" (UID: \"1165be53751c04520f8a3ebe54bb29b3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-159.ec2.internal"
Jul 15 13:11:20.641445 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.641432    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1165be53751c04520f8a3ebe54bb29b3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-159.ec2.internal\" (UID: \"1165be53751c04520f8a3ebe54bb29b3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-159.ec2.internal"
Jul 15 13:11:20.641541 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.641468    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1165be53751c04520f8a3ebe54bb29b3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-159.ec2.internal\" (UID: \"1165be53751c04520f8a3ebe54bb29b3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-159.ec2.internal"
Jul 15 13:11:20.641541 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.641486    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1165be53751c04520f8a3ebe54bb29b3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-159.ec2.internal\" (UID: \"1165be53751c04520f8a3ebe54bb29b3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-159.ec2.internal"
Jul 15 13:11:20.648620 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:20.648601    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-159.ec2.internal\" not found"
Jul 15 13:11:20.748794 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:20.748718    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-159.ec2.internal\" not found"
Jul 15 13:11:20.803417 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.803370    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-159.ec2.internal"
Jul 15 13:11:20.805555 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:20.805534    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-159.ec2.internal"
Jul 15 13:11:20.848815 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:20.848783    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-159.ec2.internal\" not found"
Jul 15 13:11:20.949989 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:20.949957    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-159.ec2.internal\" not found"
Jul 15 13:11:21.050304 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:21.050235    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-159.ec2.internal\" not found"
Jul 15 13:11:21.151369 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:21.151340    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-159.ec2.internal\" not found"
Jul 15 13:11:21.166333 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:21.166317    2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 13:11:21.183614 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:21.183590    2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 15 13:11:21.183732 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:21.183714    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 15 13:11:21.183778 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:21.183751    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 15 13:11:21.252092 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:21.252068    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-159.ec2.internal\" not found"
Jul 15 13:11:21.285357 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:21.285323    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 13:06:20 +0000 UTC" deadline="2027-12-31 01:33:55.823479529 +0000 UTC"
Jul 15 13:11:21.285357 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:21.285352    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12804h22m34.538130507s"
Jul 15 13:11:21.352953 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:21.352924    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-159.ec2.internal\" not found"
Jul 15 13:11:21.364896 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:21.364874    2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 13:11:21.370352 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:21.370336    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 13:11:21.371626 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:21.371607    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-159.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 13:11:21.371714 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:21.371639    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-159.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 13:11:21.371714 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:21.371651    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-159.ec2.internal" event="NodeHasSufficientPID"
Jul 15 13:11:21.426323 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:21.426280    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1165be53751c04520f8a3ebe54bb29b3.slice/crio-1d0c26ced58478dd63df46259c6c117d23cb2f6775000363dd74f2fe94b7a79c WatchSource:0}: Error finding container 1d0c26ced58478dd63df46259c6c117d23cb2f6775000363dd74f2fe94b7a79c: Status 404 returned error can't find the container with id 1d0c26ced58478dd63df46259c6c117d23cb2f6775000363dd74f2fe94b7a79c
Jul 15 13:11:21.431765 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:21.431749    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 13:11:21.453898 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:21.453876    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-159.ec2.internal\" not found"
Jul 15 13:11:21.554259 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:21.554229    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-159.ec2.internal\" not found"
Jul 15 13:11:21.601781 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:21.601730    2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 13:11:21.639403 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:21.639364    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-159.ec2.internal"
Jul 15 13:11:21.657849 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:21.657826    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 13:11:21.658902 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:21.658889    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-159.ec2.internal"
Jul 15 13:11:21.669645 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:21.669623    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 13:11:22.106059 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.106027    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 13:11:22.221918 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.221891    2578 apiserver.go:52] "Watching apiserver"
Jul 15 13:11:22.237614 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.237589    2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 15 13:11:22.238603 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.238576    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 15 13:11:22.238871 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.238849    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-twr26","openshift-image-registry/node-ca-9lrlb","openshift-network-operator/iptables-alerter-5dz25","kube-system/kube-apiserver-proxy-ip-10-0-128-159.ec2.internal","openshift-dns/node-resolver-wdgw4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-159.ec2.internal","openshift-multus/multus-additional-cni-plugins-wnvdj","openshift-multus/multus-x8fd7","openshift-multus/network-metrics-daemon-czmkz","openshift-network-diagnostics/network-check-target-d9lt8","openshift-ovn-kubernetes/ovnkube-node-kt6q4","kube-system/global-pull-secret-syncer-c8fxj","kube-system/konnectivity-agent-xpsbk","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qjg4m"]
Jul 15 13:11:22.240706 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.240688    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9lt8"
Jul 15 13:11:22.240839 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:22.240812    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9lt8" podUID="4a77382a-0656-4d70-88ce-01e6bf697342"
Jul 15 13:11:22.241812 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.241791    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xpsbk"
Jul 15 13:11:22.242892 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.242871    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5dz25"
Jul 15 13:11:22.244172 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.244147    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qjg4m"
Jul 15 13:11:22.245329 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.245307    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wdgw4"
Jul 15 13:11:22.246688 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.246657    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-x8fd7"
Jul 15 13:11:22.246793 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.246708    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 15 13:11:22.248093 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.248072    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-czmkz"
Jul 15 13:11:22.248197 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:22.248160    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-czmkz" podUID="c2029ab2-4966-4b8c-ba6c-e69cf982a372"
Jul 15 13:11:22.249559 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.249541    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wnvdj"
Jul 15 13:11:22.250870 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.250847    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9lrlb"
Jul 15 13:11:22.252312 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.252294    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-twr26"
Jul 15 13:11:22.254121 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.254100    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.255377 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.255356    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c8fxj"
Jul 15 13:11:22.255468 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:22.255427    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c8fxj" podUID="1415012e-b242-427c-a9b8-6950353b06a4"
Jul 15 13:11:22.316153 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.316131    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 15 13:11:22.317624 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.317606    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 15 13:11:22.319304 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.319285    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 15 13:11:22.321190 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.321166    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 15 13:11:22.321562 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.321535    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 15 13:11:22.324034 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.324018    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 15 13:11:22.330165 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.330148    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 15 13:11:22.330294 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.330262    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-tblgr\""
Jul 15 13:11:22.330973 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.330948    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 15 13:11:22.331131 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.331038    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 15 13:11:22.331209 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.331171    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 15 13:11:22.331463 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.331443    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 15 13:11:22.333339 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.331966    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 15 13:11:22.333339 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.332367    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 15 13:11:22.333339 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.333083    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 15 13:11:22.333339 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.333097    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 15 13:11:22.333339 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.333279    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 15 13:11:22.333625 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.333472    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 15 13:11:22.333625 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.333568    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-q66df\""
Jul 15 13:11:22.333625 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.333578    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bdmbq\""
Jul 15 13:11:22.333764 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.333748    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 15 13:11:22.333814 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.333760    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-mpqds\""
Jul 15 13:11:22.333814 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.333794    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 15 13:11:22.334008 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.333974    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-q6mcc\""
Jul 15 13:11:22.334084 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.334018    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5b5lh\""
Jul 15 13:11:22.334199 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.334183    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 15 13:11:22.334278 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.334214    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 15 13:11:22.334431 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.334405    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 15 13:11:22.334484 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.334411    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 15 13:11:22.334763 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.334598    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 15 13:11:22.334763 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.334649    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-tnrlc\""
Jul 15 13:11:22.334763 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.334692    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kc98x\""
Jul 15 13:11:22.334763 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.334746    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-tb46p\""
Jul 15 13:11:22.335608 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.335582    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 15 13:11:22.339032 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.339015    2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 15 13:11:22.340526 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.340500    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 15 13:11:22.353192 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.353163    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-node-log\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.353192 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.353196    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d8ecbaa-0817-4175-bd66-aaf270bc1ea1-etc-kubernetes\") pod \"tuned-twr26\" (UID: \"7d8ecbaa-0817-4175-bd66-aaf270bc1ea1\") " pod="openshift-cluster-node-tuning-operator/tuned-twr26"
Jul 15 13:11:22.353383 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.353229    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2fa39bfb-9a76-4f5a-8452-4f125ef46c59-host-slash\") pod \"iptables-alerter-5dz25\" (UID: \"2fa39bfb-9a76-4f5a-8452-4f125ef46c59\") " pod="openshift-network-operator/iptables-alerter-5dz25"
Jul 15 13:11:22.353383 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.353255    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/33ecfc20-20ff-48a9-9b57-7a24725e54b5-sys-fs\") pod \"aws-ebs-csi-driver-node-qjg4m\" (UID: \"33ecfc20-20ff-48a9-9b57-7a24725e54b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qjg4m"
Jul 15 13:11:22.353383 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.353302    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d074fc32-a8e5-47e3-a374-45b85504df8c-cni-binary-copy\") pod \"multus-x8fd7\" (UID: \"d074fc32-a8e5-47e3-a374-45b85504df8c\") " pod="openshift-multus/multus-x8fd7"
Jul 15 13:11:22.353383 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.353370    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7d8ecbaa-0817-4175-bd66-aaf270bc1ea1-etc-sysctl-d\") pod \"tuned-twr26\" (UID: \"7d8ecbaa-0817-4175-bd66-aaf270bc1ea1\") " pod="openshift-cluster-node-tuning-operator/tuned-twr26"
Jul 15 13:11:22.353562 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.353421    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7d8ecbaa-0817-4175-bd66-aaf270bc1ea1-run\") pod \"tuned-twr26\" (UID: \"7d8ecbaa-0817-4175-bd66-aaf270bc1ea1\") " pod="openshift-cluster-node-tuning-operator/tuned-twr26"
Jul 15 13:11:22.353562 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.353449    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-host-slash\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.353562 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.353484    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-run-openvswitch\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.353562 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.353519    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-env-overrides\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.353562 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.353544    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 13:11:22.353815 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.353544    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d074fc32-a8e5-47e3-a374-45b85504df8c-multus-socket-dir-parent\") pod \"multus-x8fd7\" (UID: \"d074fc32-a8e5-47e3-a374-45b85504df8c\") " pod="openshift-multus/multus-x8fd7"
Jul 15 13:11:22.353815 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.353596    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hvszg"
Jul 15 13:11:22.353815 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.353609    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d074fc32-a8e5-47e3-a374-45b85504df8c-etc-kubernetes\") pod \"multus-x8fd7\" (UID: \"d074fc32-a8e5-47e3-a374-45b85504df8c\") " pod="openshift-multus/multus-x8fd7"
Jul 15 13:11:22.353815 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.353655    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7d8ecbaa-0817-4175-bd66-aaf270bc1ea1-etc-modprobe-d\") pod \"tuned-twr26\" (UID: \"7d8ecbaa-0817-4175-bd66-aaf270bc1ea1\") " pod="openshift-cluster-node-tuning-operator/tuned-twr26"
Jul 15 13:11:22.353815 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.353681    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7d8ecbaa-0817-4175-bd66-aaf270bc1ea1-etc-sysctl-conf\") pod \"tuned-twr26\" (UID: \"7d8ecbaa-0817-4175-bd66-aaf270bc1ea1\") " pod="openshift-cluster-node-tuning-operator/tuned-twr26"
Jul 15 13:11:22.353815 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.353710    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-log-socket\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.353815 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.353756    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-host-run-ovn-kubernetes\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.353815 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.353789    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2029ab2-4966-4b8c-ba6c-e69cf982a372-metrics-certs\") pod \"network-metrics-daemon-czmkz\" (UID: \"c2029ab2-4966-4b8c-ba6c-e69cf982a372\") " pod="openshift-multus/network-metrics-daemon-czmkz"
Jul 15 13:11:22.354160 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.353818    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1415012e-b242-427c-a9b8-6950353b06a4-kubelet-config\") pod \"global-pull-secret-syncer-c8fxj\" (UID: \"1415012e-b242-427c-a9b8-6950353b06a4\") " pod="kube-system/global-pull-secret-syncer-c8fxj"
Jul 15 13:11:22.354160 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.353850    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d074fc32-a8e5-47e3-a374-45b85504df8c-multus-cni-dir\") pod \"multus-x8fd7\" (UID: \"d074fc32-a8e5-47e3-a374-45b85504df8c\") " pod="openshift-multus/multus-x8fd7"
Jul 15 13:11:22.354160 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.353879    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-var-lib-openvswitch\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.354160 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.353909    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-ovnkube-script-lib\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.354160 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.353936    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8b3c491a-f49d-405c-adf0-a1c12886786e-konnectivity-ca\") pod \"konnectivity-agent-xpsbk\" (UID: \"8b3c491a-f49d-405c-adf0-a1c12886786e\") " pod="kube-system/konnectivity-agent-xpsbk"
Jul 15 13:11:22.354160 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.353963    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fp7kj\" (UniqueName: \"kubernetes.io/projected/33ecfc20-20ff-48a9-9b57-7a24725e54b5-kube-api-access-fp7kj\") pod \"aws-ebs-csi-driver-node-qjg4m\" (UID: \"33ecfc20-20ff-48a9-9b57-7a24725e54b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qjg4m"
Jul 15 13:11:22.354160 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.353990    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed59f469-1285-4452-ac9a-a178f674611f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wnvdj\" (UID: \"ed59f469-1285-4452-ac9a-a178f674611f\") " pod="openshift-multus/multus-additional-cni-plugins-wnvdj"
Jul 15 13:11:22.354160 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.354014    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d074fc32-a8e5-47e3-a374-45b85504df8c-host-var-lib-cni-multus\") pod \"multus-x8fd7\" (UID: \"d074fc32-a8e5-47e3-a374-45b85504df8c\") " pod="openshift-multus/multus-x8fd7"
Jul 15 13:11:22.354160 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.354038    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d074fc32-a8e5-47e3-a374-45b85504df8c-host-var-lib-kubelet\") pod \"multus-x8fd7\" (UID: \"d074fc32-a8e5-47e3-a374-45b85504df8c\") " pod="openshift-multus/multus-x8fd7"
Jul 15 13:11:22.354160 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.354067    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7d8ecbaa-0817-4175-bd66-aaf270bc1ea1-host\") pod \"tuned-twr26\" (UID: \"7d8ecbaa-0817-4175-bd66-aaf270bc1ea1\") " pod="openshift-cluster-node-tuning-operator/tuned-twr26"
Jul 15 13:11:22.354160 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.354126    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7d8ecbaa-0817-4175-bd66-aaf270bc1ea1-sys\") pod \"tuned-twr26\" (UID: \"7d8ecbaa-0817-4175-bd66-aaf270bc1ea1\") " pod="openshift-cluster-node-tuning-operator/tuned-twr26"
Jul 15 13:11:22.354160 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.354150    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t46pz\" (UniqueName: \"kubernetes.io/projected/7d8ecbaa-0817-4175-bd66-aaf270bc1ea1-kube-api-access-t46pz\") pod \"tuned-twr26\" (UID: \"7d8ecbaa-0817-4175-bd66-aaf270bc1ea1\") " pod="openshift-cluster-node-tuning-operator/tuned-twr26"
Jul 15 13:11:22.354734 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.354174    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/33ecfc20-20ff-48a9-9b57-7a24725e54b5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qjg4m\" (UID: \"33ecfc20-20ff-48a9-9b57-7a24725e54b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qjg4m"
Jul 15 13:11:22.354734 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.354200    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/33ecfc20-20ff-48a9-9b57-7a24725e54b5-registration-dir\") pod \"aws-ebs-csi-driver-node-qjg4m\" (UID: \"33ecfc20-20ff-48a9-9b57-7a24725e54b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qjg4m"
Jul 15 13:11:22.354734 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.354222    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d8ecbaa-0817-4175-bd66-aaf270bc1ea1-tmp\") pod \"tuned-twr26\" (UID: \"7d8ecbaa-0817-4175-bd66-aaf270bc1ea1\") " pod="openshift-cluster-node-tuning-operator/tuned-twr26"
Jul 15 13:11:22.354734 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.354261    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-ovn-node-metrics-cert\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.354734 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.354289    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2fa39bfb-9a76-4f5a-8452-4f125ef46c59-iptables-alerter-script\") pod \"iptables-alerter-5dz25\" (UID: \"2fa39bfb-9a76-4f5a-8452-4f125ef46c59\") " pod="openshift-network-operator/iptables-alerter-5dz25"
Jul 15 13:11:22.354734 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.354314    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kttqp\" (UniqueName: \"kubernetes.io/projected/ed59f469-1285-4452-ac9a-a178f674611f-kube-api-access-kttqp\") pod \"multus-additional-cni-plugins-wnvdj\" (UID: \"ed59f469-1285-4452-ac9a-a178f674611f\") " pod="openshift-multus/multus-additional-cni-plugins-wnvdj"
Jul 15 13:11:22.354734 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.354338    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d074fc32-a8e5-47e3-a374-45b85504df8c-host-var-lib-cni-bin\") pod \"multus-x8fd7\" (UID: \"d074fc32-a8e5-47e3-a374-45b85504df8c\") " pod="openshift-multus/multus-x8fd7"
Jul 15 13:11:22.354734 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.354363    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7d8ecbaa-0817-4175-bd66-aaf270bc1ea1-etc-systemd\") pod \"tuned-twr26\" (UID: \"7d8ecbaa-0817-4175-bd66-aaf270bc1ea1\") " pod="openshift-cluster-node-tuning-operator/tuned-twr26"
Jul 15 13:11:22.354734 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.354387    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-host-run-netns\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.354734 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.354411    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed59f469-1285-4452-ac9a-a178f674611f-cni-binary-copy\") pod \"multus-additional-cni-plugins-wnvdj\" (UID: \"ed59f469-1285-4452-ac9a-a178f674611f\") " pod="openshift-multus/multus-additional-cni-plugins-wnvdj"
Jul 15 13:11:22.354734 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.354435    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d074fc32-a8e5-47e3-a374-45b85504df8c-multus-daemon-config\") pod \"multus-x8fd7\" (UID: \"d074fc32-a8e5-47e3-a374-45b85504df8c\") " pod="openshift-multus/multus-x8fd7"
Jul 15 13:11:22.354734 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.354460    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed59f469-1285-4452-ac9a-a178f674611f-cnibin\") pod \"multus-additional-cni-plugins-wnvdj\" (UID: \"ed59f469-1285-4452-ac9a-a178f674611f\") " pod="openshift-multus/multus-additional-cni-plugins-wnvdj"
Jul 15 13:11:22.354734 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.354504    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ed59f469-1285-4452-ac9a-a178f674611f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wnvdj\" (UID: \"ed59f469-1285-4452-ac9a-a178f674611f\") " pod="openshift-multus/multus-additional-cni-plugins-wnvdj"
Jul 15 13:11:22.354734 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.354529    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d074fc32-a8e5-47e3-a374-45b85504df8c-cnibin\") pod \"multus-x8fd7\" (UID: \"d074fc32-a8e5-47e3-a374-45b85504df8c\") " pod="openshift-multus/multus-x8fd7"
Jul 15 13:11:22.354734 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.354553    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d074fc32-a8e5-47e3-a374-45b85504df8c-multus-conf-dir\") pod \"multus-x8fd7\" (UID: \"d074fc32-a8e5-47e3-a374-45b85504df8c\") " pod="openshift-multus/multus-x8fd7"
Jul 15 13:11:22.354734 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.354578    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zx2t8\" (UniqueName: \"kubernetes.io/projected/d074fc32-a8e5-47e3-a374-45b85504df8c-kube-api-access-zx2t8\") pod \"multus-x8fd7\" (UID: \"d074fc32-a8e5-47e3-a374-45b85504df8c\") " pod="openshift-multus/multus-x8fd7"
Jul 15 13:11:22.355404 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.354605    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7d8ecbaa-0817-4175-bd66-aaf270bc1ea1-etc-tuned\") pod \"tuned-twr26\" (UID: \"7d8ecbaa-0817-4175-bd66-aaf270bc1ea1\") " pod="openshift-cluster-node-tuning-operator/tuned-twr26"
Jul 15 13:11:22.355404 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.354641    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/56d93a5b-2111-4969-9ef3-9e58f7e2cb82-hosts-file\") pod \"node-resolver-wdgw4\" (UID: \"56d93a5b-2111-4969-9ef3-9e58f7e2cb82\") " pod="openshift-dns/node-resolver-wdgw4"
Jul 15 13:11:22.355404 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.354687    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/740cd63d-7aa0-464d-be90-87aea6674efa-host\") pod \"node-ca-9lrlb\" (UID: \"740cd63d-7aa0-464d-be90-87aea6674efa\") " pod="openshift-image-registry/node-ca-9lrlb"
Jul 15 13:11:22.355404 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.354707    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7d8ecbaa-0817-4175-bd66-aaf270bc1ea1-lib-modules\") pod \"tuned-twr26\" (UID: \"7d8ecbaa-0817-4175-bd66-aaf270bc1ea1\") " pod="openshift-cluster-node-tuning-operator/tuned-twr26"
Jul 15 13:11:22.355404 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.354732    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-host-cni-bin\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.355404 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.354758    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/33ecfc20-20ff-48a9-9b57-7a24725e54b5-etc-selinux\") pod \"aws-ebs-csi-driver-node-qjg4m\" (UID: \"33ecfc20-20ff-48a9-9b57-7a24725e54b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qjg4m"
Jul 15 13:11:22.355404 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.354779    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhrpc\" (UniqueName: \"kubernetes.io/projected/4a77382a-0656-4d70-88ce-01e6bf697342-kube-api-access-jhrpc\") pod \"network-check-target-d9lt8\" (UID: \"4a77382a-0656-4d70-88ce-01e6bf697342\") " pod="openshift-network-diagnostics/network-check-target-d9lt8"
Jul 15 13:11:22.355404 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.354801    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d074fc32-a8e5-47e3-a374-45b85504df8c-os-release\") pod \"multus-x8fd7\" (UID: \"d074fc32-a8e5-47e3-a374-45b85504df8c\") " pod="openshift-multus/multus-x8fd7"
Jul 15 13:11:22.355404 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.354826    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d074fc32-a8e5-47e3-a374-45b85504df8c-host-run-k8s-cni-cncf-io\") pod \"multus-x8fd7\" (UID: \"d074fc32-a8e5-47e3-a374-45b85504df8c\") " pod="openshift-multus/multus-x8fd7"
Jul 15 13:11:22.355404 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.354864    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-run-systemd\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.355404 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.354898    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dz72k\" (UniqueName: \"kubernetes.io/projected/56d93a5b-2111-4969-9ef3-9e58f7e2cb82-kube-api-access-dz72k\") pod \"node-resolver-wdgw4\" (UID: \"56d93a5b-2111-4969-9ef3-9e58f7e2cb82\") " pod="openshift-dns/node-resolver-wdgw4"
Jul 15 13:11:22.355404 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.354926    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7d8ecbaa-0817-4175-bd66-aaf270bc1ea1-etc-sysconfig\") pod \"tuned-twr26\" (UID: \"7d8ecbaa-0817-4175-bd66-aaf270bc1ea1\") " pod="openshift-cluster-node-tuning-operator/tuned-twr26"
Jul 15 13:11:22.355404 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.354950    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-host-kubelet\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.355404 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.355018    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-systemd-units\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.355404 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.355057    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-etc-openvswitch\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.355404 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.355102    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-ovnkube-config\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.356116 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.355136    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9hcq\" (UniqueName: \"kubernetes.io/projected/2fa39bfb-9a76-4f5a-8452-4f125ef46c59-kube-api-access-j9hcq\") pod \"iptables-alerter-5dz25\" (UID: \"2fa39bfb-9a76-4f5a-8452-4f125ef46c59\") " pod="openshift-network-operator/iptables-alerter-5dz25"
Jul 15 13:11:22.356116 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.355163    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56d93a5b-2111-4969-9ef3-9e58f7e2cb82-tmp-dir\") pod \"node-resolver-wdgw4\" (UID: \"56d93a5b-2111-4969-9ef3-9e58f7e2cb82\") " pod="openshift-dns/node-resolver-wdgw4"
Jul 15 13:11:22.356116 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.355190    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ed59f469-1285-4452-ac9a-a178f674611f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wnvdj\" (UID: \"ed59f469-1285-4452-ac9a-a178f674611f\") " pod="openshift-multus/multus-additional-cni-plugins-wnvdj"
Jul 15 13:11:22.356116 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.355235    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d8ecbaa-0817-4175-bd66-aaf270bc1ea1-var-lib-kubelet\") pod \"tuned-twr26\" (UID: \"7d8ecbaa-0817-4175-bd66-aaf270bc1ea1\") " pod="openshift-cluster-node-tuning-operator/tuned-twr26"
Jul 15 13:11:22.356116 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.355263    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/33ecfc20-20ff-48a9-9b57-7a24725e54b5-socket-dir\") pod \"aws-ebs-csi-driver-node-qjg4m\" (UID: \"33ecfc20-20ff-48a9-9b57-7a24725e54b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qjg4m"
Jul 15 13:11:22.356116 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.355300    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d074fc32-a8e5-47e3-a374-45b85504df8c-system-cni-dir\") pod \"multus-x8fd7\" (UID: \"d074fc32-a8e5-47e3-a374-45b85504df8c\") " pod="openshift-multus/multus-x8fd7"
Jul 15 13:11:22.356116 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.355342    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-host-cni-netd\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.356116 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.355369    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.356116 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.355396    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8b3c491a-f49d-405c-adf0-a1c12886786e-agent-certs\") pod \"konnectivity-agent-xpsbk\" (UID: \"8b3c491a-f49d-405c-adf0-a1c12886786e\") " pod="kube-system/konnectivity-agent-xpsbk"
Jul 15 13:11:22.356116 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.355421    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/33ecfc20-20ff-48a9-9b57-7a24725e54b5-device-dir\") pod \"aws-ebs-csi-driver-node-qjg4m\" (UID: \"33ecfc20-20ff-48a9-9b57-7a24725e54b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qjg4m"
Jul 15 13:11:22.356116 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.355440    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ed59f469-1285-4452-ac9a-a178f674611f-os-release\") pod \"multus-additional-cni-plugins-wnvdj\" (UID: \"ed59f469-1285-4452-ac9a-a178f674611f\") " pod="openshift-multus/multus-additional-cni-plugins-wnvdj"
Jul 15 13:11:22.356116 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.355483    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d074fc32-a8e5-47e3-a374-45b85504df8c-host-run-netns\") pod \"multus-x8fd7\" (UID: \"d074fc32-a8e5-47e3-a374-45b85504df8c\") " pod="openshift-multus/multus-x8fd7"
Jul 15 13:11:22.356116 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.355510    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d074fc32-a8e5-47e3-a374-45b85504df8c-host-run-multus-certs\") pod \"multus-x8fd7\" (UID: \"d074fc32-a8e5-47e3-a374-45b85504df8c\") " pod="openshift-multus/multus-x8fd7"
Jul 15 13:11:22.356116 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.355531    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzfc5\" (UniqueName: \"kubernetes.io/projected/740cd63d-7aa0-464d-be90-87aea6674efa-kube-api-access-nzfc5\") pod \"node-ca-9lrlb\" (UID: \"740cd63d-7aa0-464d-be90-87aea6674efa\") " pod="openshift-image-registry/node-ca-9lrlb"
Jul 15 13:11:22.356116 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.355555    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-run-ovn\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.356116 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.355578    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d074fc32-a8e5-47e3-a374-45b85504df8c-hostroot\") pod \"multus-x8fd7\" (UID: \"d074fc32-a8e5-47e3-a374-45b85504df8c\") " pod="openshift-multus/multus-x8fd7"
Jul 15 13:11:22.356737 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.355598    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/740cd63d-7aa0-464d-be90-87aea6674efa-serviceca\") pod \"node-ca-9lrlb\" (UID: \"740cd63d-7aa0-464d-be90-87aea6674efa\") " pod="openshift-image-registry/node-ca-9lrlb"
Jul 15 13:11:22.356737 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.355623    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttmch\" (UniqueName: \"kubernetes.io/projected/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-kube-api-access-ttmch\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.356737 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.355649    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdrc5\" (UniqueName: \"kubernetes.io/projected/c2029ab2-4966-4b8c-ba6c-e69cf982a372-kube-api-access-tdrc5\") pod \"network-metrics-daemon-czmkz\" (UID: \"c2029ab2-4966-4b8c-ba6c-e69cf982a372\") " pod="openshift-multus/network-metrics-daemon-czmkz"
Jul 15 13:11:22.356737 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.355667    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed59f469-1285-4452-ac9a-a178f674611f-system-cni-dir\") pod \"multus-additional-cni-plugins-wnvdj\" (UID: \"ed59f469-1285-4452-ac9a-a178f674611f\") " pod="openshift-multus/multus-additional-cni-plugins-wnvdj"
Jul 15 13:11:22.356737 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.355683    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1415012e-b242-427c-a9b8-6950353b06a4-dbus\") pod \"global-pull-secret-syncer-c8fxj\" (UID: \"1415012e-b242-427c-a9b8-6950353b06a4\") " pod="kube-system/global-pull-secret-syncer-c8fxj"
Jul 15 13:11:22.356737 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.355706    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1415012e-b242-427c-a9b8-6950353b06a4-original-pull-secret\") pod \"global-pull-secret-syncer-c8fxj\" (UID: \"1415012e-b242-427c-a9b8-6950353b06a4\") " pod="kube-system/global-pull-secret-syncer-c8fxj"
Jul 15 13:11:22.373333 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.373283    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-159.ec2.internal" event={"ID":"1165be53751c04520f8a3ebe54bb29b3","Type":"ContainerStarted","Data":"1d0c26ced58478dd63df46259c6c117d23cb2f6775000363dd74f2fe94b7a79c"}
Jul 15 13:11:22.456174 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.456143    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d074fc32-a8e5-47e3-a374-45b85504df8c-cni-binary-copy\") pod \"multus-x8fd7\" (UID: \"d074fc32-a8e5-47e3-a374-45b85504df8c\") " pod="openshift-multus/multus-x8fd7"
Jul 15 13:11:22.456333 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.456185    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7d8ecbaa-0817-4175-bd66-aaf270bc1ea1-etc-sysctl-d\") pod \"tuned-twr26\" (UID: \"7d8ecbaa-0817-4175-bd66-aaf270bc1ea1\") " pod="openshift-cluster-node-tuning-operator/tuned-twr26"
Jul 15 13:11:22.456333 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.456229    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7d8ecbaa-0817-4175-bd66-aaf270bc1ea1-run\") pod \"tuned-twr26\" (UID: \"7d8ecbaa-0817-4175-bd66-aaf270bc1ea1\") " pod="openshift-cluster-node-tuning-operator/tuned-twr26"
Jul 15 13:11:22.456333 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.456253    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-host-slash\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.456333 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.456278    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-run-openvswitch\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.456333 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.456302    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-env-overrides\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.456333 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.456323    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d074fc32-a8e5-47e3-a374-45b85504df8c-multus-socket-dir-parent\") pod \"multus-x8fd7\" (UID: \"d074fc32-a8e5-47e3-a374-45b85504df8c\") " pod="openshift-multus/multus-x8fd7"
Jul 15 13:11:22.456665 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.456337    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-host-slash\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.456665 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.456363    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-run-openvswitch\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.456665 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.456345    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d074fc32-a8e5-47e3-a374-45b85504df8c-etc-kubernetes\") pod \"multus-x8fd7\" (UID: \"d074fc32-a8e5-47e3-a374-45b85504df8c\") " pod="openshift-multus/multus-x8fd7"
Jul 15 13:11:22.456665 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.456386    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d074fc32-a8e5-47e3-a374-45b85504df8c-etc-kubernetes\") pod \"multus-x8fd7\" (UID: \"d074fc32-a8e5-47e3-a374-45b85504df8c\") " pod="openshift-multus/multus-x8fd7"
Jul 15 13:11:22.456665 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.456418    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7d8ecbaa-0817-4175-bd66-aaf270bc1ea1-etc-modprobe-d\") pod \"tuned-twr26\" (UID: \"7d8ecbaa-0817-4175-bd66-aaf270bc1ea1\") " pod="openshift-cluster-node-tuning-operator/tuned-twr26"
Jul 15 13:11:22.456665 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.456419    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7d8ecbaa-0817-4175-bd66-aaf270bc1ea1-etc-sysctl-d\") pod \"tuned-twr26\" (UID: \"7d8ecbaa-0817-4175-bd66-aaf270bc1ea1\") " pod="openshift-cluster-node-tuning-operator/tuned-twr26"
Jul 15 13:11:22.456665 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.456430    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7d8ecbaa-0817-4175-bd66-aaf270bc1ea1-run\") pod \"tuned-twr26\" (UID: \"7d8ecbaa-0817-4175-bd66-aaf270bc1ea1\") " pod="openshift-cluster-node-tuning-operator/tuned-twr26"
Jul 15 13:11:22.456665 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.456446    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7d8ecbaa-0817-4175-bd66-aaf270bc1ea1-etc-sysctl-conf\") pod \"tuned-twr26\" (UID: \"7d8ecbaa-0817-4175-bd66-aaf270bc1ea1\") " pod="openshift-cluster-node-tuning-operator/tuned-twr26"
Jul 15 13:11:22.456665 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.456454    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d074fc32-a8e5-47e3-a374-45b85504df8c-multus-socket-dir-parent\") pod \"multus-x8fd7\" (UID: \"d074fc32-a8e5-47e3-a374-45b85504df8c\") " pod="openshift-multus/multus-x8fd7"
Jul 15 13:11:22.456665 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.456474    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-log-socket\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.456665 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.456504    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-host-run-ovn-kubernetes\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.456665 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.456516    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7d8ecbaa-0817-4175-bd66-aaf270bc1ea1-etc-modprobe-d\") pod \"tuned-twr26\" (UID: \"7d8ecbaa-0817-4175-bd66-aaf270bc1ea1\") " pod="openshift-cluster-node-tuning-operator/tuned-twr26"
Jul 15 13:11:22.456665 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.456530    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2029ab2-4966-4b8c-ba6c-e69cf982a372-metrics-certs\") pod \"network-metrics-daemon-czmkz\" (UID: \"c2029ab2-4966-4b8c-ba6c-e69cf982a372\") " pod="openshift-multus/network-metrics-daemon-czmkz"
Jul 15 13:11:22.456665 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.456557    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1415012e-b242-427c-a9b8-6950353b06a4-kubelet-config\") pod \"global-pull-secret-syncer-c8fxj\" (UID: \"1415012e-b242-427c-a9b8-6950353b06a4\") " pod="kube-system/global-pull-secret-syncer-c8fxj"
Jul 15 13:11:22.456665 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.456560    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-log-socket\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.456665 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.456573    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7d8ecbaa-0817-4175-bd66-aaf270bc1ea1-etc-sysctl-conf\") pod \"tuned-twr26\" (UID: \"7d8ecbaa-0817-4175-bd66-aaf270bc1ea1\") " pod="openshift-cluster-node-tuning-operator/tuned-twr26"
Jul 15 13:11:22.456665 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.456573    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-host-run-ovn-kubernetes\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.456665 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.456597    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d074fc32-a8e5-47e3-a374-45b85504df8c-multus-cni-dir\") pod \"multus-x8fd7\" (UID: \"d074fc32-a8e5-47e3-a374-45b85504df8c\") " pod="openshift-multus/multus-x8fd7"
Jul 15 13:11:22.457619 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.456611    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1415012e-b242-427c-a9b8-6950353b06a4-kubelet-config\") pod \"global-pull-secret-syncer-c8fxj\" (UID: \"1415012e-b242-427c-a9b8-6950353b06a4\") " pod="kube-system/global-pull-secret-syncer-c8fxj"
Jul 15 13:11:22.457619 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.456627    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-var-lib-openvswitch\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.457619 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.456647    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-ovnkube-script-lib\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.457619 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.456668    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8b3c491a-f49d-405c-adf0-a1c12886786e-konnectivity-ca\") pod \"konnectivity-agent-xpsbk\" (UID: \"8b3c491a-f49d-405c-adf0-a1c12886786e\") " pod="kube-system/konnectivity-agent-xpsbk"
Jul 15 13:11:22.457619 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:22.456659    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 13:11:22.457619 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.456696    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fp7kj\" (UniqueName: \"kubernetes.io/projected/33ecfc20-20ff-48a9-9b57-7a24725e54b5-kube-api-access-fp7kj\") pod \"aws-ebs-csi-driver-node-qjg4m\" (UID: \"33ecfc20-20ff-48a9-9b57-7a24725e54b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qjg4m"
Jul 15 13:11:22.457619 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.456702    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-var-lib-openvswitch\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.457619 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.456719    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d074fc32-a8e5-47e3-a374-45b85504df8c-multus-cni-dir\") pod \"multus-x8fd7\" (UID: \"d074fc32-a8e5-47e3-a374-45b85504df8c\") " pod="openshift-multus/multus-x8fd7"
Jul 15 13:11:22.457619 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.456725    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed59f469-1285-4452-ac9a-a178f674611f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wnvdj\" (UID: \"ed59f469-1285-4452-ac9a-a178f674611f\") " pod="openshift-multus/multus-additional-cni-plugins-wnvdj"
Jul 15 13:11:22.457619 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.456756    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d074fc32-a8e5-47e3-a374-45b85504df8c-host-var-lib-cni-multus\") pod \"multus-x8fd7\" (UID: \"d074fc32-a8e5-47e3-a374-45b85504df8c\") " pod="openshift-multus/multus-x8fd7"
Jul 15 13:11:22.457619 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.456812    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d074fc32-a8e5-47e3-a374-45b85504df8c-host-var-lib-kubelet\") pod \"multus-x8fd7\" (UID: \"d074fc32-a8e5-47e3-a374-45b85504df8c\") " pod="openshift-multus/multus-x8fd7"
Jul 15 13:11:22.457619 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:22.456822    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2029ab2-4966-4b8c-ba6c-e69cf982a372-metrics-certs podName:c2029ab2-4966-4b8c-ba6c-e69cf982a372 nodeName:}" failed. No retries permitted until 2026-07-15 13:11:22.956795172 +0000 UTC m=+3.044582117 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c2029ab2-4966-4b8c-ba6c-e69cf982a372-metrics-certs") pod "network-metrics-daemon-czmkz" (UID: "c2029ab2-4966-4b8c-ba6c-e69cf982a372") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 13:11:22.457619 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.456855    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d074fc32-a8e5-47e3-a374-45b85504df8c-host-var-lib-kubelet\") pod \"multus-x8fd7\" (UID: \"d074fc32-a8e5-47e3-a374-45b85504df8c\") " pod="openshift-multus/multus-x8fd7"
Jul 15 13:11:22.457619 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.456908    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7d8ecbaa-0817-4175-bd66-aaf270bc1ea1-host\") pod \"tuned-twr26\" (UID: \"7d8ecbaa-0817-4175-bd66-aaf270bc1ea1\") " pod="openshift-cluster-node-tuning-operator/tuned-twr26"
Jul 15 13:11:22.457619 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.456925    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d074fc32-a8e5-47e3-a374-45b85504df8c-cni-binary-copy\") pod \"multus-x8fd7\" (UID: \"d074fc32-a8e5-47e3-a374-45b85504df8c\") " pod="openshift-multus/multus-x8fd7"
Jul 15 13:11:22.457619 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.456997    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d074fc32-a8e5-47e3-a374-45b85504df8c-host-var-lib-cni-multus\") pod \"multus-x8fd7\" (UID: \"d074fc32-a8e5-47e3-a374-45b85504df8c\") " pod="openshift-multus/multus-x8fd7"
Jul 15 13:11:22.457619 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.456856    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7d8ecbaa-0817-4175-bd66-aaf270bc1ea1-host\") pod \"tuned-twr26\" (UID: \"7d8ecbaa-0817-4175-bd66-aaf270bc1ea1\") " pod="openshift-cluster-node-tuning-operator/tuned-twr26"
Jul 15 13:11:22.458502 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.457055    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7d8ecbaa-0817-4175-bd66-aaf270bc1ea1-sys\") pod \"tuned-twr26\" (UID: \"7d8ecbaa-0817-4175-bd66-aaf270bc1ea1\") " pod="openshift-cluster-node-tuning-operator/tuned-twr26"
Jul 15 13:11:22.458502 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.457104    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t46pz\" (UniqueName: \"kubernetes.io/projected/7d8ecbaa-0817-4175-bd66-aaf270bc1ea1-kube-api-access-t46pz\") pod \"tuned-twr26\" (UID: \"7d8ecbaa-0817-4175-bd66-aaf270bc1ea1\") " pod="openshift-cluster-node-tuning-operator/tuned-twr26"
Jul 15 13:11:22.458502 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.457127    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed59f469-1285-4452-ac9a-a178f674611f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wnvdj\" (UID: \"ed59f469-1285-4452-ac9a-a178f674611f\") " pod="openshift-multus/multus-additional-cni-plugins-wnvdj"
Jul 15 13:11:22.458502 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.457135    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/33ecfc20-20ff-48a9-9b57-7a24725e54b5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qjg4m\" (UID: \"33ecfc20-20ff-48a9-9b57-7a24725e54b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qjg4m"
Jul 15 13:11:22.458502 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.457165    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/33ecfc20-20ff-48a9-9b57-7a24725e54b5-registration-dir\") pod \"aws-ebs-csi-driver-node-qjg4m\" (UID: \"33ecfc20-20ff-48a9-9b57-7a24725e54b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qjg4m"
Jul 15 13:11:22.458502 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.457174    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7d8ecbaa-0817-4175-bd66-aaf270bc1ea1-sys\") pod \"tuned-twr26\" (UID: \"7d8ecbaa-0817-4175-bd66-aaf270bc1ea1\") " pod="openshift-cluster-node-tuning-operator/tuned-twr26"
Jul 15 13:11:22.458502 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.457173    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8b3c491a-f49d-405c-adf0-a1c12886786e-konnectivity-ca\") pod \"konnectivity-agent-xpsbk\" (UID: \"8b3c491a-f49d-405c-adf0-a1c12886786e\") " pod="kube-system/konnectivity-agent-xpsbk"
Jul 15 13:11:22.458502 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.457190    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d8ecbaa-0817-4175-bd66-aaf270bc1ea1-tmp\") pod \"tuned-twr26\" (UID: \"7d8ecbaa-0817-4175-bd66-aaf270bc1ea1\") " pod="openshift-cluster-node-tuning-operator/tuned-twr26"
Jul 15 13:11:22.458502 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.457218    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-ovn-node-metrics-cert\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.458502 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.457246    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2fa39bfb-9a76-4f5a-8452-4f125ef46c59-iptables-alerter-script\") pod \"iptables-alerter-5dz25\" (UID: \"2fa39bfb-9a76-4f5a-8452-4f125ef46c59\") " pod="openshift-network-operator/iptables-alerter-5dz25"
Jul 15 13:11:22.458502 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.457270    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/33ecfc20-20ff-48a9-9b57-7a24725e54b5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qjg4m\" (UID: \"33ecfc20-20ff-48a9-9b57-7a24725e54b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qjg4m"
Jul 15 13:11:22.458502 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.457274    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kttqp\" (UniqueName: \"kubernetes.io/projected/ed59f469-1285-4452-ac9a-a178f674611f-kube-api-access-kttqp\") pod \"multus-additional-cni-plugins-wnvdj\" (UID: \"ed59f469-1285-4452-ac9a-a178f674611f\") " pod="openshift-multus/multus-additional-cni-plugins-wnvdj"
Jul 15 13:11:22.458502 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.457320    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-ovnkube-script-lib\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.458502 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.457374    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d074fc32-a8e5-47e3-a374-45b85504df8c-host-var-lib-cni-bin\") pod \"multus-x8fd7\" (UID: \"d074fc32-a8e5-47e3-a374-45b85504df8c\") " pod="openshift-multus/multus-x8fd7"
Jul 15 13:11:22.458502 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.457323    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d074fc32-a8e5-47e3-a374-45b85504df8c-host-var-lib-cni-bin\") pod \"multus-x8fd7\" (UID: \"d074fc32-a8e5-47e3-a374-45b85504df8c\") " pod="openshift-multus/multus-x8fd7"
Jul 15 13:11:22.458502 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.457401    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-env-overrides\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.458502 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.457416    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7d8ecbaa-0817-4175-bd66-aaf270bc1ea1-etc-systemd\") pod \"tuned-twr26\" (UID: \"7d8ecbaa-0817-4175-bd66-aaf270bc1ea1\") " pod="openshift-cluster-node-tuning-operator/tuned-twr26"
Jul 15 13:11:22.459390 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.457445    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-host-run-netns\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.459390 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.457472    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed59f469-1285-4452-ac9a-a178f674611f-cni-binary-copy\") pod \"multus-additional-cni-plugins-wnvdj\" (UID: \"ed59f469-1285-4452-ac9a-a178f674611f\") " pod="openshift-multus/multus-additional-cni-plugins-wnvdj"
Jul 15 13:11:22.459390 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.457475    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/33ecfc20-20ff-48a9-9b57-7a24725e54b5-registration-dir\") pod \"aws-ebs-csi-driver-node-qjg4m\" (UID: \"33ecfc20-20ff-48a9-9b57-7a24725e54b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qjg4m"
Jul 15 13:11:22.459390 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.457498    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d074fc32-a8e5-47e3-a374-45b85504df8c-multus-daemon-config\") pod \"multus-x8fd7\" (UID: \"d074fc32-a8e5-47e3-a374-45b85504df8c\") " pod="openshift-multus/multus-x8fd7"
Jul 15 13:11:22.459390 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.457531    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed59f469-1285-4452-ac9a-a178f674611f-cnibin\") pod \"multus-additional-cni-plugins-wnvdj\" (UID: \"ed59f469-1285-4452-ac9a-a178f674611f\") " pod="openshift-multus/multus-additional-cni-plugins-wnvdj"
Jul 15 13:11:22.459390 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.457547    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7d8ecbaa-0817-4175-bd66-aaf270bc1ea1-etc-systemd\") pod \"tuned-twr26\" (UID: \"7d8ecbaa-0817-4175-bd66-aaf270bc1ea1\") " pod="openshift-cluster-node-tuning-operator/tuned-twr26"
Jul 15 13:11:22.459390 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.457577    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-host-run-netns\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.459390 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.457579    2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 15 13:11:22.459390 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.457670    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed59f469-1285-4452-ac9a-a178f674611f-cnibin\") pod \"multus-additional-cni-plugins-wnvdj\" (UID: \"ed59f469-1285-4452-ac9a-a178f674611f\") " pod="openshift-multus/multus-additional-cni-plugins-wnvdj"
Jul 15 13:11:22.459390 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.457679    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ed59f469-1285-4452-ac9a-a178f674611f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wnvdj\" (UID: \"ed59f469-1285-4452-ac9a-a178f674611f\") " pod="openshift-multus/multus-additional-cni-plugins-wnvdj"
Jul 15 13:11:22.459390 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.457710    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d074fc32-a8e5-47e3-a374-45b85504df8c-cnibin\") pod \"multus-x8fd7\" (UID: \"d074fc32-a8e5-47e3-a374-45b85504df8c\") " pod="openshift-multus/multus-x8fd7"
Jul 15 13:11:22.459390 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.457733    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d074fc32-a8e5-47e3-a374-45b85504df8c-multus-conf-dir\") pod \"multus-x8fd7\" (UID: \"d074fc32-a8e5-47e3-a374-45b85504df8c\") " pod="openshift-multus/multus-x8fd7"
Jul 15 13:11:22.459390 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.457758    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zx2t8\" (UniqueName: \"kubernetes.io/projected/d074fc32-a8e5-47e3-a374-45b85504df8c-kube-api-access-zx2t8\") pod \"multus-x8fd7\" (UID: \"d074fc32-a8e5-47e3-a374-45b85504df8c\") " pod="openshift-multus/multus-x8fd7"
Jul 15 13:11:22.459390 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.457786    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7d8ecbaa-0817-4175-bd66-aaf270bc1ea1-etc-tuned\") pod \"tuned-twr26\" (UID: \"7d8ecbaa-0817-4175-bd66-aaf270bc1ea1\") " pod="openshift-cluster-node-tuning-operator/tuned-twr26"
Jul 15 13:11:22.459390 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.457803    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d074fc32-a8e5-47e3-a374-45b85504df8c-cnibin\") pod \"multus-x8fd7\" (UID: \"d074fc32-a8e5-47e3-a374-45b85504df8c\") " pod="openshift-multus/multus-x8fd7"
Jul 15 13:11:22.459390 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.457811    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/56d93a5b-2111-4969-9ef3-9e58f7e2cb82-hosts-file\") pod \"node-resolver-wdgw4\" (UID: \"56d93a5b-2111-4969-9ef3-9e58f7e2cb82\") " pod="openshift-dns/node-resolver-wdgw4"
Jul 15 13:11:22.459390 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.457843    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/740cd63d-7aa0-464d-be90-87aea6674efa-host\") pod \"node-ca-9lrlb\" (UID: \"740cd63d-7aa0-464d-be90-87aea6674efa\") " pod="openshift-image-registry/node-ca-9lrlb"
Jul 15 13:11:22.459390 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.457858    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/56d93a5b-2111-4969-9ef3-9e58f7e2cb82-hosts-file\") pod \"node-resolver-wdgw4\" (UID: \"56d93a5b-2111-4969-9ef3-9e58f7e2cb82\") " pod="openshift-dns/node-resolver-wdgw4"
Jul 15 13:11:22.460292 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.457873    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7d8ecbaa-0817-4175-bd66-aaf270bc1ea1-lib-modules\") pod \"tuned-twr26\" (UID: \"7d8ecbaa-0817-4175-bd66-aaf270bc1ea1\") " pod="openshift-cluster-node-tuning-operator/tuned-twr26"
Jul 15 13:11:22.460292 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.457899    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d074fc32-a8e5-47e3-a374-45b85504df8c-multus-conf-dir\") pod \"multus-x8fd7\" (UID: \"d074fc32-a8e5-47e3-a374-45b85504df8c\") " pod="openshift-multus/multus-x8fd7"
Jul 15 13:11:22.460292 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.457899    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-host-cni-bin\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.460292 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.457927    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2fa39bfb-9a76-4f5a-8452-4f125ef46c59-iptables-alerter-script\") pod \"iptables-alerter-5dz25\" (UID: \"2fa39bfb-9a76-4f5a-8452-4f125ef46c59\") " pod="openshift-network-operator/iptables-alerter-5dz25"
Jul 15 13:11:22.460292 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.457931    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/33ecfc20-20ff-48a9-9b57-7a24725e54b5-etc-selinux\") pod \"aws-ebs-csi-driver-node-qjg4m\" (UID: \"33ecfc20-20ff-48a9-9b57-7a24725e54b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qjg4m"
Jul 15 13:11:22.460292 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.457985    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/740cd63d-7aa0-464d-be90-87aea6674efa-host\") pod \"node-ca-9lrlb\" (UID: \"740cd63d-7aa0-464d-be90-87aea6674efa\") " pod="openshift-image-registry/node-ca-9lrlb"
Jul 15 13:11:22.460292 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.458001    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhrpc\" (UniqueName: \"kubernetes.io/projected/4a77382a-0656-4d70-88ce-01e6bf697342-kube-api-access-jhrpc\") pod \"network-check-target-d9lt8\" (UID: \"4a77382a-0656-4d70-88ce-01e6bf697342\") " pod="openshift-network-diagnostics/network-check-target-d9lt8"
Jul 15 13:11:22.460292 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.458010    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/33ecfc20-20ff-48a9-9b57-7a24725e54b5-etc-selinux\") pod \"aws-ebs-csi-driver-node-qjg4m\" (UID: \"33ecfc20-20ff-48a9-9b57-7a24725e54b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qjg4m"
Jul 15 13:11:22.460292 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.458025    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d074fc32-a8e5-47e3-a374-45b85504df8c-multus-daemon-config\") pod \"multus-x8fd7\" (UID: \"d074fc32-a8e5-47e3-a374-45b85504df8c\") " pod="openshift-multus/multus-x8fd7"
Jul 15 13:11:22.460292 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.458030    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d074fc32-a8e5-47e3-a374-45b85504df8c-os-release\") pod \"multus-x8fd7\" (UID: \"d074fc32-a8e5-47e3-a374-45b85504df8c\") " pod="openshift-multus/multus-x8fd7"
Jul 15 13:11:22.460292 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.458089    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7d8ecbaa-0817-4175-bd66-aaf270bc1ea1-lib-modules\") pod \"tuned-twr26\" (UID: \"7d8ecbaa-0817-4175-bd66-aaf270bc1ea1\") " pod="openshift-cluster-node-tuning-operator/tuned-twr26"
Jul 15 13:11:22.460292 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.457933    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-host-cni-bin\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.460292 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.458125    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d074fc32-a8e5-47e3-a374-45b85504df8c-host-run-k8s-cni-cncf-io\") pod \"multus-x8fd7\" (UID: \"d074fc32-a8e5-47e3-a374-45b85504df8c\") " pod="openshift-multus/multus-x8fd7"
Jul 15 13:11:22.460292 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.458162    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d074fc32-a8e5-47e3-a374-45b85504df8c-host-run-k8s-cni-cncf-io\") pod \"multus-x8fd7\" (UID: \"d074fc32-a8e5-47e3-a374-45b85504df8c\") " pod="openshift-multus/multus-x8fd7"
Jul 15 13:11:22.460292 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.458167    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d074fc32-a8e5-47e3-a374-45b85504df8c-os-release\") pod \"multus-x8fd7\" (UID: \"d074fc32-a8e5-47e3-a374-45b85504df8c\") " pod="openshift-multus/multus-x8fd7"
Jul 15 13:11:22.460292 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.458165    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-run-systemd\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.460292 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.458199    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-run-systemd\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.460292 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.458203    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dz72k\" (UniqueName: \"kubernetes.io/projected/56d93a5b-2111-4969-9ef3-9e58f7e2cb82-kube-api-access-dz72k\") pod \"node-resolver-wdgw4\" (UID: \"56d93a5b-2111-4969-9ef3-9e58f7e2cb82\") " pod="openshift-dns/node-resolver-wdgw4"
Jul 15 13:11:22.461177 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.458252    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7d8ecbaa-0817-4175-bd66-aaf270bc1ea1-etc-sysconfig\") pod \"tuned-twr26\" (UID: \"7d8ecbaa-0817-4175-bd66-aaf270bc1ea1\") " pod="openshift-cluster-node-tuning-operator/tuned-twr26"
Jul 15 13:11:22.461177 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.458275    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-host-kubelet\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.461177 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.458324    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7d8ecbaa-0817-4175-bd66-aaf270bc1ea1-etc-sysconfig\") pod \"tuned-twr26\" (UID: \"7d8ecbaa-0817-4175-bd66-aaf270bc1ea1\") " pod="openshift-cluster-node-tuning-operator/tuned-twr26"
Jul 15 13:11:22.461177 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.458332    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-host-kubelet\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.461177 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.458397    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-systemd-units\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.461177 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.458458    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-etc-openvswitch\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.461177 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.458483    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-ovnkube-config\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.461177 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.458507    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9hcq\" (UniqueName: \"kubernetes.io/projected/2fa39bfb-9a76-4f5a-8452-4f125ef46c59-kube-api-access-j9hcq\") pod \"iptables-alerter-5dz25\" (UID: \"2fa39bfb-9a76-4f5a-8452-4f125ef46c59\") " pod="openshift-network-operator/iptables-alerter-5dz25"
Jul 15 13:11:22.461177 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.458530    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-systemd-units\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.461177 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.458538    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56d93a5b-2111-4969-9ef3-9e58f7e2cb82-tmp-dir\") pod \"node-resolver-wdgw4\" (UID: \"56d93a5b-2111-4969-9ef3-9e58f7e2cb82\") " pod="openshift-dns/node-resolver-wdgw4"
Jul 15 13:11:22.461177 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.458583    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ed59f469-1285-4452-ac9a-a178f674611f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wnvdj\" (UID: \"ed59f469-1285-4452-ac9a-a178f674611f\") " pod="openshift-multus/multus-additional-cni-plugins-wnvdj"
Jul 15 13:11:22.461177 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.458637    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed59f469-1285-4452-ac9a-a178f674611f-cni-binary-copy\") pod \"multus-additional-cni-plugins-wnvdj\" (UID: \"ed59f469-1285-4452-ac9a-a178f674611f\") " pod="openshift-multus/multus-additional-cni-plugins-wnvdj"
Jul 15 13:11:22.461177 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.458641    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-etc-openvswitch\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.461177 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.458864    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d8ecbaa-0817-4175-bd66-aaf270bc1ea1-var-lib-kubelet\") pod \"tuned-twr26\" (UID: \"7d8ecbaa-0817-4175-bd66-aaf270bc1ea1\") " pod="openshift-cluster-node-tuning-operator/tuned-twr26"
Jul 15 13:11:22.461177 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.458901    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/33ecfc20-20ff-48a9-9b57-7a24725e54b5-socket-dir\") pod \"aws-ebs-csi-driver-node-qjg4m\" (UID: \"33ecfc20-20ff-48a9-9b57-7a24725e54b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qjg4m"
Jul 15 13:11:22.461177 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.458928    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d074fc32-a8e5-47e3-a374-45b85504df8c-system-cni-dir\") pod \"multus-x8fd7\" (UID: \"d074fc32-a8e5-47e3-a374-45b85504df8c\") " pod="openshift-multus/multus-x8fd7"
Jul 15 13:11:22.461177 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.458941    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56d93a5b-2111-4969-9ef3-9e58f7e2cb82-tmp-dir\") pod \"node-resolver-wdgw4\" (UID: \"56d93a5b-2111-4969-9ef3-9e58f7e2cb82\") " pod="openshift-dns/node-resolver-wdgw4"
Jul 15 13:11:22.462002 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.458957    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-host-cni-netd\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.462002 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.458990    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.462002 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.459078    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d8ecbaa-0817-4175-bd66-aaf270bc1ea1-var-lib-kubelet\") pod \"tuned-twr26\" (UID: \"7d8ecbaa-0817-4175-bd66-aaf270bc1ea1\") " pod="openshift-cluster-node-tuning-operator/tuned-twr26"
Jul 15 13:11:22.462002 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.459112    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8b3c491a-f49d-405c-adf0-a1c12886786e-agent-certs\") pod \"konnectivity-agent-xpsbk\" (UID: \"8b3c491a-f49d-405c-adf0-a1c12886786e\") " pod="kube-system/konnectivity-agent-xpsbk"
Jul 15 13:11:22.462002 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.459141    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-host-cni-netd\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.462002 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.459142    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/33ecfc20-20ff-48a9-9b57-7a24725e54b5-device-dir\") pod \"aws-ebs-csi-driver-node-qjg4m\" (UID: \"33ecfc20-20ff-48a9-9b57-7a24725e54b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qjg4m"
Jul 15 13:11:22.462002 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.459185    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ed59f469-1285-4452-ac9a-a178f674611f-os-release\") pod \"multus-additional-cni-plugins-wnvdj\" (UID: \"ed59f469-1285-4452-ac9a-a178f674611f\") " pod="openshift-multus/multus-additional-cni-plugins-wnvdj"
Jul 15 13:11:22.462002 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.459197    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/33ecfc20-20ff-48a9-9b57-7a24725e54b5-device-dir\") pod \"aws-ebs-csi-driver-node-qjg4m\" (UID: \"33ecfc20-20ff-48a9-9b57-7a24725e54b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qjg4m"
Jul 15 13:11:22.462002 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.459213    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d074fc32-a8e5-47e3-a374-45b85504df8c-host-run-netns\") pod \"multus-x8fd7\" (UID: \"d074fc32-a8e5-47e3-a374-45b85504df8c\") " pod="openshift-multus/multus-x8fd7"
Jul 15 13:11:22.462002 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.459251    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d074fc32-a8e5-47e3-a374-45b85504df8c-host-run-multus-certs\") pod \"multus-x8fd7\" (UID: \"d074fc32-a8e5-47e3-a374-45b85504df8c\") " pod="openshift-multus/multus-x8fd7"
Jul 15 13:11:22.462002 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.459264    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d074fc32-a8e5-47e3-a374-45b85504df8c-host-run-netns\") pod \"multus-x8fd7\" (UID: \"d074fc32-a8e5-47e3-a374-45b85504df8c\") " pod="openshift-multus/multus-x8fd7"
Jul 15 13:11:22.462002 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.459319    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzfc5\" (UniqueName: \"kubernetes.io/projected/740cd63d-7aa0-464d-be90-87aea6674efa-kube-api-access-nzfc5\") pod \"node-ca-9lrlb\" (UID: \"740cd63d-7aa0-464d-be90-87aea6674efa\") " pod="openshift-image-registry/node-ca-9lrlb"
Jul 15 13:11:22.462002 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.459326    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.462002 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.459355    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-run-ovn\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.462002 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.459390    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d074fc32-a8e5-47e3-a374-45b85504df8c-system-cni-dir\") pod \"multus-x8fd7\" (UID: \"d074fc32-a8e5-47e3-a374-45b85504df8c\") " pod="openshift-multus/multus-x8fd7"
Jul 15 13:11:22.462002 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.459390    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ed59f469-1285-4452-ac9a-a178f674611f-os-release\") pod \"multus-additional-cni-plugins-wnvdj\" (UID: \"ed59f469-1285-4452-ac9a-a178f674611f\") " pod="openshift-multus/multus-additional-cni-plugins-wnvdj"
Jul 15 13:11:22.462002 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.459413    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d074fc32-a8e5-47e3-a374-45b85504df8c-hostroot\") pod \"multus-x8fd7\" (UID: \"d074fc32-a8e5-47e3-a374-45b85504df8c\") " pod="openshift-multus/multus-x8fd7"
Jul 15 13:11:22.462966 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.459430    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d074fc32-a8e5-47e3-a374-45b85504df8c-host-run-multus-certs\") pod \"multus-x8fd7\" (UID: \"d074fc32-a8e5-47e3-a374-45b85504df8c\") " pod="openshift-multus/multus-x8fd7"
Jul 15 13:11:22.462966 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.459468    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d074fc32-a8e5-47e3-a374-45b85504df8c-hostroot\") pod \"multus-x8fd7\" (UID: \"d074fc32-a8e5-47e3-a374-45b85504df8c\") " pod="openshift-multus/multus-x8fd7"
Jul 15 13:11:22.462966 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.459518    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/33ecfc20-20ff-48a9-9b57-7a24725e54b5-socket-dir\") pod \"aws-ebs-csi-driver-node-qjg4m\" (UID: \"33ecfc20-20ff-48a9-9b57-7a24725e54b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qjg4m"
Jul 15 13:11:22.462966 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.459556    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/740cd63d-7aa0-464d-be90-87aea6674efa-serviceca\") pod \"node-ca-9lrlb\" (UID: \"740cd63d-7aa0-464d-be90-87aea6674efa\") " pod="openshift-image-registry/node-ca-9lrlb"
Jul 15 13:11:22.462966 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.459589    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ed59f469-1285-4452-ac9a-a178f674611f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wnvdj\" (UID: \"ed59f469-1285-4452-ac9a-a178f674611f\") " pod="openshift-multus/multus-additional-cni-plugins-wnvdj"
Jul 15 13:11:22.462966 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.459622    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttmch\" (UniqueName: \"kubernetes.io/projected/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-kube-api-access-ttmch\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.462966 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.459653    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdrc5\" (UniqueName: \"kubernetes.io/projected/c2029ab2-4966-4b8c-ba6c-e69cf982a372-kube-api-access-tdrc5\") pod \"network-metrics-daemon-czmkz\" (UID: \"c2029ab2-4966-4b8c-ba6c-e69cf982a372\") " pod="openshift-multus/network-metrics-daemon-czmkz"
Jul 15 13:11:22.462966 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.459679    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-run-ovn\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.462966 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.459686    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed59f469-1285-4452-ac9a-a178f674611f-system-cni-dir\") pod \"multus-additional-cni-plugins-wnvdj\" (UID: \"ed59f469-1285-4452-ac9a-a178f674611f\") " pod="openshift-multus/multus-additional-cni-plugins-wnvdj"
Jul 15 13:11:22.462966 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.459320    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ed59f469-1285-4452-ac9a-a178f674611f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wnvdj\" (UID: \"ed59f469-1285-4452-ac9a-a178f674611f\") " pod="openshift-multus/multus-additional-cni-plugins-wnvdj"
Jul 15 13:11:22.462966 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.459711    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1415012e-b242-427c-a9b8-6950353b06a4-dbus\") pod \"global-pull-secret-syncer-c8fxj\" (UID: \"1415012e-b242-427c-a9b8-6950353b06a4\") " pod="kube-system/global-pull-secret-syncer-c8fxj"
Jul 15 13:11:22.462966 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.459738    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1415012e-b242-427c-a9b8-6950353b06a4-original-pull-secret\") pod \"global-pull-secret-syncer-c8fxj\" (UID: \"1415012e-b242-427c-a9b8-6950353b06a4\") " pod="kube-system/global-pull-secret-syncer-c8fxj"
Jul 15 13:11:22.462966 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.459773    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-node-log\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.462966 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.459799    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d8ecbaa-0817-4175-bd66-aaf270bc1ea1-etc-kubernetes\") pod \"tuned-twr26\" (UID: \"7d8ecbaa-0817-4175-bd66-aaf270bc1ea1\") " pod="openshift-cluster-node-tuning-operator/tuned-twr26"
Jul 15 13:11:22.462966 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.459825    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2fa39bfb-9a76-4f5a-8452-4f125ef46c59-host-slash\") pod \"iptables-alerter-5dz25\" (UID: \"2fa39bfb-9a76-4f5a-8452-4f125ef46c59\") " pod="openshift-network-operator/iptables-alerter-5dz25"
Jul 15 13:11:22.462966 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.459850    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/33ecfc20-20ff-48a9-9b57-7a24725e54b5-sys-fs\") pod \"aws-ebs-csi-driver-node-qjg4m\" (UID: \"33ecfc20-20ff-48a9-9b57-7a24725e54b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qjg4m"
Jul 15 13:11:22.462966 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:22.459997    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 13:11:22.462966 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.459966    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/33ecfc20-20ff-48a9-9b57-7a24725e54b5-sys-fs\") pod \"aws-ebs-csi-driver-node-qjg4m\" (UID: \"33ecfc20-20ff-48a9-9b57-7a24725e54b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qjg4m"
Jul 15 13:11:22.463889 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.460040    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d8ecbaa-0817-4175-bd66-aaf270bc1ea1-etc-kubernetes\") pod \"tuned-twr26\" (UID: \"7d8ecbaa-0817-4175-bd66-aaf270bc1ea1\") " pod="openshift-cluster-node-tuning-operator/tuned-twr26"
Jul 15 13:11:22.463889 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.460056    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2fa39bfb-9a76-4f5a-8452-4f125ef46c59-host-slash\") pod \"iptables-alerter-5dz25\" (UID: \"2fa39bfb-9a76-4f5a-8452-4f125ef46c59\") " pod="openshift-network-operator/iptables-alerter-5dz25"
Jul 15 13:11:22.463889 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:22.460063    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1415012e-b242-427c-a9b8-6950353b06a4-original-pull-secret podName:1415012e-b242-427c-a9b8-6950353b06a4 nodeName:}" failed. No retries permitted until 2026-07-15 13:11:22.960036587 +0000 UTC m=+3.047823531 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1415012e-b242-427c-a9b8-6950353b06a4-original-pull-secret") pod "global-pull-secret-syncer-c8fxj" (UID: "1415012e-b242-427c-a9b8-6950353b06a4") : object "kube-system"/"original-pull-secret" not registered
Jul 15 13:11:22.463889 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.460101    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-node-log\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.463889 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.460101    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed59f469-1285-4452-ac9a-a178f674611f-system-cni-dir\") pod \"multus-additional-cni-plugins-wnvdj\" (UID: \"ed59f469-1285-4452-ac9a-a178f674611f\") " pod="openshift-multus/multus-additional-cni-plugins-wnvdj"
Jul 15 13:11:22.463889 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.460124    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1415012e-b242-427c-a9b8-6950353b06a4-dbus\") pod \"global-pull-secret-syncer-c8fxj\" (UID: \"1415012e-b242-427c-a9b8-6950353b06a4\") " pod="kube-system/global-pull-secret-syncer-c8fxj"
Jul 15 13:11:22.463889 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.460192    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-ovnkube-config\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.463889 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.460302    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/740cd63d-7aa0-464d-be90-87aea6674efa-serviceca\") pod \"node-ca-9lrlb\" (UID: \"740cd63d-7aa0-464d-be90-87aea6674efa\") " pod="openshift-image-registry/node-ca-9lrlb"
Jul 15 13:11:22.463889 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.461576    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7d8ecbaa-0817-4175-bd66-aaf270bc1ea1-etc-tuned\") pod \"tuned-twr26\" (UID: \"7d8ecbaa-0817-4175-bd66-aaf270bc1ea1\") " pod="openshift-cluster-node-tuning-operator/tuned-twr26"
Jul 15 13:11:22.463889 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.461599    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d8ecbaa-0817-4175-bd66-aaf270bc1ea1-tmp\") pod \"tuned-twr26\" (UID: \"7d8ecbaa-0817-4175-bd66-aaf270bc1ea1\") " pod="openshift-cluster-node-tuning-operator/tuned-twr26"
Jul 15 13:11:22.463889 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.461837    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-ovn-node-metrics-cert\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.463889 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.462563    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8b3c491a-f49d-405c-adf0-a1c12886786e-agent-certs\") pod \"konnectivity-agent-xpsbk\" (UID: \"8b3c491a-f49d-405c-adf0-a1c12886786e\") " pod="kube-system/konnectivity-agent-xpsbk"
Jul 15 13:11:22.477430 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.477405    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fp7kj\" (UniqueName: \"kubernetes.io/projected/33ecfc20-20ff-48a9-9b57-7a24725e54b5-kube-api-access-fp7kj\") pod \"aws-ebs-csi-driver-node-qjg4m\" (UID: \"33ecfc20-20ff-48a9-9b57-7a24725e54b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qjg4m"
Jul 15 13:11:22.483293 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.483251    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t46pz\" (UniqueName: \"kubernetes.io/projected/7d8ecbaa-0817-4175-bd66-aaf270bc1ea1-kube-api-access-t46pz\") pod \"tuned-twr26\" (UID: \"7d8ecbaa-0817-4175-bd66-aaf270bc1ea1\") " pod="openshift-cluster-node-tuning-operator/tuned-twr26"
Jul 15 13:11:22.484512 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:22.484385    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 13:11:22.484512 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:22.484410    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 13:11:22.484512 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:22.484423    2578 projected.go:196] Error preparing data for projected volume kube-api-access-jhrpc for pod openshift-network-diagnostics/network-check-target-d9lt8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 13:11:22.484512 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:22.484494    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a77382a-0656-4d70-88ce-01e6bf697342-kube-api-access-jhrpc podName:4a77382a-0656-4d70-88ce-01e6bf697342 nodeName:}" failed. No retries permitted until 2026-07-15 13:11:22.984476359 +0000 UTC m=+3.072263310 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jhrpc" (UniqueName: "kubernetes.io/projected/4a77382a-0656-4d70-88ce-01e6bf697342-kube-api-access-jhrpc") pod "network-check-target-d9lt8" (UID: "4a77382a-0656-4d70-88ce-01e6bf697342") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 13:11:22.485398 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.485369    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzfc5\" (UniqueName: \"kubernetes.io/projected/740cd63d-7aa0-464d-be90-87aea6674efa-kube-api-access-nzfc5\") pod \"node-ca-9lrlb\" (UID: \"740cd63d-7aa0-464d-be90-87aea6674efa\") " pod="openshift-image-registry/node-ca-9lrlb"
Jul 15 13:11:22.485702 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.485646    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dz72k\" (UniqueName: \"kubernetes.io/projected/56d93a5b-2111-4969-9ef3-9e58f7e2cb82-kube-api-access-dz72k\") pod \"node-resolver-wdgw4\" (UID: \"56d93a5b-2111-4969-9ef3-9e58f7e2cb82\") " pod="openshift-dns/node-resolver-wdgw4"
Jul 15 13:11:22.485893 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.485871    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zx2t8\" (UniqueName: \"kubernetes.io/projected/d074fc32-a8e5-47e3-a374-45b85504df8c-kube-api-access-zx2t8\") pod \"multus-x8fd7\" (UID: \"d074fc32-a8e5-47e3-a374-45b85504df8c\") " pod="openshift-multus/multus-x8fd7"
Jul 15 13:11:22.496787 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.496762    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttmch\" (UniqueName: \"kubernetes.io/projected/49ca8630-3cc0-4dbb-8c80-a948ad0de2b4-kube-api-access-ttmch\") pod \"ovnkube-node-kt6q4\" (UID: \"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.499721 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.499681    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdrc5\" (UniqueName: \"kubernetes.io/projected/c2029ab2-4966-4b8c-ba6c-e69cf982a372-kube-api-access-tdrc5\") pod \"network-metrics-daemon-czmkz\" (UID: \"c2029ab2-4966-4b8c-ba6c-e69cf982a372\") " pod="openshift-multus/network-metrics-daemon-czmkz"
Jul 15 13:11:22.499837 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.499764    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9hcq\" (UniqueName: \"kubernetes.io/projected/2fa39bfb-9a76-4f5a-8452-4f125ef46c59-kube-api-access-j9hcq\") pod \"iptables-alerter-5dz25\" (UID: \"2fa39bfb-9a76-4f5a-8452-4f125ef46c59\") " pod="openshift-network-operator/iptables-alerter-5dz25"
Jul 15 13:11:22.499994 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.499970    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kttqp\" (UniqueName: \"kubernetes.io/projected/ed59f469-1285-4452-ac9a-a178f674611f-kube-api-access-kttqp\") pod \"multus-additional-cni-plugins-wnvdj\" (UID: \"ed59f469-1285-4452-ac9a-a178f674611f\") " pod="openshift-multus/multus-additional-cni-plugins-wnvdj"
Jul 15 13:11:22.553160 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.553059    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xpsbk"
Jul 15 13:11:22.560688 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:22.560662    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b3c491a_f49d_405c_adf0_a1c12886786e.slice/crio-dc8a2a64e34e91d9ed433257aaaee4f4239367bf004c70821aa45078de063593 WatchSource:0}: Error finding container dc8a2a64e34e91d9ed433257aaaee4f4239367bf004c70821aa45078de063593: Status 404 returned error can't find the container with id dc8a2a64e34e91d9ed433257aaaee4f4239367bf004c70821aa45078de063593
Jul 15 13:11:22.563146 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.563123    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5dz25"
Jul 15 13:11:22.571449 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.571423    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qjg4m"
Jul 15 13:11:22.571635 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:22.571613    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fa39bfb_9a76_4f5a_8452_4f125ef46c59.slice/crio-8fe66d0a1042bf0968f40eef334f55ea1aa2bd865c4bb75d066c783b1b5b10c5 WatchSource:0}: Error finding container 8fe66d0a1042bf0968f40eef334f55ea1aa2bd865c4bb75d066c783b1b5b10c5: Status 404 returned error can't find the container with id 8fe66d0a1042bf0968f40eef334f55ea1aa2bd865c4bb75d066c783b1b5b10c5
Jul 15 13:11:22.576837 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.576816    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wdgw4"
Jul 15 13:11:22.584643 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.584621    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-x8fd7"
Jul 15 13:11:22.591542 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.591517    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wnvdj"
Jul 15 13:11:22.592668 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:22.592643    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd074fc32_a8e5_47e3_a374_45b85504df8c.slice/crio-66d5697435d253903dc02cb9e426b78b39fbdcd43a28de209772f97e872d9ec3 WatchSource:0}: Error finding container 66d5697435d253903dc02cb9e426b78b39fbdcd43a28de209772f97e872d9ec3: Status 404 returned error can't find the container with id 66d5697435d253903dc02cb9e426b78b39fbdcd43a28de209772f97e872d9ec3
Jul 15 13:11:22.599787 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.599768    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9lrlb"
Jul 15 13:11:22.600213 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:22.600181    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded59f469_1285_4452_ac9a_a178f674611f.slice/crio-3d1289596d2dec8be69db316c929520435843fdd5f7ad7e25916bbf96db31c50 WatchSource:0}: Error finding container 3d1289596d2dec8be69db316c929520435843fdd5f7ad7e25916bbf96db31c50: Status 404 returned error can't find the container with id 3d1289596d2dec8be69db316c929520435843fdd5f7ad7e25916bbf96db31c50
Jul 15 13:11:22.605651 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.605630    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-twr26"
Jul 15 13:11:22.607889 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:22.607864    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod740cd63d_7aa0_464d_be90_87aea6674efa.slice/crio-6668b934692befb70b6903c78e2fac4768e2ea4c5bbd30759fbbf8e5e9dbf22b WatchSource:0}: Error finding container 6668b934692befb70b6903c78e2fac4768e2ea4c5bbd30759fbbf8e5e9dbf22b: Status 404 returned error can't find the container with id 6668b934692befb70b6903c78e2fac4768e2ea4c5bbd30759fbbf8e5e9dbf22b
Jul 15 13:11:22.611008 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.610987    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:22.615247 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:22.615213    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d8ecbaa_0817_4175_bd66_aaf270bc1ea1.slice/crio-405646465e80e7c60031ab4654323e422756657b3bf3611fc90d72beb81ee2de WatchSource:0}: Error finding container 405646465e80e7c60031ab4654323e422756657b3bf3611fc90d72beb81ee2de: Status 404 returned error can't find the container with id 405646465e80e7c60031ab4654323e422756657b3bf3611fc90d72beb81ee2de
Jul 15 13:11:22.620268 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:22.620245    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49ca8630_3cc0_4dbb_8c80_a948ad0de2b4.slice/crio-4b348bfd64765f405d039433f302b34fd0570bc00315ffe12c4310fc209d72d8 WatchSource:0}: Error finding container 4b348bfd64765f405d039433f302b34fd0570bc00315ffe12c4310fc209d72d8: Status 404 returned error can't find the container with id 4b348bfd64765f405d039433f302b34fd0570bc00315ffe12c4310fc209d72d8
Jul 15 13:11:22.963516 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.963187    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1415012e-b242-427c-a9b8-6950353b06a4-original-pull-secret\") pod \"global-pull-secret-syncer-c8fxj\" (UID: \"1415012e-b242-427c-a9b8-6950353b06a4\") " pod="kube-system/global-pull-secret-syncer-c8fxj"
Jul 15 13:11:22.963516 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:22.963501    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2029ab2-4966-4b8c-ba6c-e69cf982a372-metrics-certs\") pod \"network-metrics-daemon-czmkz\" (UID: \"c2029ab2-4966-4b8c-ba6c-e69cf982a372\") " pod="openshift-multus/network-metrics-daemon-czmkz"
Jul 15 13:11:22.963718 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:22.963326    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 13:11:22.963718 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:22.963610    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1415012e-b242-427c-a9b8-6950353b06a4-original-pull-secret podName:1415012e-b242-427c-a9b8-6950353b06a4 nodeName:}" failed. No retries permitted until 2026-07-15 13:11:23.963585329 +0000 UTC m=+4.051372252 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1415012e-b242-427c-a9b8-6950353b06a4-original-pull-secret") pod "global-pull-secret-syncer-c8fxj" (UID: "1415012e-b242-427c-a9b8-6950353b06a4") : object "kube-system"/"original-pull-secret" not registered
Jul 15 13:11:22.963718 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:22.963676    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 13:11:22.963861 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:22.963749    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2029ab2-4966-4b8c-ba6c-e69cf982a372-metrics-certs podName:c2029ab2-4966-4b8c-ba6c-e69cf982a372 nodeName:}" failed. No retries permitted until 2026-07-15 13:11:23.963729726 +0000 UTC m=+4.051516666 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c2029ab2-4966-4b8c-ba6c-e69cf982a372-metrics-certs") pod "network-metrics-daemon-czmkz" (UID: "c2029ab2-4966-4b8c-ba6c-e69cf982a372") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 13:11:23.065384 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:23.064723    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhrpc\" (UniqueName: \"kubernetes.io/projected/4a77382a-0656-4d70-88ce-01e6bf697342-kube-api-access-jhrpc\") pod \"network-check-target-d9lt8\" (UID: \"4a77382a-0656-4d70-88ce-01e6bf697342\") " pod="openshift-network-diagnostics/network-check-target-d9lt8"
Jul 15 13:11:23.065384 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:23.064893    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 13:11:23.065384 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:23.064919    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 13:11:23.065384 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:23.064933    2578 projected.go:196] Error preparing data for projected volume kube-api-access-jhrpc for pod openshift-network-diagnostics/network-check-target-d9lt8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 13:11:23.065384 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:23.065000    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a77382a-0656-4d70-88ce-01e6bf697342-kube-api-access-jhrpc podName:4a77382a-0656-4d70-88ce-01e6bf697342 nodeName:}" failed. No retries permitted until 2026-07-15 13:11:24.064976955 +0000 UTC m=+4.152763882 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jhrpc" (UniqueName: "kubernetes.io/projected/4a77382a-0656-4d70-88ce-01e6bf697342-kube-api-access-jhrpc") pod "network-check-target-d9lt8" (UID: "4a77382a-0656-4d70-88ce-01e6bf697342") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 13:11:23.361354 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:23.361179    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 13:06:22 +0000 UTC" deadline="2028-02-05 22:57:49.55584137 +0000 UTC"
Jul 15 13:11:23.361354 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:23.361242    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13689h46m26.19460502s"
Jul 15 13:11:23.378360 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:23.378319    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xpsbk" event={"ID":"8b3c491a-f49d-405c-adf0-a1c12886786e","Type":"ContainerStarted","Data":"dc8a2a64e34e91d9ed433257aaaee4f4239367bf004c70821aa45078de063593"}
Jul 15 13:11:23.380508 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:23.380333    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-twr26" event={"ID":"7d8ecbaa-0817-4175-bd66-aaf270bc1ea1","Type":"ContainerStarted","Data":"405646465e80e7c60031ab4654323e422756657b3bf3611fc90d72beb81ee2de"}
Jul 15 13:11:23.383062 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:23.382878    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9lrlb" event={"ID":"740cd63d-7aa0-464d-be90-87aea6674efa","Type":"ContainerStarted","Data":"6668b934692befb70b6903c78e2fac4768e2ea4c5bbd30759fbbf8e5e9dbf22b"}
Jul 15 13:11:23.385156 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:23.385130    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wdgw4" event={"ID":"56d93a5b-2111-4969-9ef3-9e58f7e2cb82","Type":"ContainerStarted","Data":"5def76822402d50837affdd1511f55c27e516a1b63748880eef9c6955c28511f"}
Jul 15 13:11:23.387798 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:23.387723    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qjg4m" event={"ID":"33ecfc20-20ff-48a9-9b57-7a24725e54b5","Type":"ContainerStarted","Data":"8f78e985d331d21feb0bc2df463b1f0c102cc8186ccf80a23929879ca71c09be"}
Jul 15 13:11:23.390082 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:23.390054    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5dz25" event={"ID":"2fa39bfb-9a76-4f5a-8452-4f125ef46c59","Type":"ContainerStarted","Data":"8fe66d0a1042bf0968f40eef334f55ea1aa2bd865c4bb75d066c783b1b5b10c5"}
Jul 15 13:11:23.394875 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:23.394840    2578 generic.go:356] "Generic (PLEG): container finished" podID="1165be53751c04520f8a3ebe54bb29b3" containerID="75b3040a2934ef6a38797bddcec1f1b5cab5fc1d8319a4f47615c3da5901617f" exitCode=0
Jul 15 13:11:23.395478 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:23.395453    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-159.ec2.internal" event={"ID":"1165be53751c04520f8a3ebe54bb29b3","Type":"ContainerDied","Data":"75b3040a2934ef6a38797bddcec1f1b5cab5fc1d8319a4f47615c3da5901617f"}
Jul 15 13:11:23.401649 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:23.401621    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4" event={"ID":"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4","Type":"ContainerStarted","Data":"4b348bfd64765f405d039433f302b34fd0570bc00315ffe12c4310fc209d72d8"}
Jul 15 13:11:23.404612 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:23.404588    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wnvdj" event={"ID":"ed59f469-1285-4452-ac9a-a178f674611f","Type":"ContainerStarted","Data":"3d1289596d2dec8be69db316c929520435843fdd5f7ad7e25916bbf96db31c50"}
Jul 15 13:11:23.410807 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:23.410655    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-x8fd7" event={"ID":"d074fc32-a8e5-47e3-a374-45b85504df8c","Type":"ContainerStarted","Data":"66d5697435d253903dc02cb9e426b78b39fbdcd43a28de209772f97e872d9ec3"}
Jul 15 13:11:23.972774 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:23.972729    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1415012e-b242-427c-a9b8-6950353b06a4-original-pull-secret\") pod \"global-pull-secret-syncer-c8fxj\" (UID: \"1415012e-b242-427c-a9b8-6950353b06a4\") " pod="kube-system/global-pull-secret-syncer-c8fxj"
Jul 15 13:11:23.972954 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:23.972799    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2029ab2-4966-4b8c-ba6c-e69cf982a372-metrics-certs\") pod \"network-metrics-daemon-czmkz\" (UID: \"c2029ab2-4966-4b8c-ba6c-e69cf982a372\") " pod="openshift-multus/network-metrics-daemon-czmkz"
Jul 15 13:11:23.972954 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:23.972943    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 13:11:23.973084 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:23.973017    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2029ab2-4966-4b8c-ba6c-e69cf982a372-metrics-certs podName:c2029ab2-4966-4b8c-ba6c-e69cf982a372 nodeName:}" failed. No retries permitted until 2026-07-15 13:11:25.972995823 +0000 UTC m=+6.060782751 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c2029ab2-4966-4b8c-ba6c-e69cf982a372-metrics-certs") pod "network-metrics-daemon-czmkz" (UID: "c2029ab2-4966-4b8c-ba6c-e69cf982a372") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 13:11:23.973617 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:23.973485    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 13:11:23.973617 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:23.973543    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1415012e-b242-427c-a9b8-6950353b06a4-original-pull-secret podName:1415012e-b242-427c-a9b8-6950353b06a4 nodeName:}" failed. No retries permitted until 2026-07-15 13:11:25.973527096 +0000 UTC m=+6.061314022 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1415012e-b242-427c-a9b8-6950353b06a4-original-pull-secret") pod "global-pull-secret-syncer-c8fxj" (UID: "1415012e-b242-427c-a9b8-6950353b06a4") : object "kube-system"/"original-pull-secret" not registered
Jul 15 13:11:24.022095 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:24.021859    2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 13:11:24.073230 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:24.073193    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhrpc\" (UniqueName: \"kubernetes.io/projected/4a77382a-0656-4d70-88ce-01e6bf697342-kube-api-access-jhrpc\") pod \"network-check-target-d9lt8\" (UID: \"4a77382a-0656-4d70-88ce-01e6bf697342\") " pod="openshift-network-diagnostics/network-check-target-d9lt8"
Jul 15 13:11:24.073456 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:24.073438    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 13:11:24.073538 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:24.073469    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 13:11:24.073538 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:24.073483    2578 projected.go:196] Error preparing data for projected volume kube-api-access-jhrpc for pod openshift-network-diagnostics/network-check-target-d9lt8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 13:11:24.073641 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:24.073542    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a77382a-0656-4d70-88ce-01e6bf697342-kube-api-access-jhrpc podName:4a77382a-0656-4d70-88ce-01e6bf697342 nodeName:}" failed. No retries permitted until 2026-07-15 13:11:26.073523936 +0000 UTC m=+6.161310859 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jhrpc" (UniqueName: "kubernetes.io/projected/4a77382a-0656-4d70-88ce-01e6bf697342-kube-api-access-jhrpc") pod "network-check-target-d9lt8" (UID: "4a77382a-0656-4d70-88ce-01e6bf697342") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 13:11:24.362085 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:24.361973    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 13:06:22 +0000 UTC" deadline="2028-04-15 00:36:09.610242054 +0000 UTC"
Jul 15 13:11:24.362085 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:24.362044    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15347h24m45.248203165s"
Jul 15 13:11:24.370513 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:24.370261    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c8fxj"
Jul 15 13:11:24.370513 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:24.370315    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-czmkz"
Jul 15 13:11:24.370513 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:24.370425    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c8fxj" podUID="1415012e-b242-427c-a9b8-6950353b06a4"
Jul 15 13:11:24.370513 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:24.370486    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9lt8"
Jul 15 13:11:24.370812 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:24.370588    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9lt8" podUID="4a77382a-0656-4d70-88ce-01e6bf697342"
Jul 15 13:11:24.370812 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:24.370685    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-czmkz" podUID="c2029ab2-4966-4b8c-ba6c-e69cf982a372"
Jul 15 13:11:24.415656 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:24.415622    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-159.ec2.internal" event={"ID":"1165be53751c04520f8a3ebe54bb29b3","Type":"ContainerStarted","Data":"a42b10f8446c1cc14eca8be7b75f38a3468f7e41974208d8f359c0776b15bb0c"}
Jul 15 13:11:24.440002 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:24.439503    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-159.ec2.internal" podStartSLOduration=2.439483066 podStartE2EDuration="2.439483066s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:11:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:11:24.439049409 +0000 UTC m=+4.526836355" watchObservedRunningTime="2026-07-15 13:11:24.439483066 +0000 UTC m=+4.527270012"
Jul 15 13:11:25.993506 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:25.992649    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1415012e-b242-427c-a9b8-6950353b06a4-original-pull-secret\") pod \"global-pull-secret-syncer-c8fxj\" (UID: \"1415012e-b242-427c-a9b8-6950353b06a4\") " pod="kube-system/global-pull-secret-syncer-c8fxj"
Jul 15 13:11:25.993506 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:25.992717    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2029ab2-4966-4b8c-ba6c-e69cf982a372-metrics-certs\") pod \"network-metrics-daemon-czmkz\" (UID: \"c2029ab2-4966-4b8c-ba6c-e69cf982a372\") " pod="openshift-multus/network-metrics-daemon-czmkz"
Jul 15 13:11:25.993506 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:25.992903    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 13:11:25.993506 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:25.992968    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2029ab2-4966-4b8c-ba6c-e69cf982a372-metrics-certs podName:c2029ab2-4966-4b8c-ba6c-e69cf982a372 nodeName:}" failed. No retries permitted until 2026-07-15 13:11:29.992946843 +0000 UTC m=+10.080733767 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c2029ab2-4966-4b8c-ba6c-e69cf982a372-metrics-certs") pod "network-metrics-daemon-czmkz" (UID: "c2029ab2-4966-4b8c-ba6c-e69cf982a372") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 13:11:25.993506 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:25.993410    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 13:11:25.993506 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:25.993469    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1415012e-b242-427c-a9b8-6950353b06a4-original-pull-secret podName:1415012e-b242-427c-a9b8-6950353b06a4 nodeName:}" failed. No retries permitted until 2026-07-15 13:11:29.993452305 +0000 UTC m=+10.081239233 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1415012e-b242-427c-a9b8-6950353b06a4-original-pull-secret") pod "global-pull-secret-syncer-c8fxj" (UID: "1415012e-b242-427c-a9b8-6950353b06a4") : object "kube-system"/"original-pull-secret" not registered
Jul 15 13:11:26.093682 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:26.093643    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhrpc\" (UniqueName: \"kubernetes.io/projected/4a77382a-0656-4d70-88ce-01e6bf697342-kube-api-access-jhrpc\") pod \"network-check-target-d9lt8\" (UID: \"4a77382a-0656-4d70-88ce-01e6bf697342\") " pod="openshift-network-diagnostics/network-check-target-d9lt8"
Jul 15 13:11:26.093915 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:26.093882    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 13:11:26.093915 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:26.093906    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 13:11:26.094060 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:26.093920    2578 projected.go:196] Error preparing data for projected volume kube-api-access-jhrpc for pod openshift-network-diagnostics/network-check-target-d9lt8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 13:11:26.094060 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:26.093984    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a77382a-0656-4d70-88ce-01e6bf697342-kube-api-access-jhrpc podName:4a77382a-0656-4d70-88ce-01e6bf697342 nodeName:}" failed. No retries permitted until 2026-07-15 13:11:30.093965033 +0000 UTC m=+10.181751979 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jhrpc" (UniqueName: "kubernetes.io/projected/4a77382a-0656-4d70-88ce-01e6bf697342-kube-api-access-jhrpc") pod "network-check-target-d9lt8" (UID: "4a77382a-0656-4d70-88ce-01e6bf697342") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 13:11:26.369550 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:26.369461    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-czmkz"
Jul 15 13:11:26.369742 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:26.369466    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c8fxj"
Jul 15 13:11:26.369742 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:26.369611    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-czmkz" podUID="c2029ab2-4966-4b8c-ba6c-e69cf982a372"
Jul 15 13:11:26.369742 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:26.369630    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9lt8"
Jul 15 13:11:26.369904 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:26.369738    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c8fxj" podUID="1415012e-b242-427c-a9b8-6950353b06a4"
Jul 15 13:11:26.369904 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:26.369825    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9lt8" podUID="4a77382a-0656-4d70-88ce-01e6bf697342"
Jul 15 13:11:28.369695 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:28.369567    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-czmkz"
Jul 15 13:11:28.369695 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:28.369611    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9lt8"
Jul 15 13:11:28.369695 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:28.369574    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c8fxj"
Jul 15 13:11:28.370292 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:28.369744    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-czmkz" podUID="c2029ab2-4966-4b8c-ba6c-e69cf982a372"
Jul 15 13:11:28.370292 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:28.369858    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c8fxj" podUID="1415012e-b242-427c-a9b8-6950353b06a4"
Jul 15 13:11:28.370292 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:28.369942    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9lt8" podUID="4a77382a-0656-4d70-88ce-01e6bf697342"
Jul 15 13:11:30.028008 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:30.027971    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1415012e-b242-427c-a9b8-6950353b06a4-original-pull-secret\") pod \"global-pull-secret-syncer-c8fxj\" (UID: \"1415012e-b242-427c-a9b8-6950353b06a4\") " pod="kube-system/global-pull-secret-syncer-c8fxj"
Jul 15 13:11:30.028480 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:30.028030    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2029ab2-4966-4b8c-ba6c-e69cf982a372-metrics-certs\") pod \"network-metrics-daemon-czmkz\" (UID: \"c2029ab2-4966-4b8c-ba6c-e69cf982a372\") " pod="openshift-multus/network-metrics-daemon-czmkz"
Jul 15 13:11:30.028480 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:30.028151    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 13:11:30.028480 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:30.028226    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2029ab2-4966-4b8c-ba6c-e69cf982a372-metrics-certs podName:c2029ab2-4966-4b8c-ba6c-e69cf982a372 nodeName:}" failed. No retries permitted until 2026-07-15 13:11:38.02818941 +0000 UTC m=+18.115976335 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c2029ab2-4966-4b8c-ba6c-e69cf982a372-metrics-certs") pod "network-metrics-daemon-czmkz" (UID: "c2029ab2-4966-4b8c-ba6c-e69cf982a372") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 13:11:30.028480 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:30.028291    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 13:11:30.028480 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:30.028323    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1415012e-b242-427c-a9b8-6950353b06a4-original-pull-secret podName:1415012e-b242-427c-a9b8-6950353b06a4 nodeName:}" failed. No retries permitted until 2026-07-15 13:11:38.028313193 +0000 UTC m=+18.116100115 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1415012e-b242-427c-a9b8-6950353b06a4-original-pull-secret") pod "global-pull-secret-syncer-c8fxj" (UID: "1415012e-b242-427c-a9b8-6950353b06a4") : object "kube-system"/"original-pull-secret" not registered
Jul 15 13:11:30.129258 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:30.128680    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhrpc\" (UniqueName: \"kubernetes.io/projected/4a77382a-0656-4d70-88ce-01e6bf697342-kube-api-access-jhrpc\") pod \"network-check-target-d9lt8\" (UID: \"4a77382a-0656-4d70-88ce-01e6bf697342\") " pod="openshift-network-diagnostics/network-check-target-d9lt8"
Jul 15 13:11:30.129258 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:30.128829    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 13:11:30.129258 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:30.128852    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 13:11:30.129258 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:30.128865    2578 projected.go:196] Error preparing data for projected volume kube-api-access-jhrpc for pod openshift-network-diagnostics/network-check-target-d9lt8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 13:11:30.129258 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:30.128917    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a77382a-0656-4d70-88ce-01e6bf697342-kube-api-access-jhrpc podName:4a77382a-0656-4d70-88ce-01e6bf697342 nodeName:}" failed. No retries permitted until 2026-07-15 13:11:38.128898436 +0000 UTC m=+18.216685362 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jhrpc" (UniqueName: "kubernetes.io/projected/4a77382a-0656-4d70-88ce-01e6bf697342-kube-api-access-jhrpc") pod "network-check-target-d9lt8" (UID: "4a77382a-0656-4d70-88ce-01e6bf697342") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 13:11:30.372906 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:30.372375    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-czmkz"
Jul 15 13:11:30.372906 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:30.372488    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-czmkz" podUID="c2029ab2-4966-4b8c-ba6c-e69cf982a372"
Jul 15 13:11:30.372906 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:30.372641    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c8fxj"
Jul 15 13:11:30.372906 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:30.372722    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c8fxj" podUID="1415012e-b242-427c-a9b8-6950353b06a4"
Jul 15 13:11:30.372906 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:30.372786    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9lt8"
Jul 15 13:11:30.372906 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:30.372870    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9lt8" podUID="4a77382a-0656-4d70-88ce-01e6bf697342"
Jul 15 13:11:30.433129 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:30.433098    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-159.ec2.internal" event={"ID":"176fec2e1fa731a8b2c054cee79a9e44","Type":"ContainerStarted","Data":"e91854ab79d53c75944ee816c96ec2ce95fccb5fd10656aaff155460b4249639"}
Jul 15 13:11:31.438330 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:31.438164    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9lrlb" event={"ID":"740cd63d-7aa0-464d-be90-87aea6674efa","Type":"ContainerStarted","Data":"5b355e544f3847b3f9cf4bdb195156c9e1505ad30af5c5137ec53637ed82b3ab"}
Jul 15 13:11:31.440638 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:31.440332    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wdgw4" event={"ID":"56d93a5b-2111-4969-9ef3-9e58f7e2cb82","Type":"ContainerStarted","Data":"6a0245c4e01f5cdfbb73d8bacf4c75346780b2419cd3f63fc7b2303daa81d15b"}
Jul 15 13:11:31.443004 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:31.442975    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qjg4m" event={"ID":"33ecfc20-20ff-48a9-9b57-7a24725e54b5","Type":"ContainerStarted","Data":"a1eb84f40a233245463197521e3c0f4303c8a0969cf57b2f52b4eafb2fa4686e"}
Jul 15 13:11:31.445343 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:31.445116    2578 generic.go:356] "Generic (PLEG): container finished" podID="ed59f469-1285-4452-ac9a-a178f674611f" containerID="2f0fd9f0e52abb140540f7a905f46a8cda08f713579fb0134157b704c50b84d2" exitCode=0
Jul 15 13:11:31.445343 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:31.445189    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wnvdj" event={"ID":"ed59f469-1285-4452-ac9a-a178f674611f","Type":"ContainerDied","Data":"2f0fd9f0e52abb140540f7a905f46a8cda08f713579fb0134157b704c50b84d2"}
Jul 15 13:11:31.446899 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:31.446753    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xpsbk" event={"ID":"8b3c491a-f49d-405c-adf0-a1c12886786e","Type":"ContainerStarted","Data":"1405314c161080fb792ebdfe2a4320c2b4e90f5d7dd642045aa288ddb9b30c0d"}
Jul 15 13:11:31.458151 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:31.458000    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9lrlb" podStartSLOduration=2.803546227 podStartE2EDuration="10.457971649s" totalImagesPullingTime="7.654425422s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:11:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:11:31.457041468 +0000 UTC m=+11.544828620" watchObservedRunningTime="2026-07-15 13:11:31.457971649 +0000 UTC m=+11.545758592"
Jul 15 13:11:31.475787 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:31.475438    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xpsbk" podStartSLOduration=2.73823583 podStartE2EDuration="10.475418545s" totalImagesPullingTime="7.737182715s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:11:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:11:31.474803108 +0000 UTC m=+11.562590050" watchObservedRunningTime="2026-07-15 13:11:31.475418545 +0000 UTC m=+11.563205490"
Jul 15 13:11:31.518260 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:31.518193    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-wdgw4" podStartSLOduration=2.810658576 podStartE2EDuration="10.518175441s" totalImagesPullingTime="7.707516865s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:11:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:11:31.494456121 +0000 UTC m=+11.582243064" watchObservedRunningTime="2026-07-15 13:11:31.518175441 +0000 UTC m=+11.605962384"
Jul 15 13:11:31.952447 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:31.952421    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xpsbk"
Jul 15 13:11:31.953103 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:31.953084    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xpsbk"
Jul 15 13:11:32.369483 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:32.369244    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9lt8"
Jul 15 13:11:32.369650 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:32.369598    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9lt8" podUID="4a77382a-0656-4d70-88ce-01e6bf697342"
Jul 15 13:11:32.369650 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:32.369417    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c8fxj"
Jul 15 13:11:32.369742 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:32.369686    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c8fxj" podUID="1415012e-b242-427c-a9b8-6950353b06a4"
Jul 15 13:11:32.369742 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:32.369264    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-czmkz"
Jul 15 13:11:32.369805 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:32.369755    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-czmkz" podUID="c2029ab2-4966-4b8c-ba6c-e69cf982a372"
Jul 15 13:11:32.452554 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:32.452517    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5dz25" event={"ID":"2fa39bfb-9a76-4f5a-8452-4f125ef46c59","Type":"ContainerStarted","Data":"a07b3b5d3090d1d0e14d0a36778659271dd161fda5a8ef57620c68a38ffb2f00"}
Jul 15 13:11:32.453263 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:32.453238    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xpsbk"
Jul 15 13:11:32.453705 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:32.453684    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xpsbk"
Jul 15 13:11:32.474435 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:32.474007    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-5dz25" podStartSLOduration=3.781830051 podStartE2EDuration="11.473977765s" totalImagesPullingTime="7.692147714s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:11:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:11:32.473964793 +0000 UTC m=+12.561751735" watchObservedRunningTime="2026-07-15 13:11:32.473977765 +0000 UTC m=+12.561764712"
Jul 15 13:11:34.369709 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:34.369674    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-czmkz"
Jul 15 13:11:34.370147 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:34.369678    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c8fxj"
Jul 15 13:11:34.370147 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:34.369816    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-czmkz" podUID="c2029ab2-4966-4b8c-ba6c-e69cf982a372"
Jul 15 13:11:34.370147 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:34.369873    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9lt8"
Jul 15 13:11:34.370147 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:34.369990    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c8fxj" podUID="1415012e-b242-427c-a9b8-6950353b06a4"
Jul 15 13:11:34.370147 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:34.370053    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9lt8" podUID="4a77382a-0656-4d70-88ce-01e6bf697342"
Jul 15 13:11:36.369322 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:36.369290    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c8fxj"
Jul 15 13:11:36.370017 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:36.369293    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9lt8"
Jul 15 13:11:36.370017 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:36.369414    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c8fxj" podUID="1415012e-b242-427c-a9b8-6950353b06a4"
Jul 15 13:11:36.370017 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:36.369424    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-czmkz"
Jul 15 13:11:36.370017 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:36.369506    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9lt8" podUID="4a77382a-0656-4d70-88ce-01e6bf697342"
Jul 15 13:11:36.370017 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:36.369608    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-czmkz" podUID="c2029ab2-4966-4b8c-ba6c-e69cf982a372"
Jul 15 13:11:38.092804 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:38.092764    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1415012e-b242-427c-a9b8-6950353b06a4-original-pull-secret\") pod \"global-pull-secret-syncer-c8fxj\" (UID: \"1415012e-b242-427c-a9b8-6950353b06a4\") " pod="kube-system/global-pull-secret-syncer-c8fxj"
Jul 15 13:11:38.093338 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:38.092825    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2029ab2-4966-4b8c-ba6c-e69cf982a372-metrics-certs\") pod \"network-metrics-daemon-czmkz\" (UID: \"c2029ab2-4966-4b8c-ba6c-e69cf982a372\") " pod="openshift-multus/network-metrics-daemon-czmkz"
Jul 15 13:11:38.093338 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:38.092948    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 13:11:38.093338 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:38.093005    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2029ab2-4966-4b8c-ba6c-e69cf982a372-metrics-certs podName:c2029ab2-4966-4b8c-ba6c-e69cf982a372 nodeName:}" failed. No retries permitted until 2026-07-15 13:11:54.092986761 +0000 UTC m=+34.180773685 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c2029ab2-4966-4b8c-ba6c-e69cf982a372-metrics-certs") pod "network-metrics-daemon-czmkz" (UID: "c2029ab2-4966-4b8c-ba6c-e69cf982a372") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 13:11:38.093338 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:38.092946    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 13:11:38.093338 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:38.093098    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1415012e-b242-427c-a9b8-6950353b06a4-original-pull-secret podName:1415012e-b242-427c-a9b8-6950353b06a4 nodeName:}" failed. No retries permitted until 2026-07-15 13:11:54.093078645 +0000 UTC m=+34.180865565 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1415012e-b242-427c-a9b8-6950353b06a4-original-pull-secret") pod "global-pull-secret-syncer-c8fxj" (UID: "1415012e-b242-427c-a9b8-6950353b06a4") : object "kube-system"/"original-pull-secret" not registered
Jul 15 13:11:38.193728 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:38.193696    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhrpc\" (UniqueName: \"kubernetes.io/projected/4a77382a-0656-4d70-88ce-01e6bf697342-kube-api-access-jhrpc\") pod \"network-check-target-d9lt8\" (UID: \"4a77382a-0656-4d70-88ce-01e6bf697342\") " pod="openshift-network-diagnostics/network-check-target-d9lt8"
Jul 15 13:11:38.193874 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:38.193821    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 13:11:38.193874 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:38.193839    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 13:11:38.193874 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:38.193848    2578 projected.go:196] Error preparing data for projected volume kube-api-access-jhrpc for pod openshift-network-diagnostics/network-check-target-d9lt8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 13:11:38.193995 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:38.193894    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a77382a-0656-4d70-88ce-01e6bf697342-kube-api-access-jhrpc podName:4a77382a-0656-4d70-88ce-01e6bf697342 nodeName:}" failed. No retries permitted until 2026-07-15 13:11:54.193881559 +0000 UTC m=+34.281668492 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jhrpc" (UniqueName: "kubernetes.io/projected/4a77382a-0656-4d70-88ce-01e6bf697342-kube-api-access-jhrpc") pod "network-check-target-d9lt8" (UID: "4a77382a-0656-4d70-88ce-01e6bf697342") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 13:11:38.369693 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:38.369628    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-czmkz"
Jul 15 13:11:38.369821 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:38.369637    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c8fxj"
Jul 15 13:11:38.369821 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:38.369729    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-czmkz" podUID="c2029ab2-4966-4b8c-ba6c-e69cf982a372"
Jul 15 13:11:38.369821 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:38.369798    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9lt8"
Jul 15 13:11:38.369963 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:38.369796    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c8fxj" podUID="1415012e-b242-427c-a9b8-6950353b06a4"
Jul 15 13:11:38.369963 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:38.369887    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9lt8" podUID="4a77382a-0656-4d70-88ce-01e6bf697342"
Jul 15 13:11:40.370559 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:40.370525    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c8fxj"
Jul 15 13:11:40.371024 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:40.370647    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c8fxj" podUID="1415012e-b242-427c-a9b8-6950353b06a4"
Jul 15 13:11:40.371024 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:40.370823    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9lt8"
Jul 15 13:11:40.371024 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:40.370931    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9lt8" podUID="4a77382a-0656-4d70-88ce-01e6bf697342"
Jul 15 13:11:40.371024 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:40.370949    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-czmkz"
Jul 15 13:11:40.371229 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:40.371050    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-czmkz" podUID="c2029ab2-4966-4b8c-ba6c-e69cf982a372"
Jul 15 13:11:42.370071 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:42.370037    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-czmkz"
Jul 15 13:11:42.370612 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:42.370036    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c8fxj"
Jul 15 13:11:42.370612 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:42.370182    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-czmkz" podUID="c2029ab2-4966-4b8c-ba6c-e69cf982a372"
Jul 15 13:11:42.370612 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:42.370044    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9lt8"
Jul 15 13:11:42.370612 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:42.370250    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c8fxj" podUID="1415012e-b242-427c-a9b8-6950353b06a4"
Jul 15 13:11:42.370612 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:42.370300    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9lt8" podUID="4a77382a-0656-4d70-88ce-01e6bf697342"
Jul 15 13:11:44.369951 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:44.369915    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9lt8"
Jul 15 13:11:44.370440 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:44.370038    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-czmkz"
Jul 15 13:11:44.370440 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:44.370047    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9lt8" podUID="4a77382a-0656-4d70-88ce-01e6bf697342"
Jul 15 13:11:44.370440 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:44.370136    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-czmkz" podUID="c2029ab2-4966-4b8c-ba6c-e69cf982a372"
Jul 15 13:11:44.370440 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:44.370185    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c8fxj"
Jul 15 13:11:44.370440 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:44.370273    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c8fxj" podUID="1415012e-b242-427c-a9b8-6950353b06a4"
Jul 15 13:11:44.774354 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:44.774139    2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 15 13:11:45.309502 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:45.308927    2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T13:11:44.774337123Z","UUID":"a11c99eb-83c3-42f7-ac7b-1b4360d3195b","Handler":null,"Name":"","Endpoint":""}
Jul 15 13:11:45.310964 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:45.310946    2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 15 13:11:45.311055 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:45.310979    2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 15 13:11:45.478635 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:45.478598    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qjg4m" event={"ID":"33ecfc20-20ff-48a9-9b57-7a24725e54b5","Type":"ContainerStarted","Data":"0b58395622436aae20ba452b29b83953524fb70e1011e863e33fc1012f3d869b"}
Jul 15 13:11:45.480280 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:45.480231    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-159.ec2.internal" event={"ID":"176fec2e1fa731a8b2c054cee79a9e44","Type":"ContainerStarted","Data":"21361e11559eca8a0fb47a9bc7e0f87e1abc61c8d49c44a280e42aa47585d339"}
Jul 15 13:11:45.483485 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:45.483464    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt6q4_49ca8630-3cc0-4dbb-8c80-a948ad0de2b4/ovn-acl-logging/0.log"
Jul 15 13:11:45.483861 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:45.483840    2578 generic.go:356] "Generic (PLEG): container finished" podID="49ca8630-3cc0-4dbb-8c80-a948ad0de2b4" containerID="069e6be69f4e8d27e2ae23234e2ce23f3222520c2194e49e25cc4c1435354319" exitCode=1
Jul 15 13:11:45.483957 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:45.483910    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4" event={"ID":"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4","Type":"ContainerStarted","Data":"5b2577b806bad9b75dd6d626e3af26f7676207e56e719918537a003e88ddd5d5"}
Jul 15 13:11:45.484035 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:45.483977    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4" event={"ID":"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4","Type":"ContainerStarted","Data":"d6660e0e378ef092bf9ccfb4e1e4cbc46e047ec47f63d27532cb0a565af0b787"}
Jul 15 13:11:45.484035 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:45.484028    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4" event={"ID":"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4","Type":"ContainerStarted","Data":"d2e052cec5aae2b0057737b4e7c52d552ec54b4574ba3610e56ecb7ecc78bc48"}
Jul 15 13:11:45.484135 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:45.484120    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4" event={"ID":"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4","Type":"ContainerStarted","Data":"984e7774fa7d7d90f2e651624909fe987a18783233c443ce7ad77adf45525c80"}
Jul 15 13:11:45.484193 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:45.484178    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4" event={"ID":"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4","Type":"ContainerDied","Data":"069e6be69f4e8d27e2ae23234e2ce23f3222520c2194e49e25cc4c1435354319"}
Jul 15 13:11:45.484265 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:45.484248    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4" event={"ID":"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4","Type":"ContainerStarted","Data":"4755b853ddc3d4490eaa0fb372f741d288b452562d5c5829c72b9838cb599da6"}
Jul 15 13:11:45.486081 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:45.486041    2578 generic.go:356] "Generic (PLEG): container finished" podID="ed59f469-1285-4452-ac9a-a178f674611f" containerID="448b42200695dd48121e3a27443e2f61a028c1081396808a65d677451bb561a4" exitCode=0
Jul 15 13:11:45.486174 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:45.486079    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wnvdj" event={"ID":"ed59f469-1285-4452-ac9a-a178f674611f","Type":"ContainerDied","Data":"448b42200695dd48121e3a27443e2f61a028c1081396808a65d677451bb561a4"}
Jul 15 13:11:45.487877 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:45.487784    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-x8fd7" event={"ID":"d074fc32-a8e5-47e3-a374-45b85504df8c","Type":"ContainerStarted","Data":"3f9d41a6f1b7f423b8c36b3a29f8c47ad20a58ffce00f9eeb150085896358fed"}
Jul 15 13:11:45.489436 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:45.489411    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-twr26" event={"ID":"7d8ecbaa-0817-4175-bd66-aaf270bc1ea1","Type":"ContainerStarted","Data":"9ddd3a83ede1a0aad4f742b8936648b3afc9ec3afd9097af081e291012d9fa40"}
Jul 15 13:11:45.501163 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:45.501127    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-159.ec2.internal" podStartSLOduration=23.501115411 podStartE2EDuration="23.501115411s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:11:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:11:45.50110925 +0000 UTC m=+25.588896194" watchObservedRunningTime="2026-07-15 13:11:45.501115411 +0000 UTC m=+25.588902352"
Jul 15 13:11:45.523614 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:45.523575    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-twr26" podStartSLOduration=2.497877784 podStartE2EDuration="24.523563467s" totalImagesPullingTime="22.025685683s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:11:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:11:45.521357708 +0000 UTC m=+25.609144650" watchObservedRunningTime="2026-07-15 13:11:45.523563467 +0000 UTC m=+25.611350408"
Jul 15 13:11:45.549174 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:45.549128    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-x8fd7" podStartSLOduration=2.502153092 podStartE2EDuration="24.549115481s" totalImagesPullingTime="22.046962389s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:11:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:11:45.548666263 +0000 UTC m=+25.636453206" watchObservedRunningTime="2026-07-15 13:11:45.549115481 +0000 UTC m=+25.636902423"
Jul 15 13:11:46.369527 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:46.369496    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c8fxj"
Jul 15 13:11:46.369527 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:46.369513    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9lt8"
Jul 15 13:11:46.369705 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:46.369496    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-czmkz"
Jul 15 13:11:46.369705 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:46.369599    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c8fxj" podUID="1415012e-b242-427c-a9b8-6950353b06a4"
Jul 15 13:11:46.369769 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:46.369700    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-czmkz" podUID="c2029ab2-4966-4b8c-ba6c-e69cf982a372"
Jul 15 13:11:46.369802 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:46.369785    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9lt8" podUID="4a77382a-0656-4d70-88ce-01e6bf697342"
Jul 15 13:11:46.493278 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:46.493246    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qjg4m" event={"ID":"33ecfc20-20ff-48a9-9b57-7a24725e54b5","Type":"ContainerStarted","Data":"a66c3e4ec4dd4b268747606fc3a5851c34765bc82ac0957b390b7857f09fd268"}
Jul 15 13:11:46.516316 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:46.516274    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qjg4m" podStartSLOduration=2.519817571 podStartE2EDuration="25.516260674s" totalImagesPullingTime="22.996443103s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:11:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:11:46.515765317 +0000 UTC m=+26.603552259" watchObservedRunningTime="2026-07-15 13:11:46.516260674 +0000 UTC m=+26.604047616"
Jul 15 13:11:47.497775 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:47.497716    2578 generic.go:356] "Generic (PLEG): container finished" podID="ed59f469-1285-4452-ac9a-a178f674611f" containerID="5ad8d11c0e42404c70e588ed4567278606abc92dcfdf8b8d229f8fabcaab314e" exitCode=0
Jul 15 13:11:47.497775 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:47.497754    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wnvdj" event={"ID":"ed59f469-1285-4452-ac9a-a178f674611f","Type":"ContainerDied","Data":"5ad8d11c0e42404c70e588ed4567278606abc92dcfdf8b8d229f8fabcaab314e"}
Jul 15 13:11:48.369090 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:48.369019    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c8fxj"
Jul 15 13:11:48.369264 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:48.369021    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9lt8"
Jul 15 13:11:48.369264 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:48.369136    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c8fxj" podUID="1415012e-b242-427c-a9b8-6950353b06a4"
Jul 15 13:11:48.369264 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:48.369021    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-czmkz"
Jul 15 13:11:48.369423 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:48.369283    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-czmkz" podUID="c2029ab2-4966-4b8c-ba6c-e69cf982a372"
Jul 15 13:11:48.369423 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:48.369195    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9lt8" podUID="4a77382a-0656-4d70-88ce-01e6bf697342"
Jul 15 13:11:48.502238 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:48.502198    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt6q4_49ca8630-3cc0-4dbb-8c80-a948ad0de2b4/ovn-acl-logging/0.log"
Jul 15 13:11:48.502698 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:48.502499    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4" event={"ID":"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4","Type":"ContainerStarted","Data":"2a3ff8fd1c6b9ea548f2a7c27f3d7467be1269f395d817773a7a6cd6287ece64"}
Jul 15 13:11:49.507007 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:49.506971    2578 generic.go:356] "Generic (PLEG): container finished" podID="ed59f469-1285-4452-ac9a-a178f674611f" containerID="b99b38dbec5169b0a2bf57717b32c48d01f16b8cc73e6d5181712c9507289357" exitCode=0
Jul 15 13:11:49.507441 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:49.507023    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wnvdj" event={"ID":"ed59f469-1285-4452-ac9a-a178f674611f","Type":"ContainerDied","Data":"b99b38dbec5169b0a2bf57717b32c48d01f16b8cc73e6d5181712c9507289357"}
Jul 15 13:11:50.370370 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:50.370160    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9lt8"
Jul 15 13:11:50.370533 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:50.370263    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-czmkz"
Jul 15 13:11:50.370533 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:50.370454    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9lt8" podUID="4a77382a-0656-4d70-88ce-01e6bf697342"
Jul 15 13:11:50.370533 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:50.370298    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c8fxj"
Jul 15 13:11:50.370692 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:50.370530    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-czmkz" podUID="c2029ab2-4966-4b8c-ba6c-e69cf982a372"
Jul 15 13:11:50.370692 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:50.370641    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c8fxj" podUID="1415012e-b242-427c-a9b8-6950353b06a4"
Jul 15 13:11:50.513677 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:50.513651    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt6q4_49ca8630-3cc0-4dbb-8c80-a948ad0de2b4/ovn-acl-logging/0.log"
Jul 15 13:11:50.514251 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:50.514066    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4" event={"ID":"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4","Type":"ContainerStarted","Data":"499860d4969e01672caa2509c38a0a2f6e8a04b3e3598b013418315ac2d702bb"}
Jul 15 13:11:50.514430 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:50.514411    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:50.514517 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:50.514470    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:50.514589 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:50.514574    2578 scope.go:117] "RemoveContainer" containerID="069e6be69f4e8d27e2ae23234e2ce23f3222520c2194e49e25cc4c1435354319"
Jul 15 13:11:50.533018 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:50.532998    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:51.521435 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:51.521410    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt6q4_49ca8630-3cc0-4dbb-8c80-a948ad0de2b4/ovn-acl-logging/0.log"
Jul 15 13:11:51.521843 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:51.521817    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4" event={"ID":"49ca8630-3cc0-4dbb-8c80-a948ad0de2b4","Type":"ContainerStarted","Data":"c8cc02ef7b3cd7224bfea02c62e8679a19ea4966c1ab30b6063c09609c769691"}
Jul 15 13:11:51.522260 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:51.522237    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:51.539568 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:51.539542    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:11:51.565871 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:51.565816    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4" podStartSLOduration=8.543784669 podStartE2EDuration="30.56579315s" totalImagesPullingTime="22.022008481s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:11:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:11:51.56467021 +0000 UTC m=+31.652457155" watchObservedRunningTime="2026-07-15 13:11:51.56579315 +0000 UTC m=+31.653580094"
Jul 15 13:11:51.982397 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:51.982364    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-czmkz"]
Jul 15 13:11:51.982571 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:51.982506    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-czmkz"
Jul 15 13:11:51.982660 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:51.982629    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-czmkz" podUID="c2029ab2-4966-4b8c-ba6c-e69cf982a372"
Jul 15 13:11:51.984536 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:51.984514    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-c8fxj"]
Jul 15 13:11:51.984632 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:51.984618    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c8fxj"
Jul 15 13:11:51.984718 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:51.984694    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c8fxj" podUID="1415012e-b242-427c-a9b8-6950353b06a4"
Jul 15 13:11:52.000175 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:52.000142    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-d9lt8"]
Jul 15 13:11:52.000280 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:52.000256    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9lt8"
Jul 15 13:11:52.000367 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:52.000344    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9lt8" podUID="4a77382a-0656-4d70-88ce-01e6bf697342"
Jul 15 13:11:53.369963 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:53.369920    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9lt8"
Jul 15 13:11:53.369963 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:53.369970    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c8fxj"
Jul 15 13:11:53.370422 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:53.370067    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9lt8" podUID="4a77382a-0656-4d70-88ce-01e6bf697342"
Jul 15 13:11:53.370422 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:53.370177    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c8fxj" podUID="1415012e-b242-427c-a9b8-6950353b06a4"
Jul 15 13:11:54.131134 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:54.131096    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1415012e-b242-427c-a9b8-6950353b06a4-original-pull-secret\") pod \"global-pull-secret-syncer-c8fxj\" (UID: \"1415012e-b242-427c-a9b8-6950353b06a4\") " pod="kube-system/global-pull-secret-syncer-c8fxj"
Jul 15 13:11:54.131343 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:54.131145    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2029ab2-4966-4b8c-ba6c-e69cf982a372-metrics-certs\") pod \"network-metrics-daemon-czmkz\" (UID: \"c2029ab2-4966-4b8c-ba6c-e69cf982a372\") " pod="openshift-multus/network-metrics-daemon-czmkz"
Jul 15 13:11:54.131343 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:54.131296    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 13:11:54.131430 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:54.131356    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2029ab2-4966-4b8c-ba6c-e69cf982a372-metrics-certs podName:c2029ab2-4966-4b8c-ba6c-e69cf982a372 nodeName:}" failed. No retries permitted until 2026-07-15 13:12:26.131340401 +0000 UTC m=+66.219127321 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c2029ab2-4966-4b8c-ba6c-e69cf982a372-metrics-certs") pod "network-metrics-daemon-czmkz" (UID: "c2029ab2-4966-4b8c-ba6c-e69cf982a372") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 13:11:54.131430 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:54.131297    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 13:11:54.131513 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:54.131463    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1415012e-b242-427c-a9b8-6950353b06a4-original-pull-secret podName:1415012e-b242-427c-a9b8-6950353b06a4 nodeName:}" failed. No retries permitted until 2026-07-15 13:12:26.131440482 +0000 UTC m=+66.219227402 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1415012e-b242-427c-a9b8-6950353b06a4-original-pull-secret") pod "global-pull-secret-syncer-c8fxj" (UID: "1415012e-b242-427c-a9b8-6950353b06a4") : object "kube-system"/"original-pull-secret" not registered
Jul 15 13:11:54.231766 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:54.231731    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhrpc\" (UniqueName: \"kubernetes.io/projected/4a77382a-0656-4d70-88ce-01e6bf697342-kube-api-access-jhrpc\") pod \"network-check-target-d9lt8\" (UID: \"4a77382a-0656-4d70-88ce-01e6bf697342\") " pod="openshift-network-diagnostics/network-check-target-d9lt8"
Jul 15 13:11:54.231913 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:54.231892    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 13:11:54.231997 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:54.231920    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 13:11:54.231997 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:54.231931    2578 projected.go:196] Error preparing data for projected volume kube-api-access-jhrpc for pod openshift-network-diagnostics/network-check-target-d9lt8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 13:11:54.231997 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:54.231979    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a77382a-0656-4d70-88ce-01e6bf697342-kube-api-access-jhrpc podName:4a77382a-0656-4d70-88ce-01e6bf697342 nodeName:}" failed. No retries permitted until 2026-07-15 13:12:26.231966288 +0000 UTC m=+66.319753208 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jhrpc" (UniqueName: "kubernetes.io/projected/4a77382a-0656-4d70-88ce-01e6bf697342-kube-api-access-jhrpc") pod "network-check-target-d9lt8" (UID: "4a77382a-0656-4d70-88ce-01e6bf697342") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 13:11:54.369577 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:54.369501    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-czmkz"
Jul 15 13:11:54.369728 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:54.369618    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-czmkz" podUID="c2029ab2-4966-4b8c-ba6c-e69cf982a372"
Jul 15 13:11:54.531023 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:54.530854    2578 generic.go:356] "Generic (PLEG): container finished" podID="ed59f469-1285-4452-ac9a-a178f674611f" containerID="8fc73bfb1bb2fa65d07692ce3c97f67009470ece865abbcd0c47fb8cf1c4a2f2" exitCode=0
Jul 15 13:11:54.531023 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:54.530940    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wnvdj" event={"ID":"ed59f469-1285-4452-ac9a-a178f674611f","Type":"ContainerDied","Data":"8fc73bfb1bb2fa65d07692ce3c97f67009470ece865abbcd0c47fb8cf1c4a2f2"}
Jul 15 13:11:55.369376 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:55.369343    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c8fxj"
Jul 15 13:11:55.369543 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:55.369457    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c8fxj" podUID="1415012e-b242-427c-a9b8-6950353b06a4"
Jul 15 13:11:55.369543 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:55.369507    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9lt8"
Jul 15 13:11:55.369671 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:55.369592    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9lt8" podUID="4a77382a-0656-4d70-88ce-01e6bf697342"
Jul 15 13:11:55.536048 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:55.536016    2578 generic.go:356] "Generic (PLEG): container finished" podID="ed59f469-1285-4452-ac9a-a178f674611f" containerID="73f8ebf423fc07fcfbb8b9443ec5545e3041273b3a1b2d563a7f91b38acd2540" exitCode=0
Jul 15 13:11:55.536615 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:55.536075    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wnvdj" event={"ID":"ed59f469-1285-4452-ac9a-a178f674611f","Type":"ContainerDied","Data":"73f8ebf423fc07fcfbb8b9443ec5545e3041273b3a1b2d563a7f91b38acd2540"}
Jul 15 13:11:56.369147 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:56.369120    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-czmkz"
Jul 15 13:11:56.369303 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:56.369240    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-czmkz" podUID="c2029ab2-4966-4b8c-ba6c-e69cf982a372"
Jul 15 13:11:56.540775 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:56.540743    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wnvdj" event={"ID":"ed59f469-1285-4452-ac9a-a178f674611f","Type":"ContainerStarted","Data":"b171f280137c4a81e08587ebe23a3263cf4840c384f421688de2f3f36814a5b0"}
Jul 15 13:11:56.581095 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:56.581052    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wnvdj" podStartSLOduration=7.862721354 podStartE2EDuration="35.581038452s" totalImagesPullingTime="27.718317098s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:11:21 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:11:56.579276893 +0000 UTC m=+36.667063835" watchObservedRunningTime="2026-07-15 13:11:56.581038452 +0000 UTC m=+36.668825394"
Jul 15 13:11:57.245051 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.245023    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-159.ec2.internal" event="NodeReady"
Jul 15 13:11:57.245231 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.245157    2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 15 13:11:57.300666 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.300639    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6d4ff848df-v8kpc"]
Jul 15 13:11:57.335603 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.335535    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d4ff848df-v8kpc"]
Jul 15 13:11:57.335723 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.335620    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d4ff848df-v8kpc"
Jul 15 13:11:57.339638 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.339615    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9ff6l\""
Jul 15 13:11:57.339638 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.339632    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 15 13:11:57.339793 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.339648    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 15 13:11:57.339793 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.339692    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 15 13:11:57.347179 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.347160    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 15 13:11:57.352115 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.352098    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-fp5hs"]
Jul 15 13:11:57.362932 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.362916    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wqxcc"]
Jul 15 13:11:57.363040 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.363027    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fp5hs"
Jul 15 13:11:57.367857 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.367838    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 15 13:11:57.368126 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.367858    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 15 13:11:57.368521 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.367858    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 15 13:11:57.368781 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.367870    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jtsrm\""
Jul 15 13:11:57.374578 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.374532    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9lt8"
Jul 15 13:11:57.374578 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.374563    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wqxcc"
Jul 15 13:11:57.374871 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.374626    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c8fxj"
Jul 15 13:11:57.375217 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.375187    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fp5hs"]
Jul 15 13:11:57.375950 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.375933    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wqxcc"]
Jul 15 13:11:57.383994 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.383977    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 13:11:57.384097 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.383998    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 13:11:57.384097 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.384067    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 15 13:11:57.384223 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.384132    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 13:11:57.384288 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.384275    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 15 13:11:57.384398 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.384381    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bdsl2\""
Jul 15 13:11:57.384488 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.384471    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-b9szj\""
Jul 15 13:11:57.455490 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.455465    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-registry-tls\") pod \"image-registry-6d4ff848df-v8kpc\" (UID: \"91ab3ba4-74ad-465b-8f66-eaafd1b66e40\") " pod="openshift-image-registry/image-registry-6d4ff848df-v8kpc"
Jul 15 13:11:57.455623 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.455493    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-trusted-ca\") pod \"image-registry-6d4ff848df-v8kpc\" (UID: \"91ab3ba4-74ad-465b-8f66-eaafd1b66e40\") " pod="openshift-image-registry/image-registry-6d4ff848df-v8kpc"
Jul 15 13:11:57.455623 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.455514    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhp8h\" (UniqueName: \"kubernetes.io/projected/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-kube-api-access-hhp8h\") pod \"image-registry-6d4ff848df-v8kpc\" (UID: \"91ab3ba4-74ad-465b-8f66-eaafd1b66e40\") " pod="openshift-image-registry/image-registry-6d4ff848df-v8kpc"
Jul 15 13:11:57.455623 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.455587    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-ca-trust-extracted\") pod \"image-registry-6d4ff848df-v8kpc\" (UID: \"91ab3ba4-74ad-465b-8f66-eaafd1b66e40\") " pod="openshift-image-registry/image-registry-6d4ff848df-v8kpc"
Jul 15 13:11:57.455717 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.455633    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-bound-sa-token\") pod \"image-registry-6d4ff848df-v8kpc\" (UID: \"91ab3ba4-74ad-465b-8f66-eaafd1b66e40\") " pod="openshift-image-registry/image-registry-6d4ff848df-v8kpc"
Jul 15 13:11:57.455717 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.455657    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-installation-pull-secrets\") pod \"image-registry-6d4ff848df-v8kpc\" (UID: \"91ab3ba4-74ad-465b-8f66-eaafd1b66e40\") " pod="openshift-image-registry/image-registry-6d4ff848df-v8kpc"
Jul 15 13:11:57.455717 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.455680    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-registry-certificates\") pod \"image-registry-6d4ff848df-v8kpc\" (UID: \"91ab3ba4-74ad-465b-8f66-eaafd1b66e40\") " pod="openshift-image-registry/image-registry-6d4ff848df-v8kpc"
Jul 15 13:11:57.455805 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.455733    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-image-registry-private-configuration\") pod \"image-registry-6d4ff848df-v8kpc\" (UID: \"91ab3ba4-74ad-465b-8f66-eaafd1b66e40\") " pod="openshift-image-registry/image-registry-6d4ff848df-v8kpc"
Jul 15 13:11:57.556458 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.556413    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-registry-certificates\") pod \"image-registry-6d4ff848df-v8kpc\" (UID: \"91ab3ba4-74ad-465b-8f66-eaafd1b66e40\") " pod="openshift-image-registry/image-registry-6d4ff848df-v8kpc"
Jul 15 13:11:57.556861 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.556475    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b061bb5-718d-4fed-9076-9668e21d4b13-tmp-dir\") pod \"dns-default-wqxcc\" (UID: \"6b061bb5-718d-4fed-9076-9668e21d4b13\") " pod="openshift-dns/dns-default-wqxcc"
Jul 15 13:11:57.556861 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.556494    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-image-registry-private-configuration\") pod \"image-registry-6d4ff848df-v8kpc\" (UID: \"91ab3ba4-74ad-465b-8f66-eaafd1b66e40\") " pod="openshift-image-registry/image-registry-6d4ff848df-v8kpc"
Jul 15 13:11:57.556861 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.556514    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-registry-tls\") pod \"image-registry-6d4ff848df-v8kpc\" (UID: \"91ab3ba4-74ad-465b-8f66-eaafd1b66e40\") " pod="openshift-image-registry/image-registry-6d4ff848df-v8kpc"
Jul 15 13:11:57.556861 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.556530    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-trusted-ca\") pod \"image-registry-6d4ff848df-v8kpc\" (UID: \"91ab3ba4-74ad-465b-8f66-eaafd1b66e40\") " pod="openshift-image-registry/image-registry-6d4ff848df-v8kpc"
Jul 15 13:11:57.556861 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.556545    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhp8h\" (UniqueName: \"kubernetes.io/projected/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-kube-api-access-hhp8h\") pod \"image-registry-6d4ff848df-v8kpc\" (UID: \"91ab3ba4-74ad-465b-8f66-eaafd1b66e40\") " pod="openshift-image-registry/image-registry-6d4ff848df-v8kpc"
Jul 15 13:11:57.556861 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.556569    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqxpg\" (UniqueName: \"kubernetes.io/projected/5920a816-5d9e-4020-a084-a84faf51ca5d-kube-api-access-sqxpg\") pod \"ingress-canary-fp5hs\" (UID: \"5920a816-5d9e-4020-a084-a84faf51ca5d\") " pod="openshift-ingress-canary/ingress-canary-fp5hs"
Jul 15 13:11:57.556861 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.556599    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btc9h\" (UniqueName: \"kubernetes.io/projected/6b061bb5-718d-4fed-9076-9668e21d4b13-kube-api-access-btc9h\") pod \"dns-default-wqxcc\" (UID: \"6b061bb5-718d-4fed-9076-9668e21d4b13\") " pod="openshift-dns/dns-default-wqxcc"
Jul 15 13:11:57.556861 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:57.556634    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 13:11:57.556861 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:57.556655    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d4ff848df-v8kpc: secret "image-registry-tls" not found
Jul 15 13:11:57.556861 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.556639    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6b061bb5-718d-4fed-9076-9668e21d4b13-config-volume\") pod \"dns-default-wqxcc\" (UID: \"6b061bb5-718d-4fed-9076-9668e21d4b13\") " pod="openshift-dns/dns-default-wqxcc"
Jul 15 13:11:57.556861 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:57.556727    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-registry-tls podName:91ab3ba4-74ad-465b-8f66-eaafd1b66e40 nodeName:}" failed. No retries permitted until 2026-07-15 13:11:58.056707946 +0000 UTC m=+38.144494871 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-registry-tls") pod "image-registry-6d4ff848df-v8kpc" (UID: "91ab3ba4-74ad-465b-8f66-eaafd1b66e40") : secret "image-registry-tls" not found
Jul 15 13:11:57.556861 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.556805    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-ca-trust-extracted\") pod \"image-registry-6d4ff848df-v8kpc\" (UID: \"91ab3ba4-74ad-465b-8f66-eaafd1b66e40\") " pod="openshift-image-registry/image-registry-6d4ff848df-v8kpc"
Jul 15 13:11:57.556861 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.556869    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-bound-sa-token\") pod \"image-registry-6d4ff848df-v8kpc\" (UID: \"91ab3ba4-74ad-465b-8f66-eaafd1b66e40\") " pod="openshift-image-registry/image-registry-6d4ff848df-v8kpc"
Jul 15 13:11:57.557424 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.556897    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5920a816-5d9e-4020-a084-a84faf51ca5d-cert\") pod \"ingress-canary-fp5hs\" (UID: \"5920a816-5d9e-4020-a084-a84faf51ca5d\") " pod="openshift-ingress-canary/ingress-canary-fp5hs"
Jul 15 13:11:57.557424 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.556921    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b061bb5-718d-4fed-9076-9668e21d4b13-metrics-tls\") pod \"dns-default-wqxcc\" (UID: \"6b061bb5-718d-4fed-9076-9668e21d4b13\") " pod="openshift-dns/dns-default-wqxcc"
Jul 15 13:11:57.557424 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.556945    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-installation-pull-secrets\") pod \"image-registry-6d4ff848df-v8kpc\" (UID: \"91ab3ba4-74ad-465b-8f66-eaafd1b66e40\") " pod="openshift-image-registry/image-registry-6d4ff848df-v8kpc"
Jul 15 13:11:57.557424 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.557071    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-registry-certificates\") pod \"image-registry-6d4ff848df-v8kpc\" (UID: \"91ab3ba4-74ad-465b-8f66-eaafd1b66e40\") " pod="openshift-image-registry/image-registry-6d4ff848df-v8kpc"
Jul 15 13:11:57.557424 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.557190    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-ca-trust-extracted\") pod \"image-registry-6d4ff848df-v8kpc\" (UID: \"91ab3ba4-74ad-465b-8f66-eaafd1b66e40\") " pod="openshift-image-registry/image-registry-6d4ff848df-v8kpc"
Jul 15 13:11:57.557575 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.557438    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-trusted-ca\") pod \"image-registry-6d4ff848df-v8kpc\" (UID: \"91ab3ba4-74ad-465b-8f66-eaafd1b66e40\") " pod="openshift-image-registry/image-registry-6d4ff848df-v8kpc"
Jul 15 13:11:57.560720 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.560702    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-image-registry-private-configuration\") pod \"image-registry-6d4ff848df-v8kpc\" (UID: \"91ab3ba4-74ad-465b-8f66-eaafd1b66e40\") " pod="openshift-image-registry/image-registry-6d4ff848df-v8kpc"
Jul 15 13:11:57.560819 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.560705    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-installation-pull-secrets\") pod \"image-registry-6d4ff848df-v8kpc\" (UID: \"91ab3ba4-74ad-465b-8f66-eaafd1b66e40\") " pod="openshift-image-registry/image-registry-6d4ff848df-v8kpc"
Jul 15 13:11:57.571413 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.571388    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-bound-sa-token\") pod \"image-registry-6d4ff848df-v8kpc\" (UID: \"91ab3ba4-74ad-465b-8f66-eaafd1b66e40\") " pod="openshift-image-registry/image-registry-6d4ff848df-v8kpc"
Jul 15 13:11:57.581270 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.581247    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhp8h\" (UniqueName: \"kubernetes.io/projected/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-kube-api-access-hhp8h\") pod \"image-registry-6d4ff848df-v8kpc\" (UID: \"91ab3ba4-74ad-465b-8f66-eaafd1b66e40\") " pod="openshift-image-registry/image-registry-6d4ff848df-v8kpc"
Jul 15 13:11:57.658307 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.658238    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqxpg\" (UniqueName: \"kubernetes.io/projected/5920a816-5d9e-4020-a084-a84faf51ca5d-kube-api-access-sqxpg\") pod \"ingress-canary-fp5hs\" (UID: \"5920a816-5d9e-4020-a084-a84faf51ca5d\") " pod="openshift-ingress-canary/ingress-canary-fp5hs"
Jul 15 13:11:57.658307 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.658276    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btc9h\" (UniqueName: \"kubernetes.io/projected/6b061bb5-718d-4fed-9076-9668e21d4b13-kube-api-access-btc9h\") pod \"dns-default-wqxcc\" (UID: \"6b061bb5-718d-4fed-9076-9668e21d4b13\") " pod="openshift-dns/dns-default-wqxcc"
Jul 15 13:11:57.658307 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.658302    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6b061bb5-718d-4fed-9076-9668e21d4b13-config-volume\") pod \"dns-default-wqxcc\" (UID: \"6b061bb5-718d-4fed-9076-9668e21d4b13\") " pod="openshift-dns/dns-default-wqxcc"
Jul 15 13:11:57.658588 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.658340    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5920a816-5d9e-4020-a084-a84faf51ca5d-cert\") pod \"ingress-canary-fp5hs\" (UID: \"5920a816-5d9e-4020-a084-a84faf51ca5d\") " pod="openshift-ingress-canary/ingress-canary-fp5hs"
Jul 15 13:11:57.658588 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.658367    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b061bb5-718d-4fed-9076-9668e21d4b13-metrics-tls\") pod \"dns-default-wqxcc\" (UID: \"6b061bb5-718d-4fed-9076-9668e21d4b13\") " pod="openshift-dns/dns-default-wqxcc"
Jul 15 13:11:57.658588 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:57.658487    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 13:11:57.658588 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:57.658549    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b061bb5-718d-4fed-9076-9668e21d4b13-metrics-tls podName:6b061bb5-718d-4fed-9076-9668e21d4b13 nodeName:}" failed. No retries permitted until 2026-07-15 13:11:58.15852886 +0000 UTC m=+38.246315793 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6b061bb5-718d-4fed-9076-9668e21d4b13-metrics-tls") pod "dns-default-wqxcc" (UID: "6b061bb5-718d-4fed-9076-9668e21d4b13") : secret "dns-default-metrics-tls" not found
Jul 15 13:11:57.658783 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.658591    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b061bb5-718d-4fed-9076-9668e21d4b13-tmp-dir\") pod \"dns-default-wqxcc\" (UID: \"6b061bb5-718d-4fed-9076-9668e21d4b13\") " pod="openshift-dns/dns-default-wqxcc"
Jul 15 13:11:57.658906 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.658876    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b061bb5-718d-4fed-9076-9668e21d4b13-tmp-dir\") pod \"dns-default-wqxcc\" (UID: \"6b061bb5-718d-4fed-9076-9668e21d4b13\") " pod="openshift-dns/dns-default-wqxcc"
Jul 15 13:11:57.659001 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.658984    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6b061bb5-718d-4fed-9076-9668e21d4b13-config-volume\") pod \"dns-default-wqxcc\" (UID: \"6b061bb5-718d-4fed-9076-9668e21d4b13\") " pod="openshift-dns/dns-default-wqxcc"
Jul 15 13:11:57.660697 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.660680    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5920a816-5d9e-4020-a084-a84faf51ca5d-cert\") pod \"ingress-canary-fp5hs\" (UID: \"5920a816-5d9e-4020-a084-a84faf51ca5d\") " pod="openshift-ingress-canary/ingress-canary-fp5hs"
Jul 15 13:11:57.673121 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.673092    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btc9h\" (UniqueName: \"kubernetes.io/projected/6b061bb5-718d-4fed-9076-9668e21d4b13-kube-api-access-btc9h\") pod \"dns-default-wqxcc\" (UID: \"6b061bb5-718d-4fed-9076-9668e21d4b13\") " pod="openshift-dns/dns-default-wqxcc"
Jul 15 13:11:57.674787 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.674767    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqxpg\" (UniqueName: \"kubernetes.io/projected/5920a816-5d9e-4020-a084-a84faf51ca5d-kube-api-access-sqxpg\") pod \"ingress-canary-fp5hs\" (UID: \"5920a816-5d9e-4020-a084-a84faf51ca5d\") " pod="openshift-ingress-canary/ingress-canary-fp5hs"
Jul 15 13:11:57.973324 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:57.973295    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fp5hs"
Jul 15 13:11:58.062144 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:58.062113    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-registry-tls\") pod \"image-registry-6d4ff848df-v8kpc\" (UID: \"91ab3ba4-74ad-465b-8f66-eaafd1b66e40\") " pod="openshift-image-registry/image-registry-6d4ff848df-v8kpc"
Jul 15 13:11:58.062311 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:58.062291    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 13:11:58.062360 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:58.062314    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d4ff848df-v8kpc: secret "image-registry-tls" not found
Jul 15 13:11:58.062393 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:58.062379    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-registry-tls podName:91ab3ba4-74ad-465b-8f66-eaafd1b66e40 nodeName:}" failed. No retries permitted until 2026-07-15 13:11:59.062364439 +0000 UTC m=+39.150151359 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-registry-tls") pod "image-registry-6d4ff848df-v8kpc" (UID: "91ab3ba4-74ad-465b-8f66-eaafd1b66e40") : secret "image-registry-tls" not found
Jul 15 13:11:58.162778 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:58.162614    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b061bb5-718d-4fed-9076-9668e21d4b13-metrics-tls\") pod \"dns-default-wqxcc\" (UID: \"6b061bb5-718d-4fed-9076-9668e21d4b13\") " pod="openshift-dns/dns-default-wqxcc"
Jul 15 13:11:58.162778 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:58.162770    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 13:11:58.162938 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:58.162833    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b061bb5-718d-4fed-9076-9668e21d4b13-metrics-tls podName:6b061bb5-718d-4fed-9076-9668e21d4b13 nodeName:}" failed. No retries permitted until 2026-07-15 13:11:59.162818474 +0000 UTC m=+39.250605393 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6b061bb5-718d-4fed-9076-9668e21d4b13-metrics-tls") pod "dns-default-wqxcc" (UID: "6b061bb5-718d-4fed-9076-9668e21d4b13") : secret "dns-default-metrics-tls" not found
Jul 15 13:11:58.194588 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:58.194563    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fp5hs"]
Jul 15 13:11:58.198016 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:11:58.197994    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5920a816_5d9e_4020_a084_a84faf51ca5d.slice/crio-e161e4ce19c8da742f39147f1f5c6897396434795c84fabf0e3ceaf3e5a87526 WatchSource:0}: Error finding container e161e4ce19c8da742f39147f1f5c6897396434795c84fabf0e3ceaf3e5a87526: Status 404 returned error can't find the container with id e161e4ce19c8da742f39147f1f5c6897396434795c84fabf0e3ceaf3e5a87526
Jul 15 13:11:58.372408 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:58.372331    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-czmkz"
Jul 15 13:11:58.377924 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:58.377894    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hh9ms\""
Jul 15 13:11:58.378046 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:58.377936    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 13:11:58.545981 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:58.545948    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fp5hs" event={"ID":"5920a816-5d9e-4020-a084-a84faf51ca5d","Type":"ContainerStarted","Data":"e161e4ce19c8da742f39147f1f5c6897396434795c84fabf0e3ceaf3e5a87526"}
Jul 15 13:11:59.068972 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:59.068937    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-registry-tls\") pod \"image-registry-6d4ff848df-v8kpc\" (UID: \"91ab3ba4-74ad-465b-8f66-eaafd1b66e40\") " pod="openshift-image-registry/image-registry-6d4ff848df-v8kpc"
Jul 15 13:11:59.069519 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:59.069116    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 13:11:59.069519 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:59.069141    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d4ff848df-v8kpc: secret "image-registry-tls" not found
Jul 15 13:11:59.069519 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:59.069218    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-registry-tls podName:91ab3ba4-74ad-465b-8f66-eaafd1b66e40 nodeName:}" failed. No retries permitted until 2026-07-15 13:12:01.069186341 +0000 UTC m=+41.156973260 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-registry-tls") pod "image-registry-6d4ff848df-v8kpc" (UID: "91ab3ba4-74ad-465b-8f66-eaafd1b66e40") : secret "image-registry-tls" not found
Jul 15 13:11:59.169412 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:11:59.169378    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b061bb5-718d-4fed-9076-9668e21d4b13-metrics-tls\") pod \"dns-default-wqxcc\" (UID: \"6b061bb5-718d-4fed-9076-9668e21d4b13\") " pod="openshift-dns/dns-default-wqxcc"
Jul 15 13:11:59.169592 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:59.169544    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 13:11:59.169673 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:11:59.169612    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b061bb5-718d-4fed-9076-9668e21d4b13-metrics-tls podName:6b061bb5-718d-4fed-9076-9668e21d4b13 nodeName:}" failed. No retries permitted until 2026-07-15 13:12:01.169592673 +0000 UTC m=+41.257379595 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6b061bb5-718d-4fed-9076-9668e21d4b13-metrics-tls") pod "dns-default-wqxcc" (UID: "6b061bb5-718d-4fed-9076-9668e21d4b13") : secret "dns-default-metrics-tls" not found
Jul 15 13:12:01.083275 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:12:01.083231    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-registry-tls\") pod \"image-registry-6d4ff848df-v8kpc\" (UID: \"91ab3ba4-74ad-465b-8f66-eaafd1b66e40\") " pod="openshift-image-registry/image-registry-6d4ff848df-v8kpc"
Jul 15 13:12:01.083794 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:12:01.083386    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 13:12:01.083794 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:12:01.083406    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d4ff848df-v8kpc: secret "image-registry-tls" not found
Jul 15 13:12:01.083794 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:12:01.083464    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-registry-tls podName:91ab3ba4-74ad-465b-8f66-eaafd1b66e40 nodeName:}" failed. No retries permitted until 2026-07-15 13:12:05.083448986 +0000 UTC m=+45.171235906 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-registry-tls") pod "image-registry-6d4ff848df-v8kpc" (UID: "91ab3ba4-74ad-465b-8f66-eaafd1b66e40") : secret "image-registry-tls" not found
Jul 15 13:12:01.183882 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:12:01.183800    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b061bb5-718d-4fed-9076-9668e21d4b13-metrics-tls\") pod \"dns-default-wqxcc\" (UID: \"6b061bb5-718d-4fed-9076-9668e21d4b13\") " pod="openshift-dns/dns-default-wqxcc"
Jul 15 13:12:01.184015 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:12:01.183939    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 13:12:01.184015 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:12:01.184000    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b061bb5-718d-4fed-9076-9668e21d4b13-metrics-tls podName:6b061bb5-718d-4fed-9076-9668e21d4b13 nodeName:}" failed. No retries permitted until 2026-07-15 13:12:05.183986153 +0000 UTC m=+45.271773078 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6b061bb5-718d-4fed-9076-9668e21d4b13-metrics-tls") pod "dns-default-wqxcc" (UID: "6b061bb5-718d-4fed-9076-9668e21d4b13") : secret "dns-default-metrics-tls" not found
Jul 15 13:12:01.555272 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:12:01.555234    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fp5hs" event={"ID":"5920a816-5d9e-4020-a084-a84faf51ca5d","Type":"ContainerStarted","Data":"b77673bf3e52b34eaef40e52f04c74e4b70b24eec836089d6d6e015c518f12d4"}
Jul 15 13:12:01.581894 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:12:01.581843    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-fp5hs" podStartSLOduration=1.909091885 podStartE2EDuration="4.581825202s" totalImagesPullingTime="2.672733317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:11:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:12:01.581153203 +0000 UTC m=+41.668940150" watchObservedRunningTime="2026-07-15 13:12:01.581825202 +0000 UTC m=+41.669612144"
Jul 15 13:12:05.109197 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:12:05.109006    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-registry-tls\") pod \"image-registry-6d4ff848df-v8kpc\" (UID: \"91ab3ba4-74ad-465b-8f66-eaafd1b66e40\") " pod="openshift-image-registry/image-registry-6d4ff848df-v8kpc"
Jul 15 13:12:05.109659 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:12:05.109150    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 13:12:05.109659 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:12:05.109278    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d4ff848df-v8kpc: secret "image-registry-tls" not found
Jul 15 13:12:05.109659 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:12:05.109353    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-registry-tls podName:91ab3ba4-74ad-465b-8f66-eaafd1b66e40 nodeName:}" failed. No retries permitted until 2026-07-15 13:12:13.109330429 +0000 UTC m=+53.197117352 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-registry-tls") pod "image-registry-6d4ff848df-v8kpc" (UID: "91ab3ba4-74ad-465b-8f66-eaafd1b66e40") : secret "image-registry-tls" not found
Jul 15 13:12:05.210089 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:12:05.210058    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b061bb5-718d-4fed-9076-9668e21d4b13-metrics-tls\") pod \"dns-default-wqxcc\" (UID: \"6b061bb5-718d-4fed-9076-9668e21d4b13\") " pod="openshift-dns/dns-default-wqxcc"
Jul 15 13:12:05.210232 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:12:05.210161    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 13:12:05.210232 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:12:05.210225    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b061bb5-718d-4fed-9076-9668e21d4b13-metrics-tls podName:6b061bb5-718d-4fed-9076-9668e21d4b13 nodeName:}" failed. No retries permitted until 2026-07-15 13:12:13.210196031 +0000 UTC m=+53.297982952 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6b061bb5-718d-4fed-9076-9668e21d4b13-metrics-tls") pod "dns-default-wqxcc" (UID: "6b061bb5-718d-4fed-9076-9668e21d4b13") : secret "dns-default-metrics-tls" not found
Jul 15 13:12:13.166215 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:12:13.166177    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-registry-tls\") pod \"image-registry-6d4ff848df-v8kpc\" (UID: \"91ab3ba4-74ad-465b-8f66-eaafd1b66e40\") " pod="openshift-image-registry/image-registry-6d4ff848df-v8kpc"
Jul 15 13:12:13.166659 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:12:13.166334    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 13:12:13.166659 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:12:13.166353    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d4ff848df-v8kpc: secret "image-registry-tls" not found
Jul 15 13:12:13.166659 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:12:13.166415    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-registry-tls podName:91ab3ba4-74ad-465b-8f66-eaafd1b66e40 nodeName:}" failed. No retries permitted until 2026-07-15 13:12:29.166400566 +0000 UTC m=+69.254187489 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-registry-tls") pod "image-registry-6d4ff848df-v8kpc" (UID: "91ab3ba4-74ad-465b-8f66-eaafd1b66e40") : secret "image-registry-tls" not found
Jul 15 13:12:13.266776 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:12:13.266735    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b061bb5-718d-4fed-9076-9668e21d4b13-metrics-tls\") pod \"dns-default-wqxcc\" (UID: \"6b061bb5-718d-4fed-9076-9668e21d4b13\") " pod="openshift-dns/dns-default-wqxcc"
Jul 15 13:12:13.267010 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:12:13.266885    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 13:12:13.267010 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:12:13.266951    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b061bb5-718d-4fed-9076-9668e21d4b13-metrics-tls podName:6b061bb5-718d-4fed-9076-9668e21d4b13 nodeName:}" failed. No retries permitted until 2026-07-15 13:12:29.266935027 +0000 UTC m=+69.354722182 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6b061bb5-718d-4fed-9076-9668e21d4b13-metrics-tls") pod "dns-default-wqxcc" (UID: "6b061bb5-718d-4fed-9076-9668e21d4b13") : secret "dns-default-metrics-tls" not found
Jul 15 13:12:23.544902 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:12:23.544870    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kt6q4"
Jul 15 13:12:26.162822 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:12:26.162781    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1415012e-b242-427c-a9b8-6950353b06a4-original-pull-secret\") pod \"global-pull-secret-syncer-c8fxj\" (UID: \"1415012e-b242-427c-a9b8-6950353b06a4\") " pod="kube-system/global-pull-secret-syncer-c8fxj"
Jul 15 13:12:26.163328 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:12:26.162834    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2029ab2-4966-4b8c-ba6c-e69cf982a372-metrics-certs\") pod \"network-metrics-daemon-czmkz\" (UID: \"c2029ab2-4966-4b8c-ba6c-e69cf982a372\") " pod="openshift-multus/network-metrics-daemon-czmkz"
Jul 15 13:12:26.166289 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:12:26.166269    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 13:12:26.166385 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:12:26.166270    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 13:12:26.174021 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:12:26.174003    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 15 13:12:26.174076 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:12:26.174058    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2029ab2-4966-4b8c-ba6c-e69cf982a372-metrics-certs podName:c2029ab2-4966-4b8c-ba6c-e69cf982a372 nodeName:}" failed. No retries permitted until 2026-07-15 13:13:30.174042262 +0000 UTC m=+130.261829185 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c2029ab2-4966-4b8c-ba6c-e69cf982a372-metrics-certs") pod "network-metrics-daemon-czmkz" (UID: "c2029ab2-4966-4b8c-ba6c-e69cf982a372") : secret "metrics-daemon-secret" not found
Jul 15 13:12:26.177556 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:12:26.177540    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1415012e-b242-427c-a9b8-6950353b06a4-original-pull-secret\") pod \"global-pull-secret-syncer-c8fxj\" (UID: \"1415012e-b242-427c-a9b8-6950353b06a4\") " pod="kube-system/global-pull-secret-syncer-c8fxj"
Jul 15 13:12:26.190846 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:12:26.190828    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c8fxj"
Jul 15 13:12:26.263631 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:12:26.263448    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhrpc\" (UniqueName: \"kubernetes.io/projected/4a77382a-0656-4d70-88ce-01e6bf697342-kube-api-access-jhrpc\") pod \"network-check-target-d9lt8\" (UID: \"4a77382a-0656-4d70-88ce-01e6bf697342\") " pod="openshift-network-diagnostics/network-check-target-d9lt8"
Jul 15 13:12:26.266993 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:12:26.266971    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 13:12:26.276912 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:12:26.276889    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 13:12:26.287084 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:12:26.287057    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhrpc\" (UniqueName: \"kubernetes.io/projected/4a77382a-0656-4d70-88ce-01e6bf697342-kube-api-access-jhrpc\") pod \"network-check-target-d9lt8\" (UID: \"4a77382a-0656-4d70-88ce-01e6bf697342\") " pod="openshift-network-diagnostics/network-check-target-d9lt8"
Jul 15 13:12:26.318656 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:12:26.318624    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-c8fxj"]
Jul 15 13:12:26.322483 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:12:26.322458    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1415012e_b242_427c_a9b8_6950353b06a4.slice/crio-98f1fcb361e4b480355245a21a2db3907203c03633596c878f743d798fe70eb8 WatchSource:0}: Error finding container 98f1fcb361e4b480355245a21a2db3907203c03633596c878f743d798fe70eb8: Status 404 returned error can't find the container with id 98f1fcb361e4b480355245a21a2db3907203c03633596c878f743d798fe70eb8
Jul 15 13:12:26.489154 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:12:26.489135    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-b9szj\""
Jul 15 13:12:26.494766 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:12:26.494744    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9lt8"
Jul 15 13:12:26.609828 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:12:26.609801    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-d9lt8"]
Jul 15 13:12:26.611214 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:12:26.611177    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-c8fxj" event={"ID":"1415012e-b242-427c-a9b8-6950353b06a4","Type":"ContainerStarted","Data":"98f1fcb361e4b480355245a21a2db3907203c03633596c878f743d798fe70eb8"}
Jul 15 13:12:26.613287 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:12:26.613269    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a77382a_0656_4d70_88ce_01e6bf697342.slice/crio-449d3a85fb8db0072dd453c6c2d902e690e71d1e5c65aa1a8e9644417aea5507 WatchSource:0}: Error finding container 449d3a85fb8db0072dd453c6c2d902e690e71d1e5c65aa1a8e9644417aea5507: Status 404 returned error can't find the container with id 449d3a85fb8db0072dd453c6c2d902e690e71d1e5c65aa1a8e9644417aea5507
Jul 15 13:12:27.615582 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:12:27.615470    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-d9lt8" event={"ID":"4a77382a-0656-4d70-88ce-01e6bf697342","Type":"ContainerStarted","Data":"449d3a85fb8db0072dd453c6c2d902e690e71d1e5c65aa1a8e9644417aea5507"}
Jul 15 13:12:29.184486 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:12:29.184446    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-registry-tls\") pod \"image-registry-6d4ff848df-v8kpc\" (UID: \"91ab3ba4-74ad-465b-8f66-eaafd1b66e40\") " pod="openshift-image-registry/image-registry-6d4ff848df-v8kpc"
Jul 15 13:12:29.184891 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:12:29.184643    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 13:12:29.184891 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:12:29.184666    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d4ff848df-v8kpc: secret "image-registry-tls" not found
Jul 15 13:12:29.184891 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:12:29.184753    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-registry-tls podName:91ab3ba4-74ad-465b-8f66-eaafd1b66e40 nodeName:}" failed. No retries permitted until 2026-07-15 13:13:01.184731223 +0000 UTC m=+101.272518148 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-registry-tls") pod "image-registry-6d4ff848df-v8kpc" (UID: "91ab3ba4-74ad-465b-8f66-eaafd1b66e40") : secret "image-registry-tls" not found
Jul 15 13:12:29.285327 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:12:29.285286    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b061bb5-718d-4fed-9076-9668e21d4b13-metrics-tls\") pod \"dns-default-wqxcc\" (UID: \"6b061bb5-718d-4fed-9076-9668e21d4b13\") " pod="openshift-dns/dns-default-wqxcc"
Jul 15 13:12:29.285503 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:12:29.285458    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 13:12:29.285564 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:12:29.285539    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b061bb5-718d-4fed-9076-9668e21d4b13-metrics-tls podName:6b061bb5-718d-4fed-9076-9668e21d4b13 nodeName:}" failed. No retries permitted until 2026-07-15 13:13:01.285519394 +0000 UTC m=+101.373306314 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6b061bb5-718d-4fed-9076-9668e21d4b13-metrics-tls") pod "dns-default-wqxcc" (UID: "6b061bb5-718d-4fed-9076-9668e21d4b13") : secret "dns-default-metrics-tls" not found
Jul 15 13:12:31.626616 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:12:31.626574    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-c8fxj" event={"ID":"1415012e-b242-427c-a9b8-6950353b06a4","Type":"ContainerStarted","Data":"f06f0202f99e897ff5286099615b617bdcdf1f21878825923e9a22643eba520c"}
Jul 15 13:12:31.627997 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:12:31.627975    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-d9lt8" event={"ID":"4a77382a-0656-4d70-88ce-01e6bf697342","Type":"ContainerStarted","Data":"83b3579d466a3104cf2a4c343a44d443e000546cbc5a1e23f9f40de27c520324"}
Jul 15 13:12:31.628123 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:12:31.628108    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-d9lt8"
Jul 15 13:12:31.645237 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:12:31.645045    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-c8fxj" podStartSLOduration=65.979118183 podStartE2EDuration="1m10.645029591s" totalImagesPullingTime="4.665911408s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:11:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:12:31.644419917 +0000 UTC m=+71.732206860" watchObservedRunningTime="2026-07-15 13:12:31.645029591 +0000 UTC m=+71.732816532"
Jul 15 13:12:31.664018 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:12:31.663975    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-d9lt8" podStartSLOduration=66.292609296 podStartE2EDuration="1m10.663960111s" totalImagesPullingTime="4.371350815s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:11:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:12:31.663445742 +0000 UTC m=+71.751232683" watchObservedRunningTime="2026-07-15 13:12:31.663960111 +0000 UTC m=+71.751747052"
Jul 15 13:13:01.200248 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:13:01.200084    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-registry-tls\") pod \"image-registry-6d4ff848df-v8kpc\" (UID: \"91ab3ba4-74ad-465b-8f66-eaafd1b66e40\") " pod="openshift-image-registry/image-registry-6d4ff848df-v8kpc"
Jul 15 13:13:01.200248 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:13:01.200195    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 13:13:01.200248 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:13:01.200221    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d4ff848df-v8kpc: secret "image-registry-tls" not found
Jul 15 13:13:01.200737 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:13:01.200279    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-registry-tls podName:91ab3ba4-74ad-465b-8f66-eaafd1b66e40 nodeName:}" failed. No retries permitted until 2026-07-15 13:14:05.20026446 +0000 UTC m=+165.288051380 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-registry-tls") pod "image-registry-6d4ff848df-v8kpc" (UID: "91ab3ba4-74ad-465b-8f66-eaafd1b66e40") : secret "image-registry-tls" not found
Jul 15 13:13:01.301285 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:13:01.301252    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b061bb5-718d-4fed-9076-9668e21d4b13-metrics-tls\") pod \"dns-default-wqxcc\" (UID: \"6b061bb5-718d-4fed-9076-9668e21d4b13\") " pod="openshift-dns/dns-default-wqxcc"
Jul 15 13:13:01.301424 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:13:01.301403    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 13:13:01.301478 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:13:01.301468    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b061bb5-718d-4fed-9076-9668e21d4b13-metrics-tls podName:6b061bb5-718d-4fed-9076-9668e21d4b13 nodeName:}" failed. No retries permitted until 2026-07-15 13:14:05.301452756 +0000 UTC m=+165.389239676 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6b061bb5-718d-4fed-9076-9668e21d4b13-metrics-tls") pod "dns-default-wqxcc" (UID: "6b061bb5-718d-4fed-9076-9668e21d4b13") : secret "dns-default-metrics-tls" not found
Jul 15 13:13:02.633334 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:13:02.633304    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-d9lt8"
Jul 15 13:13:30.205126 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:13:30.205084    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2029ab2-4966-4b8c-ba6c-e69cf982a372-metrics-certs\") pod \"network-metrics-daemon-czmkz\" (UID: \"c2029ab2-4966-4b8c-ba6c-e69cf982a372\") " pod="openshift-multus/network-metrics-daemon-czmkz"
Jul 15 13:13:30.205577 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:13:30.205253    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 15 13:13:30.205577 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:13:30.205341    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2029ab2-4966-4b8c-ba6c-e69cf982a372-metrics-certs podName:c2029ab2-4966-4b8c-ba6c-e69cf982a372 nodeName:}" failed. No retries permitted until 2026-07-15 13:15:32.205323855 +0000 UTC m=+252.293110778 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c2029ab2-4966-4b8c-ba6c-e69cf982a372-metrics-certs") pod "network-metrics-daemon-czmkz" (UID: "c2029ab2-4966-4b8c-ba6c-e69cf982a372") : secret "metrics-daemon-secret" not found
Jul 15 13:14:00.345654 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:14:00.345619    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6d4ff848df-v8kpc" podUID="91ab3ba4-74ad-465b-8f66-eaafd1b66e40"
Jul 15 13:14:00.395525 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:14:00.395495    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-wqxcc" podUID="6b061bb5-718d-4fed-9076-9668e21d4b13"
Jul 15 13:14:00.839346 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:14:00.839312    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wqxcc"
Jul 15 13:14:01.381170 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:14:01.381124    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-czmkz" podUID="c2029ab2-4966-4b8c-ba6c-e69cf982a372"
Jul 15 13:14:05.246282 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:14:05.246247    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-registry-tls\") pod \"image-registry-6d4ff848df-v8kpc\" (UID: \"91ab3ba4-74ad-465b-8f66-eaafd1b66e40\") " pod="openshift-image-registry/image-registry-6d4ff848df-v8kpc"
Jul 15 13:14:05.246630 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:14:05.246379    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 13:14:05.246630 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:14:05.246390    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d4ff848df-v8kpc: secret "image-registry-tls" not found
Jul 15 13:14:05.246630 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:14:05.246441    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-registry-tls podName:91ab3ba4-74ad-465b-8f66-eaafd1b66e40 nodeName:}" failed. No retries permitted until 2026-07-15 13:16:07.246427071 +0000 UTC m=+287.334213991 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-registry-tls") pod "image-registry-6d4ff848df-v8kpc" (UID: "91ab3ba4-74ad-465b-8f66-eaafd1b66e40") : secret "image-registry-tls" not found
Jul 15 13:14:05.346718 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:14:05.346684    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b061bb5-718d-4fed-9076-9668e21d4b13-metrics-tls\") pod \"dns-default-wqxcc\" (UID: \"6b061bb5-718d-4fed-9076-9668e21d4b13\") " pod="openshift-dns/dns-default-wqxcc"
Jul 15 13:14:05.346924 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:14:05.346828    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 13:14:05.346924 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:14:05.346889    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b061bb5-718d-4fed-9076-9668e21d4b13-metrics-tls podName:6b061bb5-718d-4fed-9076-9668e21d4b13 nodeName:}" failed. No retries permitted until 2026-07-15 13:16:07.346872589 +0000 UTC m=+287.434659509 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6b061bb5-718d-4fed-9076-9668e21d4b13-metrics-tls") pod "dns-default-wqxcc" (UID: "6b061bb5-718d-4fed-9076-9668e21d4b13") : secret "dns-default-metrics-tls" not found
Jul 15 13:14:13.369659 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:14:13.369572    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d4ff848df-v8kpc"
Jul 15 13:14:13.369659 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:14:13.369572    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-czmkz"
Jul 15 13:15:24.704552 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.704514    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-5vp9j"]
Jul 15 13:15:24.706409 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.706393    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-5vp9j"
Jul 15 13:15:24.709528 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.709504    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 15 13:15:24.709768 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.709731    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-p74p5\""
Jul 15 13:15:24.709885 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.709870    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 15 13:15:24.711050 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.711033    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 15 13:15:24.714374 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.714354    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 15 13:15:24.716815 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.716799    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 15 13:15:24.719070 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.719049    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-5vp9j"]
Jul 15 13:15:24.816056 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.816028    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cjgpm"]
Jul 15 13:15:24.818755 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.818719    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-cpc58"]
Jul 15 13:15:24.819332 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.819309    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cjgpm"
Jul 15 13:15:24.821325 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.821304    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-8db99c4db-qzshk"]
Jul 15 13:15:24.821458 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.821440    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-cpc58"
Jul 15 13:15:24.822734 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.822715    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 15 13:15:24.822831 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.822777    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-7d42c\""
Jul 15 13:15:24.823100 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.823084    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-8db99c4db-qzshk"
Jul 15 13:15:24.824810 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.824790    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 15 13:15:24.824911 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.824886    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-z2v86\""
Jul 15 13:15:24.824911 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.824817    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 15 13:15:24.825022 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.824939    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 15 13:15:24.825022 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.824797    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 15 13:15:24.825022 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.824866    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 15 13:15:24.825808 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.825795    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 15 13:15:24.826399 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.826380    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 15 13:15:24.826506 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.826384    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 15 13:15:24.826772 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.826752    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 15 13:15:24.826885 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.826867    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 15 13:15:24.826946 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.826867    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 15 13:15:24.827002 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.826945    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-f2kkj\""
Jul 15 13:15:24.835961 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.835940    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-xj7ht"]
Jul 15 13:15:24.837772 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.837751    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-cpc58"]
Jul 15 13:15:24.837858 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.837789    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cjgpm"]
Jul 15 13:15:24.837919 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.837858    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-xj7ht"
Jul 15 13:15:24.840602 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.840582    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-8db99c4db-qzshk"]
Jul 15 13:15:24.841647 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.841629    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 15 13:15:24.841906 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.841891    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 15 13:15:24.841989 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.841902    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-8rpqf\""
Jul 15 13:15:24.854776 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.854755    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-xj7ht"]
Jul 15 13:15:24.884059 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.884035    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46f6ef45-16e7-486e-a44f-6284f36e2add-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-5vp9j\" (UID: \"46f6ef45-16e7-486e-a44f-6284f36e2add\") " pod="openshift-insights/insights-operator-68d9dd94cf-5vp9j"
Jul 15 13:15:24.884142 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.884064    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ssqf\" (UniqueName: \"kubernetes.io/projected/46f6ef45-16e7-486e-a44f-6284f36e2add-kube-api-access-2ssqf\") pod \"insights-operator-68d9dd94cf-5vp9j\" (UID: \"46f6ef45-16e7-486e-a44f-6284f36e2add\") " pod="openshift-insights/insights-operator-68d9dd94cf-5vp9j"
Jul 15 13:15:24.884142 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.884084    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/46f6ef45-16e7-486e-a44f-6284f36e2add-snapshots\") pod \"insights-operator-68d9dd94cf-5vp9j\" (UID: \"46f6ef45-16e7-486e-a44f-6284f36e2add\") " pod="openshift-insights/insights-operator-68d9dd94cf-5vp9j"
Jul 15 13:15:24.884142 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.884099    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46f6ef45-16e7-486e-a44f-6284f36e2add-tmp\") pod \"insights-operator-68d9dd94cf-5vp9j\" (UID: \"46f6ef45-16e7-486e-a44f-6284f36e2add\") " pod="openshift-insights/insights-operator-68d9dd94cf-5vp9j"
Jul 15 13:15:24.884298 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.884158    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46f6ef45-16e7-486e-a44f-6284f36e2add-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-5vp9j\" (UID: \"46f6ef45-16e7-486e-a44f-6284f36e2add\") " pod="openshift-insights/insights-operator-68d9dd94cf-5vp9j"
Jul 15 13:15:24.884298 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.884183    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/46f6ef45-16e7-486e-a44f-6284f36e2add-serving-cert\") pod \"insights-operator-68d9dd94cf-5vp9j\" (UID: \"46f6ef45-16e7-486e-a44f-6284f36e2add\") " pod="openshift-insights/insights-operator-68d9dd94cf-5vp9j"
Jul 15 13:15:24.892508 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.892487    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-jzfn9"]
Jul 15 13:15:24.894436 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.894422    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-t4bfh"]
Jul 15 13:15:24.894562 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.894547    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-jzfn9"
Jul 15 13:15:24.896240 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.896223    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zzpw4"]
Jul 15 13:15:24.896311 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.896299    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-t4bfh"
Jul 15 13:15:24.897228 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.897197    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-pvm6k\""
Jul 15 13:15:24.898272 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.898249    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zzpw4"
Jul 15 13:15:24.904933 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.904916    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 15 13:15:24.906013 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.905998    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 15 13:15:24.908904 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.908882    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 15 13:15:24.909001 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.908923    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-fshk4\""
Jul 15 13:15:24.909076 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.909029    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 15 13:15:24.909076 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.909040    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 15 13:15:24.909230 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.909211    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-df4dh\""
Jul 15 13:15:24.909295 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.909256    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 15 13:15:24.909295 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.909276    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 15 13:15:24.909542 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.909528    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 15 13:15:24.915625 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.915609    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 15 13:15:24.919500 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.919481    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zzpw4"]
Jul 15 13:15:24.920320 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.920303    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-t4bfh"]
Jul 15 13:15:24.921378 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.921358    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-jzfn9"]
Jul 15 13:15:24.985052 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.985024    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a1a43adb-5124-4e7d-99d1-7c7eef0d6908-serving-cert\") pod \"service-ca-operator-7695fc6c8c-zzpw4\" (UID: \"a1a43adb-5124-4e7d-99d1-7c7eef0d6908\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zzpw4"
Jul 15 13:15:24.985197 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.985062    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ssqf\" (UniqueName: \"kubernetes.io/projected/46f6ef45-16e7-486e-a44f-6284f36e2add-kube-api-access-2ssqf\") pod \"insights-operator-68d9dd94cf-5vp9j\" (UID: \"46f6ef45-16e7-486e-a44f-6284f36e2add\") " pod="openshift-insights/insights-operator-68d9dd94cf-5vp9j"
Jul 15 13:15:24.985197 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.985087    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46f6ef45-16e7-486e-a44f-6284f36e2add-tmp\") pod \"insights-operator-68d9dd94cf-5vp9j\" (UID: \"46f6ef45-16e7-486e-a44f-6284f36e2add\") " pod="openshift-insights/insights-operator-68d9dd94cf-5vp9j"
Jul 15 13:15:24.985197 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.985109    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0f8a6a75-cdcf-4264-8e27-6a0af529b5b2-default-certificate\") pod \"router-default-8db99c4db-qzshk\" (UID: \"0f8a6a75-cdcf-4264-8e27-6a0af529b5b2\") " pod="openshift-ingress/router-default-8db99c4db-qzshk"
Jul 15 13:15:24.985197 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.985134    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/56a94de7-8c93-43ae-a4b2-929d78711ac8-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-cjgpm\" (UID: \"56a94de7-8c93-43ae-a4b2-929d78711ac8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cjgpm"
Jul 15 13:15:24.985573 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.985244    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46f6ef45-16e7-486e-a44f-6284f36e2add-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-5vp9j\" (UID: \"46f6ef45-16e7-486e-a44f-6284f36e2add\") " pod="openshift-insights/insights-operator-68d9dd94cf-5vp9j"
Jul 15 13:15:24.985573 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.985271    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/46f6ef45-16e7-486e-a44f-6284f36e2add-serving-cert\") pod \"insights-operator-68d9dd94cf-5vp9j\" (UID: \"46f6ef45-16e7-486e-a44f-6284f36e2add\") " pod="openshift-insights/insights-operator-68d9dd94cf-5vp9j"
Jul 15 13:15:24.985573 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.985295    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk2dh\" (UniqueName: \"kubernetes.io/projected/0f8a6a75-cdcf-4264-8e27-6a0af529b5b2-kube-api-access-hk2dh\") pod \"router-default-8db99c4db-qzshk\" (UID: \"0f8a6a75-cdcf-4264-8e27-6a0af529b5b2\") " pod="openshift-ingress/router-default-8db99c4db-qzshk"
Jul 15 13:15:24.985573 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.985329    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c21b11d6-3242-4dd5-8b75-74dad14868e9-serving-cert\") pod \"console-operator-7866497494-t4bfh\" (UID: \"c21b11d6-3242-4dd5-8b75-74dad14868e9\") " pod="openshift-console-operator/console-operator-7866497494-t4bfh"
Jul 15 13:15:24.985573 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.985357    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9f41e77d-33d2-4d77-a15e-9d8e59a98d6b-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-cpc58\" (UID: \"9f41e77d-33d2-4d77-a15e-9d8e59a98d6b\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-cpc58"
Jul 15 13:15:24.985573 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.985385    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c21b11d6-3242-4dd5-8b75-74dad14868e9-config\") pod \"console-operator-7866497494-t4bfh\" (UID: \"c21b11d6-3242-4dd5-8b75-74dad14868e9\") " pod="openshift-console-operator/console-operator-7866497494-t4bfh"
Jul 15 13:15:24.985573 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.985400    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a1a43adb-5124-4e7d-99d1-7c7eef0d6908-config\") pod \"service-ca-operator-7695fc6c8c-zzpw4\" (UID: \"a1a43adb-5124-4e7d-99d1-7c7eef0d6908\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zzpw4"
Jul 15 13:15:24.985573 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.985421    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/56a94de7-8c93-43ae-a4b2-929d78711ac8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-cjgpm\" (UID: \"56a94de7-8c93-43ae-a4b2-929d78711ac8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cjgpm"
Jul 15 13:15:24.985573 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.985423    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46f6ef45-16e7-486e-a44f-6284f36e2add-tmp\") pod \"insights-operator-68d9dd94cf-5vp9j\" (UID: \"46f6ef45-16e7-486e-a44f-6284f36e2add\") " pod="openshift-insights/insights-operator-68d9dd94cf-5vp9j"
Jul 15 13:15:24.985573 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.985460    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46f6ef45-16e7-486e-a44f-6284f36e2add-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-5vp9j\" (UID: \"46f6ef45-16e7-486e-a44f-6284f36e2add\") " pod="openshift-insights/insights-operator-68d9dd94cf-5vp9j"
Jul 15 13:15:24.985573 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.985549    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/46f6ef45-16e7-486e-a44f-6284f36e2add-snapshots\") pod \"insights-operator-68d9dd94cf-5vp9j\" (UID: \"46f6ef45-16e7-486e-a44f-6284f36e2add\") " pod="openshift-insights/insights-operator-68d9dd94cf-5vp9j"
Jul 15 13:15:24.986047 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.985584    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c21b11d6-3242-4dd5-8b75-74dad14868e9-trusted-ca\") pod \"console-operator-7866497494-t4bfh\" (UID: \"c21b11d6-3242-4dd5-8b75-74dad14868e9\") " pod="openshift-console-operator/console-operator-7866497494-t4bfh"
Jul 15 13:15:24.986047 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.985615    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbps5\" (UniqueName: \"kubernetes.io/projected/ddd87030-16d4-4f45-ab5e-e1ddd7d01983-kube-api-access-qbps5\") pod \"volume-data-source-validator-78495597f6-xj7ht\" (UID: \"ddd87030-16d4-4f45-ab5e-e1ddd7d01983\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-xj7ht"
Jul 15 13:15:24.986047 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.985659    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xknpm\" (UniqueName: \"kubernetes.io/projected/56a94de7-8c93-43ae-a4b2-929d78711ac8-kube-api-access-xknpm\") pod \"cluster-monitoring-operator-5f7f494dd4-cjgpm\" (UID: \"56a94de7-8c93-43ae-a4b2-929d78711ac8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cjgpm"
Jul 15 13:15:24.986047 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.985702    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0f8a6a75-cdcf-4264-8e27-6a0af529b5b2-stats-auth\") pod \"router-default-8db99c4db-qzshk\" (UID: \"0f8a6a75-cdcf-4264-8e27-6a0af529b5b2\") " pod="openshift-ingress/router-default-8db99c4db-qzshk"
Jul 15 13:15:24.986047 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.985737    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f8a6a75-cdcf-4264-8e27-6a0af529b5b2-service-ca-bundle\") pod \"router-default-8db99c4db-qzshk\" (UID: \"0f8a6a75-cdcf-4264-8e27-6a0af529b5b2\") " pod="openshift-ingress/router-default-8db99c4db-qzshk"
Jul 15 13:15:24.986047 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.985761    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9f41e77d-33d2-4d77-a15e-9d8e59a98d6b-nginx-conf\") pod \"networking-console-plugin-6cf856758c-cpc58\" (UID: \"9f41e77d-33d2-4d77-a15e-9d8e59a98d6b\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-cpc58"
Jul 15 13:15:24.986047 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.985788    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f8a6a75-cdcf-4264-8e27-6a0af529b5b2-metrics-certs\") pod \"router-default-8db99c4db-qzshk\" (UID: \"0f8a6a75-cdcf-4264-8e27-6a0af529b5b2\") " pod="openshift-ingress/router-default-8db99c4db-qzshk"
Jul 15 13:15:24.986047 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.985794    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46f6ef45-16e7-486e-a44f-6284f36e2add-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-5vp9j\" (UID: \"46f6ef45-16e7-486e-a44f-6284f36e2add\") " pod="openshift-insights/insights-operator-68d9dd94cf-5vp9j"
Jul 15 13:15:24.986047 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.985811    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxzpv\" (UniqueName: \"kubernetes.io/projected/c21b11d6-3242-4dd5-8b75-74dad14868e9-kube-api-access-kxzpv\") pod \"console-operator-7866497494-t4bfh\" (UID: \"c21b11d6-3242-4dd5-8b75-74dad14868e9\") " pod="openshift-console-operator/console-operator-7866497494-t4bfh"
Jul 15 13:15:24.986047 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.985859    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwpz8\" (UniqueName: \"kubernetes.io/projected/fca7d4b6-dbc9-466f-a3ba-15539d508c10-kube-api-access-xwpz8\") pod \"network-check-source-869dcfcdcd-jzfn9\" (UID: \"fca7d4b6-dbc9-466f-a3ba-15539d508c10\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-jzfn9"
Jul 15 13:15:24.986047 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.985892    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9n5hd\" (UniqueName: \"kubernetes.io/projected/a1a43adb-5124-4e7d-99d1-7c7eef0d6908-kube-api-access-9n5hd\") pod \"service-ca-operator-7695fc6c8c-zzpw4\" (UID: \"a1a43adb-5124-4e7d-99d1-7c7eef0d6908\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zzpw4"
Jul 15 13:15:24.986437 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.986153    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/46f6ef45-16e7-486e-a44f-6284f36e2add-snapshots\") pod \"insights-operator-68d9dd94cf-5vp9j\" (UID: \"46f6ef45-16e7-486e-a44f-6284f36e2add\") " pod="openshift-insights/insights-operator-68d9dd94cf-5vp9j"
Jul 15 13:15:24.986437 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.986195    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46f6ef45-16e7-486e-a44f-6284f36e2add-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-5vp9j\" (UID: \"46f6ef45-16e7-486e-a44f-6284f36e2add\") " pod="openshift-insights/insights-operator-68d9dd94cf-5vp9j"
Jul 15 13:15:24.987581 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.987565    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/46f6ef45-16e7-486e-a44f-6284f36e2add-serving-cert\") pod \"insights-operator-68d9dd94cf-5vp9j\" (UID: \"46f6ef45-16e7-486e-a44f-6284f36e2add\") " pod="openshift-insights/insights-operator-68d9dd94cf-5vp9j"
Jul 15 13:15:24.996384 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:24.996367    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ssqf\" (UniqueName: \"kubernetes.io/projected/46f6ef45-16e7-486e-a44f-6284f36e2add-kube-api-access-2ssqf\") pod \"insights-operator-68d9dd94cf-5vp9j\" (UID: \"46f6ef45-16e7-486e-a44f-6284f36e2add\") " pod="openshift-insights/insights-operator-68d9dd94cf-5vp9j"
Jul 15 13:15:25.015329 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:25.015307    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-5vp9j"
Jul 15 13:15:25.086442 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:25.086411    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a1a43adb-5124-4e7d-99d1-7c7eef0d6908-config\") pod \"service-ca-operator-7695fc6c8c-zzpw4\" (UID: \"a1a43adb-5124-4e7d-99d1-7c7eef0d6908\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zzpw4"
Jul 15 13:15:25.086442 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:25.086442    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/56a94de7-8c93-43ae-a4b2-929d78711ac8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-cjgpm\" (UID: \"56a94de7-8c93-43ae-a4b2-929d78711ac8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cjgpm"
Jul 15 13:15:25.086763 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:25.086469    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c21b11d6-3242-4dd5-8b75-74dad14868e9-trusted-ca\") pod \"console-operator-7866497494-t4bfh\" (UID: \"c21b11d6-3242-4dd5-8b75-74dad14868e9\") " pod="openshift-console-operator/console-operator-7866497494-t4bfh"
Jul 15 13:15:25.086763 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:25.086486    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbps5\" (UniqueName: \"kubernetes.io/projected/ddd87030-16d4-4f45-ab5e-e1ddd7d01983-kube-api-access-qbps5\") pod \"volume-data-source-validator-78495597f6-xj7ht\" (UID: \"ddd87030-16d4-4f45-ab5e-e1ddd7d01983\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-xj7ht"
Jul 15 13:15:25.086763 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:25.086503    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xknpm\" (UniqueName: \"kubernetes.io/projected/56a94de7-8c93-43ae-a4b2-929d78711ac8-kube-api-access-xknpm\") pod \"cluster-monitoring-operator-5f7f494dd4-cjgpm\" (UID: \"56a94de7-8c93-43ae-a4b2-929d78711ac8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cjgpm"
Jul 15 13:15:25.086763 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:25.086521    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0f8a6a75-cdcf-4264-8e27-6a0af529b5b2-stats-auth\") pod \"router-default-8db99c4db-qzshk\" (UID: \"0f8a6a75-cdcf-4264-8e27-6a0af529b5b2\") " pod="openshift-ingress/router-default-8db99c4db-qzshk"
Jul 15 13:15:25.086763 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:25.086541    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f8a6a75-cdcf-4264-8e27-6a0af529b5b2-service-ca-bundle\") pod \"router-default-8db99c4db-qzshk\" (UID: \"0f8a6a75-cdcf-4264-8e27-6a0af529b5b2\") " pod="openshift-ingress/router-default-8db99c4db-qzshk"
Jul 15 13:15:25.086763 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:25.086556    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9f41e77d-33d2-4d77-a15e-9d8e59a98d6b-nginx-conf\") pod \"networking-console-plugin-6cf856758c-cpc58\" (UID: \"9f41e77d-33d2-4d77-a15e-9d8e59a98d6b\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-cpc58"
Jul 15 13:15:25.086763 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:25.086573    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f8a6a75-cdcf-4264-8e27-6a0af529b5b2-metrics-certs\") pod \"router-default-8db99c4db-qzshk\" (UID: \"0f8a6a75-cdcf-4264-8e27-6a0af529b5b2\") " pod="openshift-ingress/router-default-8db99c4db-qzshk"
Jul 15 13:15:25.086763 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:25.086586    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxzpv\" (UniqueName: \"kubernetes.io/projected/c21b11d6-3242-4dd5-8b75-74dad14868e9-kube-api-access-kxzpv\") pod \"console-operator-7866497494-t4bfh\" (UID: \"c21b11d6-3242-4dd5-8b75-74dad14868e9\") " pod="openshift-console-operator/console-operator-7866497494-t4bfh"
Jul 15 13:15:25.086763 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:25.086603    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwpz8\" (UniqueName: \"kubernetes.io/projected/fca7d4b6-dbc9-466f-a3ba-15539d508c10-kube-api-access-xwpz8\") pod \"network-check-source-869dcfcdcd-jzfn9\" (UID: \"fca7d4b6-dbc9-466f-a3ba-15539d508c10\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-jzfn9"
Jul 15 13:15:25.086763 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:25.086630    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9n5hd\" (UniqueName: \"kubernetes.io/projected/a1a43adb-5124-4e7d-99d1-7c7eef0d6908-kube-api-access-9n5hd\") pod \"service-ca-operator-7695fc6c8c-zzpw4\" (UID: \"a1a43adb-5124-4e7d-99d1-7c7eef0d6908\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zzpw4"
Jul 15 13:15:25.086763 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:25.086664    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a1a43adb-5124-4e7d-99d1-7c7eef0d6908-serving-cert\") pod \"service-ca-operator-7695fc6c8c-zzpw4\" (UID: \"a1a43adb-5124-4e7d-99d1-7c7eef0d6908\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zzpw4"
Jul 15 13:15:25.086763 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:25.086682    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0f8a6a75-cdcf-4264-8e27-6a0af529b5b2-default-certificate\") pod \"router-default-8db99c4db-qzshk\" (UID: \"0f8a6a75-cdcf-4264-8e27-6a0af529b5b2\") " pod="openshift-ingress/router-default-8db99c4db-qzshk"
Jul 15 13:15:25.086763 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:25.086701    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/56a94de7-8c93-43ae-a4b2-929d78711ac8-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-cjgpm\" (UID: \"56a94de7-8c93-43ae-a4b2-929d78711ac8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cjgpm"
Jul 15 13:15:25.086763 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:25.086734    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk2dh\" (UniqueName: \"kubernetes.io/projected/0f8a6a75-cdcf-4264-8e27-6a0af529b5b2-kube-api-access-hk2dh\") pod \"router-default-8db99c4db-qzshk\" (UID: \"0f8a6a75-cdcf-4264-8e27-6a0af529b5b2\") " pod="openshift-ingress/router-default-8db99c4db-qzshk"
Jul 15 13:15:25.086763 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:25.086760    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c21b11d6-3242-4dd5-8b75-74dad14868e9-serving-cert\") pod \"console-operator-7866497494-t4bfh\" (UID: \"c21b11d6-3242-4dd5-8b75-74dad14868e9\") " pod="openshift-console-operator/console-operator-7866497494-t4bfh"
Jul 15 13:15:25.087519 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:25.086776    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9f41e77d-33d2-4d77-a15e-9d8e59a98d6b-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-cpc58\" (UID: \"9f41e77d-33d2-4d77-a15e-9d8e59a98d6b\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-cpc58"
Jul 15 13:15:25.087519 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:25.086793    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c21b11d6-3242-4dd5-8b75-74dad14868e9-config\") pod \"console-operator-7866497494-t4bfh\" (UID: \"c21b11d6-3242-4dd5-8b75-74dad14868e9\") " pod="openshift-console-operator/console-operator-7866497494-t4bfh"
Jul 15 13:15:25.087519 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:25.086945    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a1a43adb-5124-4e7d-99d1-7c7eef0d6908-config\") pod \"service-ca-operator-7695fc6c8c-zzpw4\" (UID: \"a1a43adb-5124-4e7d-99d1-7c7eef0d6908\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zzpw4"
Jul 15 13:15:25.087519 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:25.087282    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 13:15:25.087519 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:25.087292    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c21b11d6-3242-4dd5-8b75-74dad14868e9-config\") pod \"console-operator-7866497494-t4bfh\" (UID: \"c21b11d6-3242-4dd5-8b75-74dad14868e9\") " pod="openshift-console-operator/console-operator-7866497494-t4bfh"
Jul 15 13:15:25.087519 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:25.087332    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56a94de7-8c93-43ae-a4b2-929d78711ac8-cluster-monitoring-operator-tls podName:56a94de7-8c93-43ae-a4b2-929d78711ac8 nodeName:}" failed. No retries permitted until 2026-07-15 13:15:25.587319246 +0000 UTC m=+245.675106166 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/56a94de7-8c93-43ae-a4b2-929d78711ac8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-cjgpm" (UID: "56a94de7-8c93-43ae-a4b2-929d78711ac8") : secret "cluster-monitoring-operator-tls" not found
Jul 15 13:15:25.087824 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:25.087769    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0f8a6a75-cdcf-4264-8e27-6a0af529b5b2-service-ca-bundle podName:0f8a6a75-cdcf-4264-8e27-6a0af529b5b2 nodeName:}" failed. No retries permitted until 2026-07-15 13:15:25.587752764 +0000 UTC m=+245.675539699 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0f8a6a75-cdcf-4264-8e27-6a0af529b5b2-service-ca-bundle") pod "router-default-8db99c4db-qzshk" (UID: "0f8a6a75-cdcf-4264-8e27-6a0af529b5b2") : configmap references non-existent config key: service-ca.crt
Jul 15 13:15:25.087976 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:25.087950    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 13:15:25.088116 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:25.088012    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f8a6a75-cdcf-4264-8e27-6a0af529b5b2-metrics-certs podName:0f8a6a75-cdcf-4264-8e27-6a0af529b5b2 nodeName:}" failed. No retries permitted until 2026-07-15 13:15:25.587995537 +0000 UTC m=+245.675782473 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f8a6a75-cdcf-4264-8e27-6a0af529b5b2-metrics-certs") pod "router-default-8db99c4db-qzshk" (UID: "0f8a6a75-cdcf-4264-8e27-6a0af529b5b2") : secret "router-metrics-certs-default" not found
Jul 15 13:15:25.088193 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:25.088180    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 15 13:15:25.088279 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:25.088249    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f41e77d-33d2-4d77-a15e-9d8e59a98d6b-networking-console-plugin-cert podName:9f41e77d-33d2-4d77-a15e-9d8e59a98d6b nodeName:}" failed. No retries permitted until 2026-07-15 13:15:25.588234496 +0000 UTC m=+245.676021415 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9f41e77d-33d2-4d77-a15e-9d8e59a98d6b-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-cpc58" (UID: "9f41e77d-33d2-4d77-a15e-9d8e59a98d6b") : secret "networking-console-plugin-cert" not found
Jul 15 13:15:25.089600 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:25.088469    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c21b11d6-3242-4dd5-8b75-74dad14868e9-trusted-ca\") pod \"console-operator-7866497494-t4bfh\" (UID: \"c21b11d6-3242-4dd5-8b75-74dad14868e9\") " pod="openshift-console-operator/console-operator-7866497494-t4bfh"
Jul 15 13:15:25.089600 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:25.088704    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9f41e77d-33d2-4d77-a15e-9d8e59a98d6b-nginx-conf\") pod \"networking-console-plugin-6cf856758c-cpc58\" (UID: \"9f41e77d-33d2-4d77-a15e-9d8e59a98d6b\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-cpc58"
Jul 15 13:15:25.089600 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:25.088888    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/56a94de7-8c93-43ae-a4b2-929d78711ac8-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-cjgpm\" (UID: \"56a94de7-8c93-43ae-a4b2-929d78711ac8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cjgpm"
Jul 15 13:15:25.091143 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:25.090559    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a1a43adb-5124-4e7d-99d1-7c7eef0d6908-serving-cert\") pod \"service-ca-operator-7695fc6c8c-zzpw4\" (UID: \"a1a43adb-5124-4e7d-99d1-7c7eef0d6908\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zzpw4"
Jul 15 13:15:25.091302 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:25.091152    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0f8a6a75-cdcf-4264-8e27-6a0af529b5b2-default-certificate\") pod \"router-default-8db99c4db-qzshk\" (UID: \"0f8a6a75-cdcf-4264-8e27-6a0af529b5b2\") " pod="openshift-ingress/router-default-8db99c4db-qzshk"
Jul 15 13:15:25.091302 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:25.091283    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c21b11d6-3242-4dd5-8b75-74dad14868e9-serving-cert\") pod \"console-operator-7866497494-t4bfh\" (UID: \"c21b11d6-3242-4dd5-8b75-74dad14868e9\") " pod="openshift-console-operator/console-operator-7866497494-t4bfh"
Jul 15 13:15:25.091411 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:25.091377    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0f8a6a75-cdcf-4264-8e27-6a0af529b5b2-stats-auth\") pod \"router-default-8db99c4db-qzshk\" (UID: \"0f8a6a75-cdcf-4264-8e27-6a0af529b5b2\") " pod="openshift-ingress/router-default-8db99c4db-qzshk"
Jul 15 13:15:25.100267 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:25.100238    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxzpv\" (UniqueName: \"kubernetes.io/projected/c21b11d6-3242-4dd5-8b75-74dad14868e9-kube-api-access-kxzpv\") pod \"console-operator-7866497494-t4bfh\" (UID: \"c21b11d6-3242-4dd5-8b75-74dad14868e9\") " pod="openshift-console-operator/console-operator-7866497494-t4bfh"
Jul 15 13:15:25.100691 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:25.100670    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbps5\" (UniqueName: \"kubernetes.io/projected/ddd87030-16d4-4f45-ab5e-e1ddd7d01983-kube-api-access-qbps5\") pod \"volume-data-source-validator-78495597f6-xj7ht\" (UID: \"ddd87030-16d4-4f45-ab5e-e1ddd7d01983\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-xj7ht"
Jul 15 13:15:25.102351 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:25.102327    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwpz8\" (UniqueName: \"kubernetes.io/projected/fca7d4b6-dbc9-466f-a3ba-15539d508c10-kube-api-access-xwpz8\") pod \"network-check-source-869dcfcdcd-jzfn9\" (UID: \"fca7d4b6-dbc9-466f-a3ba-15539d508c10\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-jzfn9"
Jul 15 13:15:25.108001 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:25.107937    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9n5hd\" (UniqueName: \"kubernetes.io/projected/a1a43adb-5124-4e7d-99d1-7c7eef0d6908-kube-api-access-9n5hd\") pod \"service-ca-operator-7695fc6c8c-zzpw4\" (UID: \"a1a43adb-5124-4e7d-99d1-7c7eef0d6908\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zzpw4"
Jul 15 13:15:25.108893 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:25.108844    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xknpm\" (UniqueName: \"kubernetes.io/projected/56a94de7-8c93-43ae-a4b2-929d78711ac8-kube-api-access-xknpm\") pod \"cluster-monitoring-operator-5f7f494dd4-cjgpm\" (UID: \"56a94de7-8c93-43ae-a4b2-929d78711ac8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cjgpm"
Jul 15 13:15:25.111596 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:25.111576    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk2dh\" (UniqueName: \"kubernetes.io/projected/0f8a6a75-cdcf-4264-8e27-6a0af529b5b2-kube-api-access-hk2dh\") pod \"router-default-8db99c4db-qzshk\" (UID: \"0f8a6a75-cdcf-4264-8e27-6a0af529b5b2\") " pod="openshift-ingress/router-default-8db99c4db-qzshk"
Jul 15 13:15:25.144251 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:25.144230    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-5vp9j"]
Jul 15 13:15:25.146549 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:15:25.146528    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46f6ef45_16e7_486e_a44f_6284f36e2add.slice/crio-07424571a10aa43f87a7dd43c24ed4a35fb37e1a5297b728a2d06f91c0303838 WatchSource:0}: Error finding container 07424571a10aa43f87a7dd43c24ed4a35fb37e1a5297b728a2d06f91c0303838: Status 404 returned error can't find the container with id 07424571a10aa43f87a7dd43c24ed4a35fb37e1a5297b728a2d06f91c0303838
Jul 15 13:15:25.149745 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:25.149728    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-xj7ht"
Jul 15 13:15:25.204035 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:25.203927    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-jzfn9"
Jul 15 13:15:25.208856 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:25.208836    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-t4bfh"
Jul 15 13:15:25.214612 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:25.214580    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zzpw4"
Jul 15 13:15:25.289543 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:25.289509    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-xj7ht"]
Jul 15 13:15:25.293614 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:15:25.293588    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddd87030_16d4_4f45_ab5e_e1ddd7d01983.slice/crio-a85af666b7732f64efd640628c5f4c27037ecd1a8312f6d72cfbad56a420a022 WatchSource:0}: Error finding container a85af666b7732f64efd640628c5f4c27037ecd1a8312f6d72cfbad56a420a022: Status 404 returned error can't find the container with id a85af666b7732f64efd640628c5f4c27037ecd1a8312f6d72cfbad56a420a022
Jul 15 13:15:25.347122 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:25.347038    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-jzfn9"]
Jul 15 13:15:25.349527 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:15:25.349504    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfca7d4b6_dbc9_466f_a3ba_15539d508c10.slice/crio-da8bacb773c19c1761a60ddc0301a4c961e02698f90ebd01226eff8245a003ff WatchSource:0}: Error finding container da8bacb773c19c1761a60ddc0301a4c961e02698f90ebd01226eff8245a003ff: Status 404 returned error can't find the container with id da8bacb773c19c1761a60ddc0301a4c961e02698f90ebd01226eff8245a003ff
Jul 15 13:15:25.568814 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:25.568779    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-t4bfh"]
Jul 15 13:15:25.569675 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:25.569655    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zzpw4"]
Jul 15 13:15:25.573453 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:15:25.571533    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1a43adb_5124_4e7d_99d1_7c7eef0d6908.slice/crio-acc819a69d9462998fd0ad640a194996699d8321f254abe7f00e502fcf3f4566 WatchSource:0}: Error finding container acc819a69d9462998fd0ad640a194996699d8321f254abe7f00e502fcf3f4566: Status 404 returned error can't find the container with id acc819a69d9462998fd0ad640a194996699d8321f254abe7f00e502fcf3f4566
Jul 15 13:15:25.591243 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:25.591192    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f8a6a75-cdcf-4264-8e27-6a0af529b5b2-service-ca-bundle\") pod \"router-default-8db99c4db-qzshk\" (UID: \"0f8a6a75-cdcf-4264-8e27-6a0af529b5b2\") " pod="openshift-ingress/router-default-8db99c4db-qzshk"
Jul 15 13:15:25.591353 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:25.591259    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f8a6a75-cdcf-4264-8e27-6a0af529b5b2-metrics-certs\") pod \"router-default-8db99c4db-qzshk\" (UID: \"0f8a6a75-cdcf-4264-8e27-6a0af529b5b2\") " pod="openshift-ingress/router-default-8db99c4db-qzshk"
Jul 15 13:15:25.591392 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:25.591360    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0f8a6a75-cdcf-4264-8e27-6a0af529b5b2-service-ca-bundle podName:0f8a6a75-cdcf-4264-8e27-6a0af529b5b2 nodeName:}" failed. No retries permitted until 2026-07-15 13:15:26.591336378 +0000 UTC m=+246.679123300 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0f8a6a75-cdcf-4264-8e27-6a0af529b5b2-service-ca-bundle") pod "router-default-8db99c4db-qzshk" (UID: "0f8a6a75-cdcf-4264-8e27-6a0af529b5b2") : configmap references non-existent config key: service-ca.crt
Jul 15 13:15:25.591442 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:25.591410    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 13:15:25.591483 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:25.591466    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f8a6a75-cdcf-4264-8e27-6a0af529b5b2-metrics-certs podName:0f8a6a75-cdcf-4264-8e27-6a0af529b5b2 nodeName:}" failed. No retries permitted until 2026-07-15 13:15:26.591448003 +0000 UTC m=+246.679234930 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f8a6a75-cdcf-4264-8e27-6a0af529b5b2-metrics-certs") pod "router-default-8db99c4db-qzshk" (UID: "0f8a6a75-cdcf-4264-8e27-6a0af529b5b2") : secret "router-metrics-certs-default" not found
Jul 15 13:15:25.591483 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:25.591477    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 15 13:15:25.591563 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:25.591514    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f41e77d-33d2-4d77-a15e-9d8e59a98d6b-networking-console-plugin-cert podName:9f41e77d-33d2-4d77-a15e-9d8e59a98d6b nodeName:}" failed. No retries permitted until 2026-07-15 13:15:26.591504866 +0000 UTC m=+246.679291785 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9f41e77d-33d2-4d77-a15e-9d8e59a98d6b-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-cpc58" (UID: "9f41e77d-33d2-4d77-a15e-9d8e59a98d6b") : secret "networking-console-plugin-cert" not found
Jul 15 13:15:25.591563 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:25.591408    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9f41e77d-33d2-4d77-a15e-9d8e59a98d6b-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-cpc58\" (UID: \"9f41e77d-33d2-4d77-a15e-9d8e59a98d6b\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-cpc58"
Jul 15 13:15:25.591563 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:25.591544    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/56a94de7-8c93-43ae-a4b2-929d78711ac8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-cjgpm\" (UID: \"56a94de7-8c93-43ae-a4b2-929d78711ac8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cjgpm"
Jul 15 13:15:25.591662 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:25.591654    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 13:15:25.591691 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:25.591684    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56a94de7-8c93-43ae-a4b2-929d78711ac8-cluster-monitoring-operator-tls podName:56a94de7-8c93-43ae-a4b2-929d78711ac8 nodeName:}" failed. No retries permitted until 2026-07-15 13:15:26.591676968 +0000 UTC m=+246.679463888 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/56a94de7-8c93-43ae-a4b2-929d78711ac8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-cjgpm" (UID: "56a94de7-8c93-43ae-a4b2-929d78711ac8") : secret "cluster-monitoring-operator-tls" not found
Jul 15 13:15:26.035832 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:26.035795    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-jzfn9" event={"ID":"fca7d4b6-dbc9-466f-a3ba-15539d508c10","Type":"ContainerStarted","Data":"ac0d27e37d95fa4e8d953297bf2741eccfa576926b13a5996b26216c6e2f1ad3"}
Jul 15 13:15:26.036273 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:26.035854    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-jzfn9" event={"ID":"fca7d4b6-dbc9-466f-a3ba-15539d508c10","Type":"ContainerStarted","Data":"da8bacb773c19c1761a60ddc0301a4c961e02698f90ebd01226eff8245a003ff"}
Jul 15 13:15:26.036835 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:26.036813    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-xj7ht" event={"ID":"ddd87030-16d4-4f45-ab5e-e1ddd7d01983","Type":"ContainerStarted","Data":"a85af666b7732f64efd640628c5f4c27037ecd1a8312f6d72cfbad56a420a022"}
Jul 15 13:15:26.037819 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:26.037794    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-5vp9j" event={"ID":"46f6ef45-16e7-486e-a44f-6284f36e2add","Type":"ContainerStarted","Data":"07424571a10aa43f87a7dd43c24ed4a35fb37e1a5297b728a2d06f91c0303838"}
Jul 15 13:15:26.038767 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:26.038746    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zzpw4" event={"ID":"a1a43adb-5124-4e7d-99d1-7c7eef0d6908","Type":"ContainerStarted","Data":"acc819a69d9462998fd0ad640a194996699d8321f254abe7f00e502fcf3f4566"}
Jul 15 13:15:26.039735 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:26.039713    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-t4bfh" event={"ID":"c21b11d6-3242-4dd5-8b75-74dad14868e9","Type":"ContainerStarted","Data":"e78a2970ecfcef3ee357481806f02c973e494a54967e2b72f719c40f227cd69c"}
Jul 15 13:15:26.054641 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:26.054595    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-jzfn9" podStartSLOduration=2.054577652 podStartE2EDuration="2.054577652s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:15:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:15:26.053972553 +0000 UTC m=+246.141759497" watchObservedRunningTime="2026-07-15 13:15:26.054577652 +0000 UTC m=+246.142364577"
Jul 15 13:15:26.598895 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:26.598410    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9f41e77d-33d2-4d77-a15e-9d8e59a98d6b-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-cpc58\" (UID: \"9f41e77d-33d2-4d77-a15e-9d8e59a98d6b\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-cpc58"
Jul 15 13:15:26.598895 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:26.598468    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/56a94de7-8c93-43ae-a4b2-929d78711ac8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-cjgpm\" (UID: \"56a94de7-8c93-43ae-a4b2-929d78711ac8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cjgpm"
Jul 15 13:15:26.598895 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:26.598533    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f8a6a75-cdcf-4264-8e27-6a0af529b5b2-service-ca-bundle\") pod \"router-default-8db99c4db-qzshk\" (UID: \"0f8a6a75-cdcf-4264-8e27-6a0af529b5b2\") " pod="openshift-ingress/router-default-8db99c4db-qzshk"
Jul 15 13:15:26.598895 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:26.598562    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f8a6a75-cdcf-4264-8e27-6a0af529b5b2-metrics-certs\") pod \"router-default-8db99c4db-qzshk\" (UID: \"0f8a6a75-cdcf-4264-8e27-6a0af529b5b2\") " pod="openshift-ingress/router-default-8db99c4db-qzshk"
Jul 15 13:15:26.598895 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:26.598585    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 15 13:15:26.598895 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:26.598648    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f41e77d-33d2-4d77-a15e-9d8e59a98d6b-networking-console-plugin-cert podName:9f41e77d-33d2-4d77-a15e-9d8e59a98d6b nodeName:}" failed. No retries permitted until 2026-07-15 13:15:28.598629287 +0000 UTC m=+248.686416210 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9f41e77d-33d2-4d77-a15e-9d8e59a98d6b-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-cpc58" (UID: "9f41e77d-33d2-4d77-a15e-9d8e59a98d6b") : secret "networking-console-plugin-cert" not found
Jul 15 13:15:26.598895 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:26.598682    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 13:15:26.598895 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:26.598717    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f8a6a75-cdcf-4264-8e27-6a0af529b5b2-metrics-certs podName:0f8a6a75-cdcf-4264-8e27-6a0af529b5b2 nodeName:}" failed. No retries permitted until 2026-07-15 13:15:28.598706521 +0000 UTC m=+248.686493447 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f8a6a75-cdcf-4264-8e27-6a0af529b5b2-metrics-certs") pod "router-default-8db99c4db-qzshk" (UID: "0f8a6a75-cdcf-4264-8e27-6a0af529b5b2") : secret "router-metrics-certs-default" not found
Jul 15 13:15:26.598895 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:26.598765    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 13:15:26.598895 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:26.598802    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56a94de7-8c93-43ae-a4b2-929d78711ac8-cluster-monitoring-operator-tls podName:56a94de7-8c93-43ae-a4b2-929d78711ac8 nodeName:}" failed. No retries permitted until 2026-07-15 13:15:28.598783637 +0000 UTC m=+248.686570562 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/56a94de7-8c93-43ae-a4b2-929d78711ac8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-cjgpm" (UID: "56a94de7-8c93-43ae-a4b2-929d78711ac8") : secret "cluster-monitoring-operator-tls" not found
Jul 15 13:15:26.598895 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:26.598868    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0f8a6a75-cdcf-4264-8e27-6a0af529b5b2-service-ca-bundle podName:0f8a6a75-cdcf-4264-8e27-6a0af529b5b2 nodeName:}" failed. No retries permitted until 2026-07-15 13:15:28.59885854 +0000 UTC m=+248.686645461 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0f8a6a75-cdcf-4264-8e27-6a0af529b5b2-service-ca-bundle") pod "router-default-8db99c4db-qzshk" (UID: "0f8a6a75-cdcf-4264-8e27-6a0af529b5b2") : configmap references non-existent config key: service-ca.crt
Jul 15 13:15:27.048028 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:27.047696    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-xj7ht" event={"ID":"ddd87030-16d4-4f45-ab5e-e1ddd7d01983","Type":"ContainerStarted","Data":"7ae9efa8f7361f38a6d51878050dfaf7f731cb9279f682b038829bd06a955701"}
Jul 15 13:15:27.066747 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:27.066692    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-xj7ht" podStartSLOduration=1.946162294 podStartE2EDuration="3.066672744s" totalImagesPullingTime="1.12051045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:15:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:15:27.065173126 +0000 UTC m=+247.152960072" watchObservedRunningTime="2026-07-15 13:15:27.066672744 +0000 UTC m=+247.154459687"
Jul 15 13:15:28.623838 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:28.623802    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f8a6a75-cdcf-4264-8e27-6a0af529b5b2-service-ca-bundle\") pod \"router-default-8db99c4db-qzshk\" (UID: \"0f8a6a75-cdcf-4264-8e27-6a0af529b5b2\") " pod="openshift-ingress/router-default-8db99c4db-qzshk"
Jul 15 13:15:28.623838 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:28.623846    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f8a6a75-cdcf-4264-8e27-6a0af529b5b2-metrics-certs\") pod \"router-default-8db99c4db-qzshk\" (UID: \"0f8a6a75-cdcf-4264-8e27-6a0af529b5b2\") " pod="openshift-ingress/router-default-8db99c4db-qzshk"
Jul 15 13:15:28.624373 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:28.623913    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9f41e77d-33d2-4d77-a15e-9d8e59a98d6b-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-cpc58\" (UID: \"9f41e77d-33d2-4d77-a15e-9d8e59a98d6b\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-cpc58"
Jul 15 13:15:28.624373 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:28.623942    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/56a94de7-8c93-43ae-a4b2-929d78711ac8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-cjgpm\" (UID: \"56a94de7-8c93-43ae-a4b2-929d78711ac8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cjgpm"
Jul 15 13:15:28.624373 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:28.624000    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0f8a6a75-cdcf-4264-8e27-6a0af529b5b2-service-ca-bundle podName:0f8a6a75-cdcf-4264-8e27-6a0af529b5b2 nodeName:}" failed. No retries permitted until 2026-07-15 13:15:32.623977351 +0000 UTC m=+252.711764273 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0f8a6a75-cdcf-4264-8e27-6a0af529b5b2-service-ca-bundle") pod "router-default-8db99c4db-qzshk" (UID: "0f8a6a75-cdcf-4264-8e27-6a0af529b5b2") : configmap references non-existent config key: service-ca.crt
Jul 15 13:15:28.624373 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:28.624058    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 13:15:28.624373 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:28.624067    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 13:15:28.624373 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:28.624121    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f8a6a75-cdcf-4264-8e27-6a0af529b5b2-metrics-certs podName:0f8a6a75-cdcf-4264-8e27-6a0af529b5b2 nodeName:}" failed. No retries permitted until 2026-07-15 13:15:32.624104498 +0000 UTC m=+252.711891435 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f8a6a75-cdcf-4264-8e27-6a0af529b5b2-metrics-certs") pod "router-default-8db99c4db-qzshk" (UID: "0f8a6a75-cdcf-4264-8e27-6a0af529b5b2") : secret "router-metrics-certs-default" not found
Jul 15 13:15:28.624373 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:28.624170    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 15 13:15:28.624373 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:28.624197    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56a94de7-8c93-43ae-a4b2-929d78711ac8-cluster-monitoring-operator-tls podName:56a94de7-8c93-43ae-a4b2-929d78711ac8 nodeName:}" failed. No retries permitted until 2026-07-15 13:15:32.624170587 +0000 UTC m=+252.711957521 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/56a94de7-8c93-43ae-a4b2-929d78711ac8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-cjgpm" (UID: "56a94de7-8c93-43ae-a4b2-929d78711ac8") : secret "cluster-monitoring-operator-tls" not found
Jul 15 13:15:28.624373 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:28.624234    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f41e77d-33d2-4d77-a15e-9d8e59a98d6b-networking-console-plugin-cert podName:9f41e77d-33d2-4d77-a15e-9d8e59a98d6b nodeName:}" failed. No retries permitted until 2026-07-15 13:15:32.624219026 +0000 UTC m=+252.712005959 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9f41e77d-33d2-4d77-a15e-9d8e59a98d6b-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-cpc58" (UID: "9f41e77d-33d2-4d77-a15e-9d8e59a98d6b") : secret "networking-console-plugin-cert" not found
Jul 15 13:15:29.057122 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:29.057081    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-t4bfh" event={"ID":"c21b11d6-3242-4dd5-8b75-74dad14868e9","Type":"ContainerStarted","Data":"77cb14adca36d41673ea7ee760a0b0ab6c379b42692c3de5de060f2efdaf7cf2"}
Jul 15 13:15:29.061053 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:29.061022    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-5vp9j" event={"ID":"46f6ef45-16e7-486e-a44f-6284f36e2add","Type":"ContainerStarted","Data":"fcaca25cd5e8dab2cec7d50996b91ee3be06c1ab11af97035ef8bab46d87ad01"}
Jul 15 13:15:29.061429 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:29.059485    2578 patch_prober.go:28] interesting pod/console-operator-7866497494-t4bfh container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.15:8443/readyz\": dial tcp 10.132.0.15:8443: connect: connection refused" start-of-body=
Jul 15 13:15:29.061572 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:29.061505    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-7866497494-t4bfh" podUID="c21b11d6-3242-4dd5-8b75-74dad14868e9" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.15:8443/readyz\": dial tcp 10.132.0.15:8443: connect: connection refused"
Jul 15 13:15:29.062137 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:29.062105    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zzpw4" event={"ID":"a1a43adb-5124-4e7d-99d1-7c7eef0d6908","Type":"ContainerStarted","Data":"4b37356dd250ab9dde96994b770f87f7074191a633aea43efb137c53779f8e56"}
Jul 15 13:15:29.062252 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:29.062167    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-t4bfh"
Jul 15 13:15:29.079092 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:29.079025    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-t4bfh" podStartSLOduration=1.705783504 podStartE2EDuration="5.079006838s" totalImagesPullingTime="3.373223334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:15:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:15:29.078238367 +0000 UTC m=+249.166025335" watchObservedRunningTime="2026-07-15 13:15:29.079006838 +0000 UTC m=+249.166793781"
Jul 15 13:15:29.096031 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:29.095983    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-5vp9j" podStartSLOduration=1.290682779 podStartE2EDuration="5.095963463s" totalImagesPullingTime="3.805280684s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:15:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:15:29.095837623 +0000 UTC m=+249.183624565" watchObservedRunningTime="2026-07-15 13:15:29.095963463 +0000 UTC m=+249.183750406"
Jul 15 13:15:29.114906 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:29.114592    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zzpw4" podStartSLOduration=1.7377389349999999 podStartE2EDuration="5.114577605s" totalImagesPullingTime="3.37683867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:15:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:15:29.114444882 +0000 UTC m=+249.202231824" watchObservedRunningTime="2026-07-15 13:15:29.114577605 +0000 UTC m=+249.202364547"
Jul 15 13:15:30.066550 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:30.066521    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-t4bfh_c21b11d6-3242-4dd5-8b75-74dad14868e9/console-operator/0.log"
Jul 15 13:15:30.066995 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:30.066558    2578 generic.go:356] "Generic (PLEG): container finished" podID="c21b11d6-3242-4dd5-8b75-74dad14868e9" containerID="77cb14adca36d41673ea7ee760a0b0ab6c379b42692c3de5de060f2efdaf7cf2" exitCode=255
Jul 15 13:15:30.066995 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:30.066595    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-t4bfh" event={"ID":"c21b11d6-3242-4dd5-8b75-74dad14868e9","Type":"ContainerDied","Data":"77cb14adca36d41673ea7ee760a0b0ab6c379b42692c3de5de060f2efdaf7cf2"}
Jul 15 13:15:30.067099 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:30.067000    2578 scope.go:117] "RemoveContainer" containerID="77cb14adca36d41673ea7ee760a0b0ab6c379b42692c3de5de060f2efdaf7cf2"
Jul 15 13:15:30.745380 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:30.745344    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-7q4kb"]
Jul 15 13:15:30.747503 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:30.747483    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7q4kb"
Jul 15 13:15:30.750543 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:30.750518    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 15 13:15:30.750660 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:30.750601    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 15 13:15:30.750660 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:30.750632    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-k8phr\""
Jul 15 13:15:30.771269 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:30.771243    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7q4kb"]
Jul 15 13:15:30.844408 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:30.844377    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810-crio-socket\") pod \"insights-runtime-extractor-7q4kb\" (UID: \"e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810\") " pod="openshift-insights/insights-runtime-extractor-7q4kb"
Jul 15 13:15:30.844408 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:30.844405    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7q4kb\" (UID: \"e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810\") " pod="openshift-insights/insights-runtime-extractor-7q4kb"
Jul 15 13:15:30.844566 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:30.844444    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810-data-volume\") pod \"insights-runtime-extractor-7q4kb\" (UID: \"e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810\") " pod="openshift-insights/insights-runtime-extractor-7q4kb"
Jul 15 13:15:30.844566 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:30.844521    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-755zs\" (UniqueName: \"kubernetes.io/projected/e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810-kube-api-access-755zs\") pod \"insights-runtime-extractor-7q4kb\" (UID: \"e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810\") " pod="openshift-insights/insights-runtime-extractor-7q4kb"
Jul 15 13:15:30.844632 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:30.844564    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7q4kb\" (UID: \"e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810\") " pod="openshift-insights/insights-runtime-extractor-7q4kb"
Jul 15 13:15:30.945578 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:30.945546    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810-data-volume\") pod \"insights-runtime-extractor-7q4kb\" (UID: \"e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810\") " pod="openshift-insights/insights-runtime-extractor-7q4kb"
Jul 15 13:15:30.945700 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:30.945605    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-755zs\" (UniqueName: \"kubernetes.io/projected/e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810-kube-api-access-755zs\") pod \"insights-runtime-extractor-7q4kb\" (UID: \"e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810\") " pod="openshift-insights/insights-runtime-extractor-7q4kb"
Jul 15 13:15:30.945700 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:30.945639    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7q4kb\" (UID: \"e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810\") " pod="openshift-insights/insights-runtime-extractor-7q4kb"
Jul 15 13:15:30.945700 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:30.945679    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810-crio-socket\") pod \"insights-runtime-extractor-7q4kb\" (UID: \"e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810\") " pod="openshift-insights/insights-runtime-extractor-7q4kb"
Jul 15 13:15:30.945700 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:30.945695    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7q4kb\" (UID: \"e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810\") " pod="openshift-insights/insights-runtime-extractor-7q4kb"
Jul 15 13:15:30.945905 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:30.945770    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 13:15:30.945905 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:30.945782    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810-crio-socket\") pod \"insights-runtime-extractor-7q4kb\" (UID: \"e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810\") " pod="openshift-insights/insights-runtime-extractor-7q4kb"
Jul 15 13:15:30.945905 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:30.945798    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 13:15:30.945905 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:30.945856    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810-kube-rbac-proxy-cm podName:e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810 nodeName:}" failed. No retries permitted until 2026-07-15 13:15:31.445834551 +0000 UTC m=+251.533621474 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7q4kb" (UID: "e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810") : configmap "kube-rbac-proxy" not found
Jul 15 13:15:30.945905 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:30.945876    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810-insights-runtime-extractor-tls podName:e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810 nodeName:}" failed. No retries permitted until 2026-07-15 13:15:31.44586599 +0000 UTC m=+251.533652914 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7q4kb" (UID: "e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810") : secret "insights-runtime-extractor-tls" not found
Jul 15 13:15:30.946132 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:30.945918    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810-data-volume\") pod \"insights-runtime-extractor-7q4kb\" (UID: \"e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810\") " pod="openshift-insights/insights-runtime-extractor-7q4kb"
Jul 15 13:15:30.958380 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:30.958352    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-755zs\" (UniqueName: \"kubernetes.io/projected/e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810-kube-api-access-755zs\") pod \"insights-runtime-extractor-7q4kb\" (UID: \"e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810\") " pod="openshift-insights/insights-runtime-extractor-7q4kb"
Jul 15 13:15:31.070799 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:31.070733    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-t4bfh_c21b11d6-3242-4dd5-8b75-74dad14868e9/console-operator/1.log"
Jul 15 13:15:31.071171 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:31.071157    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-t4bfh_c21b11d6-3242-4dd5-8b75-74dad14868e9/console-operator/0.log"
Jul 15 13:15:31.071236 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:31.071189    2578 generic.go:356] "Generic (PLEG): container finished" podID="c21b11d6-3242-4dd5-8b75-74dad14868e9" containerID="628b291e69c5cdc70e5572adc43f73fc99e617670ab202396fffe32517de977c" exitCode=255
Jul 15 13:15:31.071278 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:31.071259    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-t4bfh" event={"ID":"c21b11d6-3242-4dd5-8b75-74dad14868e9","Type":"ContainerDied","Data":"628b291e69c5cdc70e5572adc43f73fc99e617670ab202396fffe32517de977c"}
Jul 15 13:15:31.071313 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:31.071307    2578 scope.go:117] "RemoveContainer" containerID="77cb14adca36d41673ea7ee760a0b0ab6c379b42692c3de5de060f2efdaf7cf2"
Jul 15 13:15:31.071461 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:31.071442    2578 scope.go:117] "RemoveContainer" containerID="628b291e69c5cdc70e5572adc43f73fc99e617670ab202396fffe32517de977c"
Jul 15 13:15:31.071643 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:31.071620    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-t4bfh_openshift-console-operator(c21b11d6-3242-4dd5-8b75-74dad14868e9)\"" pod="openshift-console-operator/console-operator-7866497494-t4bfh" podUID="c21b11d6-3242-4dd5-8b75-74dad14868e9"
Jul 15 13:15:31.453029 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:31.449458    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7q4kb\" (UID: \"e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810\") " pod="openshift-insights/insights-runtime-extractor-7q4kb"
Jul 15 13:15:31.453029 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:31.449574    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 13:15:31.453029 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:31.449660    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7q4kb\" (UID: \"e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810\") " pod="openshift-insights/insights-runtime-extractor-7q4kb"
Jul 15 13:15:31.453029 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:31.449677    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810-kube-rbac-proxy-cm podName:e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810 nodeName:}" failed. No retries permitted until 2026-07-15 13:15:32.449648951 +0000 UTC m=+252.537435875 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7q4kb" (UID: "e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810") : configmap "kube-rbac-proxy" not found
Jul 15 13:15:31.453029 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:31.449838    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 13:15:31.453029 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:31.449931    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810-insights-runtime-extractor-tls podName:e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810 nodeName:}" failed. No retries permitted until 2026-07-15 13:15:32.449904819 +0000 UTC m=+252.537691740 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7q4kb" (UID: "e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810") : secret "insights-runtime-extractor-tls" not found
Jul 15 13:15:31.754817 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:31.754785    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-6p996"]
Jul 15 13:15:31.757461 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:31.757445    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-6p996"
Jul 15 13:15:31.762540 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:31.762515    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 15 13:15:31.763689 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:31.763664    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-ttx4m\""
Jul 15 13:15:31.763789 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:31.763703    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 15 13:15:31.770848 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:31.770826    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-6p996"]
Jul 15 13:15:31.853828 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:31.853799    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqhns\" (UniqueName: \"kubernetes.io/projected/e83f8574-d32c-43ff-bd55-3178f6df8031-kube-api-access-vqhns\") pod \"migrator-7f59b54f6c-6p996\" (UID: \"e83f8574-d32c-43ff-bd55-3178f6df8031\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-6p996"
Jul 15 13:15:31.955085 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:31.955061    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqhns\" (UniqueName: \"kubernetes.io/projected/e83f8574-d32c-43ff-bd55-3178f6df8031-kube-api-access-vqhns\") pod \"migrator-7f59b54f6c-6p996\" (UID: \"e83f8574-d32c-43ff-bd55-3178f6df8031\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-6p996"
Jul 15 13:15:31.964629 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:31.964599    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqhns\" (UniqueName: \"kubernetes.io/projected/e83f8574-d32c-43ff-bd55-3178f6df8031-kube-api-access-vqhns\") pod \"migrator-7f59b54f6c-6p996\" (UID: \"e83f8574-d32c-43ff-bd55-3178f6df8031\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-6p996"
Jul 15 13:15:32.065963 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:32.065886    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-6p996"
Jul 15 13:15:32.076830 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:32.076809    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-t4bfh_c21b11d6-3242-4dd5-8b75-74dad14868e9/console-operator/1.log"
Jul 15 13:15:32.077219 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:32.077163    2578 scope.go:117] "RemoveContainer" containerID="628b291e69c5cdc70e5572adc43f73fc99e617670ab202396fffe32517de977c"
Jul 15 13:15:32.077441 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:32.077399    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-t4bfh_openshift-console-operator(c21b11d6-3242-4dd5-8b75-74dad14868e9)\"" pod="openshift-console-operator/console-operator-7866497494-t4bfh" podUID="c21b11d6-3242-4dd5-8b75-74dad14868e9"
Jul 15 13:15:32.211506 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:32.211476    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-6p996"]
Jul 15 13:15:32.215256 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:15:32.215232    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode83f8574_d32c_43ff_bd55_3178f6df8031.slice/crio-38ff897b1044595de3d7a77ab4b34c8a66d3a747ae3f700d2fcb391c71a9e54c WatchSource:0}: Error finding container 38ff897b1044595de3d7a77ab4b34c8a66d3a747ae3f700d2fcb391c71a9e54c: Status 404 returned error can't find the container with id 38ff897b1044595de3d7a77ab4b34c8a66d3a747ae3f700d2fcb391c71a9e54c
Jul 15 13:15:32.258243 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:32.258221    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2029ab2-4966-4b8c-ba6c-e69cf982a372-metrics-certs\") pod \"network-metrics-daemon-czmkz\" (UID: \"c2029ab2-4966-4b8c-ba6c-e69cf982a372\") " pod="openshift-multus/network-metrics-daemon-czmkz"
Jul 15 13:15:32.258375 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:32.258359    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 15 13:15:32.258431 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:32.258409    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2029ab2-4966-4b8c-ba6c-e69cf982a372-metrics-certs podName:c2029ab2-4966-4b8c-ba6c-e69cf982a372 nodeName:}" failed. No retries permitted until 2026-07-15 13:17:34.258395748 +0000 UTC m=+374.346182669 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c2029ab2-4966-4b8c-ba6c-e69cf982a372-metrics-certs") pod "network-metrics-daemon-czmkz" (UID: "c2029ab2-4966-4b8c-ba6c-e69cf982a372") : secret "metrics-daemon-secret" not found
Jul 15 13:15:32.460050 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:32.460022    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7q4kb\" (UID: \"e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810\") " pod="openshift-insights/insights-runtime-extractor-7q4kb"
Jul 15 13:15:32.460195 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:32.460095    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7q4kb\" (UID: \"e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810\") " pod="openshift-insights/insights-runtime-extractor-7q4kb"
Jul 15 13:15:32.460195 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:32.460142    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 13:15:32.460320 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:32.460242    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810-kube-rbac-proxy-cm podName:e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810 nodeName:}" failed. No retries permitted until 2026-07-15 13:15:34.460216305 +0000 UTC m=+254.548003241 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7q4kb" (UID: "e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810") : configmap "kube-rbac-proxy" not found
Jul 15 13:15:32.460320 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:32.460279    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 13:15:32.460410 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:32.460345    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810-insights-runtime-extractor-tls podName:e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810 nodeName:}" failed. No retries permitted until 2026-07-15 13:15:34.460327104 +0000 UTC m=+254.548114046 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7q4kb" (UID: "e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810") : secret "insights-runtime-extractor-tls" not found
Jul 15 13:15:32.661645 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:32.661611    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f8a6a75-cdcf-4264-8e27-6a0af529b5b2-service-ca-bundle\") pod \"router-default-8db99c4db-qzshk\" (UID: \"0f8a6a75-cdcf-4264-8e27-6a0af529b5b2\") " pod="openshift-ingress/router-default-8db99c4db-qzshk"
Jul 15 13:15:32.661645 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:32.661648    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f8a6a75-cdcf-4264-8e27-6a0af529b5b2-metrics-certs\") pod \"router-default-8db99c4db-qzshk\" (UID: \"0f8a6a75-cdcf-4264-8e27-6a0af529b5b2\") " pod="openshift-ingress/router-default-8db99c4db-qzshk"
Jul 15 13:15:32.661868 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:32.661709    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9f41e77d-33d2-4d77-a15e-9d8e59a98d6b-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-cpc58\" (UID: \"9f41e77d-33d2-4d77-a15e-9d8e59a98d6b\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-cpc58"
Jul 15 13:15:32.661868 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:32.661731    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/56a94de7-8c93-43ae-a4b2-929d78711ac8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-cjgpm\" (UID: \"56a94de7-8c93-43ae-a4b2-929d78711ac8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cjgpm"
Jul 15 13:15:32.661868 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:32.661767    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0f8a6a75-cdcf-4264-8e27-6a0af529b5b2-service-ca-bundle podName:0f8a6a75-cdcf-4264-8e27-6a0af529b5b2 nodeName:}" failed. No retries permitted until 2026-07-15 13:15:40.661747898 +0000 UTC m=+260.749534818 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0f8a6a75-cdcf-4264-8e27-6a0af529b5b2-service-ca-bundle") pod "router-default-8db99c4db-qzshk" (UID: "0f8a6a75-cdcf-4264-8e27-6a0af529b5b2") : configmap references non-existent config key: service-ca.crt
Jul 15 13:15:32.661868 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:32.661832    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 15 13:15:32.661868 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:32.661856    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 13:15:32.662066 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:32.661878    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f41e77d-33d2-4d77-a15e-9d8e59a98d6b-networking-console-plugin-cert podName:9f41e77d-33d2-4d77-a15e-9d8e59a98d6b nodeName:}" failed. No retries permitted until 2026-07-15 13:15:40.661865448 +0000 UTC m=+260.749652371 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9f41e77d-33d2-4d77-a15e-9d8e59a98d6b-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-cpc58" (UID: "9f41e77d-33d2-4d77-a15e-9d8e59a98d6b") : secret "networking-console-plugin-cert" not found
Jul 15 13:15:32.662066 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:32.661911    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56a94de7-8c93-43ae-a4b2-929d78711ac8-cluster-monitoring-operator-tls podName:56a94de7-8c93-43ae-a4b2-929d78711ac8 nodeName:}" failed. No retries permitted until 2026-07-15 13:15:40.661894025 +0000 UTC m=+260.749681167 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/56a94de7-8c93-43ae-a4b2-929d78711ac8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-cjgpm" (UID: "56a94de7-8c93-43ae-a4b2-929d78711ac8") : secret "cluster-monitoring-operator-tls" not found
Jul 15 13:15:32.662066 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:32.661915    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 13:15:32.662066 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:32.661938    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f8a6a75-cdcf-4264-8e27-6a0af529b5b2-metrics-certs podName:0f8a6a75-cdcf-4264-8e27-6a0af529b5b2 nodeName:}" failed. No retries permitted until 2026-07-15 13:15:40.661931252 +0000 UTC m=+260.749718172 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f8a6a75-cdcf-4264-8e27-6a0af529b5b2-metrics-certs") pod "router-default-8db99c4db-qzshk" (UID: "0f8a6a75-cdcf-4264-8e27-6a0af529b5b2") : secret "router-metrics-certs-default" not found
Jul 15 13:15:32.939164 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:32.939085    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wdgw4_56d93a5b-2111-4969-9ef3-9e58f7e2cb82/dns-node-resolver/0.log"
Jul 15 13:15:33.081277 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:33.081244    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-6p996" event={"ID":"e83f8574-d32c-43ff-bd55-3178f6df8031","Type":"ContainerStarted","Data":"38ff897b1044595de3d7a77ab4b34c8a66d3a747ae3f700d2fcb391c71a9e54c"}
Jul 15 13:15:33.535725 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:33.535703    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9lrlb_740cd63d-7aa0-464d-be90-87aea6674efa/node-ca/0.log"
Jul 15 13:15:34.086930 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:34.086896    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-6p996" event={"ID":"e83f8574-d32c-43ff-bd55-3178f6df8031","Type":"ContainerStarted","Data":"a5e5498cc27d4bbb438d96bb2b6a914bbfb25fb04a124d00491e72fecf760393"}
Jul 15 13:15:34.087319 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:34.086949    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-6p996" event={"ID":"e83f8574-d32c-43ff-bd55-3178f6df8031","Type":"ContainerStarted","Data":"1c7e8b29923513d398c0acee0ced117d6bed52afa79869ca29cb0daf3a5a3d78"}
Jul 15 13:15:34.477912 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:34.477880    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7q4kb\" (UID: \"e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810\") " pod="openshift-insights/insights-runtime-extractor-7q4kb"
Jul 15 13:15:34.478100 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:34.477939    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7q4kb\" (UID: \"e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810\") " pod="openshift-insights/insights-runtime-extractor-7q4kb"
Jul 15 13:15:34.478100 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:34.478031    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 13:15:34.478100 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:34.478045    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 13:15:34.478100 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:34.478097    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810-insights-runtime-extractor-tls podName:e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810 nodeName:}" failed. No retries permitted until 2026-07-15 13:15:38.478084155 +0000 UTC m=+258.565871075 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7q4kb" (UID: "e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810") : secret "insights-runtime-extractor-tls" not found
Jul 15 13:15:34.478289 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:34.478110    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810-kube-rbac-proxy-cm podName:e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810 nodeName:}" failed. No retries permitted until 2026-07-15 13:15:38.478104707 +0000 UTC m=+258.565891626 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7q4kb" (UID: "e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810") : configmap "kube-rbac-proxy" not found
Jul 15 13:15:34.538242 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:34.538198    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fp5hs_5920a816-5d9e-4020-a084-a84faf51ca5d/serve-healthcheck-canary/0.log"
Jul 15 13:15:35.209027 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:35.208998    2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-t4bfh"
Jul 15 13:15:35.209399 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:35.209360    2578 scope.go:117] "RemoveContainer" containerID="628b291e69c5cdc70e5572adc43f73fc99e617670ab202396fffe32517de977c"
Jul 15 13:15:35.209508 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:35.209489    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-t4bfh_openshift-console-operator(c21b11d6-3242-4dd5-8b75-74dad14868e9)\"" pod="openshift-console-operator/console-operator-7866497494-t4bfh" podUID="c21b11d6-3242-4dd5-8b75-74dad14868e9"
Jul 15 13:15:38.510924 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:38.510886    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7q4kb\" (UID: \"e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810\") " pod="openshift-insights/insights-runtime-extractor-7q4kb"
Jul 15 13:15:38.511312 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:38.510973    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7q4kb\" (UID: \"e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810\") " pod="openshift-insights/insights-runtime-extractor-7q4kb"
Jul 15 13:15:38.511312 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:38.511012    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 13:15:38.511312 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:38.511054    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 13:15:38.511312 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:38.511070    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810-kube-rbac-proxy-cm podName:e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810 nodeName:}" failed. No retries permitted until 2026-07-15 13:15:46.511056347 +0000 UTC m=+266.598843267 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7q4kb" (UID: "e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810") : configmap "kube-rbac-proxy" not found
Jul 15 13:15:38.511312 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:38.511102    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810-insights-runtime-extractor-tls podName:e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810 nodeName:}" failed. No retries permitted until 2026-07-15 13:15:46.511091074 +0000 UTC m=+266.598877994 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7q4kb" (UID: "e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810") : secret "insights-runtime-extractor-tls" not found
Jul 15 13:15:39.058640 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:39.058611    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-t4bfh"
Jul 15 13:15:39.058946 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:39.058933    2578 scope.go:117] "RemoveContainer" containerID="628b291e69c5cdc70e5572adc43f73fc99e617670ab202396fffe32517de977c"
Jul 15 13:15:39.059088 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:39.059069    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-t4bfh_openshift-console-operator(c21b11d6-3242-4dd5-8b75-74dad14868e9)\"" pod="openshift-console-operator/console-operator-7866497494-t4bfh" podUID="c21b11d6-3242-4dd5-8b75-74dad14868e9"
Jul 15 13:15:40.729399 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:40.729365    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9f41e77d-33d2-4d77-a15e-9d8e59a98d6b-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-cpc58\" (UID: \"9f41e77d-33d2-4d77-a15e-9d8e59a98d6b\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-cpc58"
Jul 15 13:15:40.729399 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:40.729402    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/56a94de7-8c93-43ae-a4b2-929d78711ac8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-cjgpm\" (UID: \"56a94de7-8c93-43ae-a4b2-929d78711ac8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cjgpm"
Jul 15 13:15:40.729797 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:40.729516    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 15 13:15:40.729797 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:40.729557    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 13:15:40.729797 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:40.729572    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f41e77d-33d2-4d77-a15e-9d8e59a98d6b-networking-console-plugin-cert podName:9f41e77d-33d2-4d77-a15e-9d8e59a98d6b nodeName:}" failed. No retries permitted until 2026-07-15 13:15:56.729555923 +0000 UTC m=+276.817342846 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9f41e77d-33d2-4d77-a15e-9d8e59a98d6b-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-cpc58" (UID: "9f41e77d-33d2-4d77-a15e-9d8e59a98d6b") : secret "networking-console-plugin-cert" not found
Jul 15 13:15:40.729797 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:40.729595    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56a94de7-8c93-43ae-a4b2-929d78711ac8-cluster-monitoring-operator-tls podName:56a94de7-8c93-43ae-a4b2-929d78711ac8 nodeName:}" failed. No retries permitted until 2026-07-15 13:15:56.729584199 +0000 UTC m=+276.817371120 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/56a94de7-8c93-43ae-a4b2-929d78711ac8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-cjgpm" (UID: "56a94de7-8c93-43ae-a4b2-929d78711ac8") : secret "cluster-monitoring-operator-tls" not found
Jul 15 13:15:40.729797 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:40.729618    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f8a6a75-cdcf-4264-8e27-6a0af529b5b2-service-ca-bundle\") pod \"router-default-8db99c4db-qzshk\" (UID: \"0f8a6a75-cdcf-4264-8e27-6a0af529b5b2\") " pod="openshift-ingress/router-default-8db99c4db-qzshk"
Jul 15 13:15:40.729797 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:40.729639    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f8a6a75-cdcf-4264-8e27-6a0af529b5b2-metrics-certs\") pod \"router-default-8db99c4db-qzshk\" (UID: \"0f8a6a75-cdcf-4264-8e27-6a0af529b5b2\") " pod="openshift-ingress/router-default-8db99c4db-qzshk"
Jul 15 13:15:40.729797 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:40.729724    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 13:15:40.729797 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:40.729757    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0f8a6a75-cdcf-4264-8e27-6a0af529b5b2-service-ca-bundle podName:0f8a6a75-cdcf-4264-8e27-6a0af529b5b2 nodeName:}" failed. No retries permitted until 2026-07-15 13:15:56.729745272 +0000 UTC m=+276.817532192 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0f8a6a75-cdcf-4264-8e27-6a0af529b5b2-service-ca-bundle") pod "router-default-8db99c4db-qzshk" (UID: "0f8a6a75-cdcf-4264-8e27-6a0af529b5b2") : configmap references non-existent config key: service-ca.crt
Jul 15 13:15:40.729797 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:15:40.729777    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f8a6a75-cdcf-4264-8e27-6a0af529b5b2-metrics-certs podName:0f8a6a75-cdcf-4264-8e27-6a0af529b5b2 nodeName:}" failed. No retries permitted until 2026-07-15 13:15:56.729769282 +0000 UTC m=+276.817556203 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f8a6a75-cdcf-4264-8e27-6a0af529b5b2-metrics-certs") pod "router-default-8db99c4db-qzshk" (UID: "0f8a6a75-cdcf-4264-8e27-6a0af529b5b2") : secret "router-metrics-certs-default" not found
Jul 15 13:15:46.583074 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:46.582989    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7q4kb\" (UID: \"e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810\") " pod="openshift-insights/insights-runtime-extractor-7q4kb"
Jul 15 13:15:46.583074 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:46.583047    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7q4kb\" (UID: \"e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810\") " pod="openshift-insights/insights-runtime-extractor-7q4kb"
Jul 15 13:15:46.583550 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:46.583524    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7q4kb\" (UID: \"e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810\") " pod="openshift-insights/insights-runtime-extractor-7q4kb"
Jul 15 13:15:46.585283 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:46.585263    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7q4kb\" (UID: \"e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810\") " pod="openshift-insights/insights-runtime-extractor-7q4kb"
Jul 15 13:15:46.656234 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:46.656197    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7q4kb"
Jul 15 13:15:46.779057 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:46.778977    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-6p996" podStartSLOduration=14.616890063 podStartE2EDuration="15.778959634s" totalImagesPullingTime="1.162069571s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:15:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:15:34.109244025 +0000 UTC m=+254.197030974" watchObservedRunningTime="2026-07-15 13:15:46.778959634 +0000 UTC m=+266.866746576"
Jul 15 13:15:46.779400 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:46.779385    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7q4kb"]
Jul 15 13:15:46.781448 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:15:46.781413    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0ec29bb_51e2_4e7d_99ad_a5fc19f9c810.slice/crio-7054af9e37108882ec6049c58fe0b1d57a985cf4fa27b81ba6b2329909f61d73 WatchSource:0}: Error finding container 7054af9e37108882ec6049c58fe0b1d57a985cf4fa27b81ba6b2329909f61d73: Status 404 returned error can't find the container with id 7054af9e37108882ec6049c58fe0b1d57a985cf4fa27b81ba6b2329909f61d73
Jul 15 13:15:47.128688 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:47.128655    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7q4kb" event={"ID":"e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810","Type":"ContainerStarted","Data":"7054af9e37108882ec6049c58fe0b1d57a985cf4fa27b81ba6b2329909f61d73"}
Jul 15 13:15:53.153602 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:53.153522    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7q4kb" event={"ID":"e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810","Type":"ContainerStarted","Data":"68b08f081182a4b9bebbc4bc12590c62a895084704145d1c399519dce9959c55"}
Jul 15 13:15:53.369740 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:53.369686    2578 scope.go:117] "RemoveContainer" containerID="628b291e69c5cdc70e5572adc43f73fc99e617670ab202396fffe32517de977c"
Jul 15 13:15:54.158221 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:54.158177    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-t4bfh_c21b11d6-3242-4dd5-8b75-74dad14868e9/console-operator/1.log"
Jul 15 13:15:54.158620 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:54.158282    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-t4bfh" event={"ID":"c21b11d6-3242-4dd5-8b75-74dad14868e9","Type":"ContainerStarted","Data":"63f971b668bf35fda4f98e44cd2db6dee63ede691b7cc551c9d9fa8448ef66c7"}
Jul 15 13:15:54.158620 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:54.158551    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-t4bfh"
Jul 15 13:15:54.241828 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:54.241792    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-t4bfh"
Jul 15 13:15:56.773759 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:56.773723    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9f41e77d-33d2-4d77-a15e-9d8e59a98d6b-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-cpc58\" (UID: \"9f41e77d-33d2-4d77-a15e-9d8e59a98d6b\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-cpc58"
Jul 15 13:15:56.774330 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:56.773766    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/56a94de7-8c93-43ae-a4b2-929d78711ac8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-cjgpm\" (UID: \"56a94de7-8c93-43ae-a4b2-929d78711ac8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cjgpm"
Jul 15 13:15:56.774330 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:56.773803    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f8a6a75-cdcf-4264-8e27-6a0af529b5b2-service-ca-bundle\") pod \"router-default-8db99c4db-qzshk\" (UID: \"0f8a6a75-cdcf-4264-8e27-6a0af529b5b2\") " pod="openshift-ingress/router-default-8db99c4db-qzshk"
Jul 15 13:15:56.774330 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:56.773823    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f8a6a75-cdcf-4264-8e27-6a0af529b5b2-metrics-certs\") pod \"router-default-8db99c4db-qzshk\" (UID: \"0f8a6a75-cdcf-4264-8e27-6a0af529b5b2\") " pod="openshift-ingress/router-default-8db99c4db-qzshk"
Jul 15 13:15:56.774613 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:56.774591    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f8a6a75-cdcf-4264-8e27-6a0af529b5b2-service-ca-bundle\") pod \"router-default-8db99c4db-qzshk\" (UID: \"0f8a6a75-cdcf-4264-8e27-6a0af529b5b2\") " pod="openshift-ingress/router-default-8db99c4db-qzshk"
Jul 15 13:15:56.776395 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:56.776367    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f8a6a75-cdcf-4264-8e27-6a0af529b5b2-metrics-certs\") pod \"router-default-8db99c4db-qzshk\" (UID: \"0f8a6a75-cdcf-4264-8e27-6a0af529b5b2\") " pod="openshift-ingress/router-default-8db99c4db-qzshk"
Jul 15 13:15:56.776636 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:56.776617    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/56a94de7-8c93-43ae-a4b2-929d78711ac8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-cjgpm\" (UID: \"56a94de7-8c93-43ae-a4b2-929d78711ac8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cjgpm"
Jul 15 13:15:56.776710 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:56.776689    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9f41e77d-33d2-4d77-a15e-9d8e59a98d6b-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-cpc58\" (UID: \"9f41e77d-33d2-4d77-a15e-9d8e59a98d6b\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-cpc58"
Jul 15 13:15:56.932041 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:56.932007    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cjgpm"
Jul 15 13:15:56.938135 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:56.938106    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-cpc58"
Jul 15 13:15:56.946531 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:56.946509    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-8db99c4db-qzshk"
Jul 15 13:15:57.575383 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:57.575352    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cjgpm"]
Jul 15 13:15:57.583550 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:15:57.583525    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56a94de7_8c93_43ae_a4b2_929d78711ac8.slice/crio-c0b4d249874f9a0d12d2ef802c6fc963198d47b642241efe742143a296a8fd32 WatchSource:0}: Error finding container c0b4d249874f9a0d12d2ef802c6fc963198d47b642241efe742143a296a8fd32: Status 404 returned error can't find the container with id c0b4d249874f9a0d12d2ef802c6fc963198d47b642241efe742143a296a8fd32
Jul 15 13:15:57.594933 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:57.594912    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-cpc58"]
Jul 15 13:15:57.596694 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:15:57.596669    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f41e77d_33d2_4d77_a15e_9d8e59a98d6b.slice/crio-6ed31e15f0b09c0f6ead41239309da8d1650128af542e78ff20b936e28fb11c2 WatchSource:0}: Error finding container 6ed31e15f0b09c0f6ead41239309da8d1650128af542e78ff20b936e28fb11c2: Status 404 returned error can't find the container with id 6ed31e15f0b09c0f6ead41239309da8d1650128af542e78ff20b936e28fb11c2
Jul 15 13:15:57.619031 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:57.619007    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-8db99c4db-qzshk"]
Jul 15 13:15:57.620685 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:15:57.620655    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f8a6a75_cdcf_4264_8e27_6a0af529b5b2.slice/crio-aa54a5b952baaa0fb5f38ca82230d178d4b74d0a45ad2c22bb0ed74329a6b466 WatchSource:0}: Error finding container aa54a5b952baaa0fb5f38ca82230d178d4b74d0a45ad2c22bb0ed74329a6b466: Status 404 returned error can't find the container with id aa54a5b952baaa0fb5f38ca82230d178d4b74d0a45ad2c22bb0ed74329a6b466
Jul 15 13:15:58.173347 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:58.173316    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cjgpm" event={"ID":"56a94de7-8c93-43ae-a4b2-929d78711ac8","Type":"ContainerStarted","Data":"c0b4d249874f9a0d12d2ef802c6fc963198d47b642241efe742143a296a8fd32"}
Jul 15 13:15:58.175031 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:58.175005    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-8db99c4db-qzshk" event={"ID":"0f8a6a75-cdcf-4264-8e27-6a0af529b5b2","Type":"ContainerStarted","Data":"71a440635320c778e92c5dd50f7900ce871257331f8550c1f1935c9a73d5ef9d"}
Jul 15 13:15:58.175166 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:58.175046    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-8db99c4db-qzshk" event={"ID":"0f8a6a75-cdcf-4264-8e27-6a0af529b5b2","Type":"ContainerStarted","Data":"aa54a5b952baaa0fb5f38ca82230d178d4b74d0a45ad2c22bb0ed74329a6b466"}
Jul 15 13:15:58.176236 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:58.176189    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-cpc58" event={"ID":"9f41e77d-33d2-4d77-a15e-9d8e59a98d6b","Type":"ContainerStarted","Data":"6ed31e15f0b09c0f6ead41239309da8d1650128af542e78ff20b936e28fb11c2"}
Jul 15 13:15:58.178014 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:58.177994    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7q4kb" event={"ID":"e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810","Type":"ContainerStarted","Data":"ae290d84a40c78abe3794a0abd79cf1226c2f2b125dd1dedf101763de0010ec7"}
Jul 15 13:15:58.197640 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:58.197593    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-8db99c4db-qzshk" podStartSLOduration=34.197576531 podStartE2EDuration="34.197576531s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:15:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:15:58.197346847 +0000 UTC m=+278.285133789" watchObservedRunningTime="2026-07-15 13:15:58.197576531 +0000 UTC m=+278.285363456"
Jul 15 13:15:58.947009 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:58.946958    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-8db99c4db-qzshk"
Jul 15 13:15:58.950216 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:58.949983    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-8db99c4db-qzshk"
Jul 15 13:15:59.184016 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:59.183988    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-8db99c4db-qzshk"
Jul 15 13:15:59.185324 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:15:59.185299    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-8db99c4db-qzshk"
Jul 15 13:16:02.194970 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:02.194927    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cjgpm" event={"ID":"56a94de7-8c93-43ae-a4b2-929d78711ac8","Type":"ContainerStarted","Data":"ff78fcdaa4c309895fd083ad81cb503b879ae30dba41c0bdab6a6e9e57cb2d54"}
Jul 15 13:16:02.196379 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:02.196349    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-cpc58" event={"ID":"9f41e77d-33d2-4d77-a15e-9d8e59a98d6b","Type":"ContainerStarted","Data":"65b4bf01c98ca4069cc3022a5a7a744640575324663525e3cfad1769fd113e1f"}
Jul 15 13:16:02.198302 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:02.198281    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7q4kb" event={"ID":"e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810","Type":"ContainerStarted","Data":"13d99036fba35b1349c6d6a6d16206e0ec5d7b14e0d6d52a77261d0c11dba6c1"}
Jul 15 13:16:02.219755 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:02.219710    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cjgpm" podStartSLOduration=34.379822424 podStartE2EDuration="38.219697112s" totalImagesPullingTime="3.839874688s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:15:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:16:02.216088282 +0000 UTC m=+282.303875224" watchObservedRunningTime="2026-07-15 13:16:02.219697112 +0000 UTC m=+282.307484242"
Jul 15 13:16:02.236923 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:02.236873    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-cpc58" podStartSLOduration=34.409245847 podStartE2EDuration="38.236835387s" totalImagesPullingTime="3.82758954s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:15:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:16:02.23572743 +0000 UTC m=+282.323514373" watchObservedRunningTime="2026-07-15 13:16:02.236835387 +0000 UTC m=+282.324622327"
Jul 15 13:16:02.256315 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:02.256268    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-7q4kb" podStartSLOduration=17.752862983 podStartE2EDuration="32.256254582s" totalImagesPullingTime="14.503391599s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:15:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:16:02.2547688 +0000 UTC m=+282.342555743" watchObservedRunningTime="2026-07-15 13:16:02.256254582 +0000 UTC m=+282.344041555"
Jul 15 13:16:03.839800 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:16:03.839757    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-wqxcc" podUID="6b061bb5-718d-4fed-9076-9668e21d4b13"
Jul 15 13:16:04.204597 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:04.204520    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wqxcc"
Jul 15 13:16:05.041570 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:05.041537    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-m85z7"]
Jul 15 13:16:05.046030 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:05.046013    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-m85z7"
Jul 15 13:16:05.049127 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:05.049106    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 15 13:16:05.050574 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:05.050553    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 15 13:16:05.050668 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:05.050571    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-89vhq\""
Jul 15 13:16:05.050668 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:05.050601    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 15 13:16:05.058666 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:05.058649    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-m85z7"]
Jul 15 13:16:05.144073 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:05.144039    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c95927ef-80cb-468c-bac6-ebfd22f92bdf-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-m85z7\" (UID: \"c95927ef-80cb-468c-bac6-ebfd22f92bdf\") " pod="openshift-monitoring/prometheus-operator-64785b6675-m85z7"
Jul 15 13:16:05.144199 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:05.144085    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c95927ef-80cb-468c-bac6-ebfd22f92bdf-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-m85z7\" (UID: \"c95927ef-80cb-468c-bac6-ebfd22f92bdf\") " pod="openshift-monitoring/prometheus-operator-64785b6675-m85z7"
Jul 15 13:16:05.144199 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:05.144109    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c95927ef-80cb-468c-bac6-ebfd22f92bdf-metrics-client-ca\") pod \"prometheus-operator-64785b6675-m85z7\" (UID: \"c95927ef-80cb-468c-bac6-ebfd22f92bdf\") " pod="openshift-monitoring/prometheus-operator-64785b6675-m85z7"
Jul 15 13:16:05.144199 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:05.144173    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gg5bk\" (UniqueName: \"kubernetes.io/projected/c95927ef-80cb-468c-bac6-ebfd22f92bdf-kube-api-access-gg5bk\") pod \"prometheus-operator-64785b6675-m85z7\" (UID: \"c95927ef-80cb-468c-bac6-ebfd22f92bdf\") " pod="openshift-monitoring/prometheus-operator-64785b6675-m85z7"
Jul 15 13:16:05.244902 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:05.244853    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c95927ef-80cb-468c-bac6-ebfd22f92bdf-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-m85z7\" (UID: \"c95927ef-80cb-468c-bac6-ebfd22f92bdf\") " pod="openshift-monitoring/prometheus-operator-64785b6675-m85z7"
Jul 15 13:16:05.244902 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:05.244911    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c95927ef-80cb-468c-bac6-ebfd22f92bdf-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-m85z7\" (UID: \"c95927ef-80cb-468c-bac6-ebfd22f92bdf\") " pod="openshift-monitoring/prometheus-operator-64785b6675-m85z7"
Jul 15 13:16:05.245119 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:05.244933    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c95927ef-80cb-468c-bac6-ebfd22f92bdf-metrics-client-ca\") pod \"prometheus-operator-64785b6675-m85z7\" (UID: \"c95927ef-80cb-468c-bac6-ebfd22f92bdf\") " pod="openshift-monitoring/prometheus-operator-64785b6675-m85z7"
Jul 15 13:16:05.245119 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:05.244975    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gg5bk\" (UniqueName: \"kubernetes.io/projected/c95927ef-80cb-468c-bac6-ebfd22f92bdf-kube-api-access-gg5bk\") pod \"prometheus-operator-64785b6675-m85z7\" (UID: \"c95927ef-80cb-468c-bac6-ebfd22f92bdf\") " pod="openshift-monitoring/prometheus-operator-64785b6675-m85z7"
Jul 15 13:16:05.245119 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:16:05.245019    2578 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 15 13:16:05.245119 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:16:05.245109    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c95927ef-80cb-468c-bac6-ebfd22f92bdf-prometheus-operator-tls podName:c95927ef-80cb-468c-bac6-ebfd22f92bdf nodeName:}" failed. No retries permitted until 2026-07-15 13:16:05.745086737 +0000 UTC m=+285.832873673 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/c95927ef-80cb-468c-bac6-ebfd22f92bdf-prometheus-operator-tls") pod "prometheus-operator-64785b6675-m85z7" (UID: "c95927ef-80cb-468c-bac6-ebfd22f92bdf") : secret "prometheus-operator-tls" not found
Jul 15 13:16:05.245717 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:05.245701    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c95927ef-80cb-468c-bac6-ebfd22f92bdf-metrics-client-ca\") pod \"prometheus-operator-64785b6675-m85z7\" (UID: \"c95927ef-80cb-468c-bac6-ebfd22f92bdf\") " pod="openshift-monitoring/prometheus-operator-64785b6675-m85z7"
Jul 15 13:16:05.247313 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:05.247292    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c95927ef-80cb-468c-bac6-ebfd22f92bdf-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-m85z7\" (UID: \"c95927ef-80cb-468c-bac6-ebfd22f92bdf\") " pod="openshift-monitoring/prometheus-operator-64785b6675-m85z7"
Jul 15 13:16:05.254744 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:05.254715    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gg5bk\" (UniqueName: \"kubernetes.io/projected/c95927ef-80cb-468c-bac6-ebfd22f92bdf-kube-api-access-gg5bk\") pod \"prometheus-operator-64785b6675-m85z7\" (UID: \"c95927ef-80cb-468c-bac6-ebfd22f92bdf\") " pod="openshift-monitoring/prometheus-operator-64785b6675-m85z7"
Jul 15 13:16:05.750478 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:05.750440    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c95927ef-80cb-468c-bac6-ebfd22f92bdf-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-m85z7\" (UID: \"c95927ef-80cb-468c-bac6-ebfd22f92bdf\") " pod="openshift-monitoring/prometheus-operator-64785b6675-m85z7"
Jul 15 13:16:05.752765 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:05.752740    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c95927ef-80cb-468c-bac6-ebfd22f92bdf-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-m85z7\" (UID: \"c95927ef-80cb-468c-bac6-ebfd22f92bdf\") " pod="openshift-monitoring/prometheus-operator-64785b6675-m85z7"
Jul 15 13:16:05.954754 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:05.954708    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-m85z7"
Jul 15 13:16:06.085323 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:06.085187    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-m85z7"]
Jul 15 13:16:06.087624 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:16:06.087602    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc95927ef_80cb_468c_bac6_ebfd22f92bdf.slice/crio-204c5b2b2c52924c4564094bbaf752a1353d2b6ebbbeec8aa3876a3b9e857da2 WatchSource:0}: Error finding container 204c5b2b2c52924c4564094bbaf752a1353d2b6ebbbeec8aa3876a3b9e857da2: Status 404 returned error can't find the container with id 204c5b2b2c52924c4564094bbaf752a1353d2b6ebbbeec8aa3876a3b9e857da2
Jul 15 13:16:06.212224 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:06.212172    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-m85z7" event={"ID":"c95927ef-80cb-468c-bac6-ebfd22f92bdf","Type":"ContainerStarted","Data":"204c5b2b2c52924c4564094bbaf752a1353d2b6ebbbeec8aa3876a3b9e857da2"}
Jul 15 13:16:07.262475 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:07.262448    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-registry-tls\") pod \"image-registry-6d4ff848df-v8kpc\" (UID: \"91ab3ba4-74ad-465b-8f66-eaafd1b66e40\") " pod="openshift-image-registry/image-registry-6d4ff848df-v8kpc"
Jul 15 13:16:07.264631 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:07.264613    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-registry-tls\") pod \"image-registry-6d4ff848df-v8kpc\" (UID: \"91ab3ba4-74ad-465b-8f66-eaafd1b66e40\") " pod="openshift-image-registry/image-registry-6d4ff848df-v8kpc"
Jul 15 13:16:07.363553 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:07.363527    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b061bb5-718d-4fed-9076-9668e21d4b13-metrics-tls\") pod \"dns-default-wqxcc\" (UID: \"6b061bb5-718d-4fed-9076-9668e21d4b13\") " pod="openshift-dns/dns-default-wqxcc"
Jul 15 13:16:07.365943 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:07.365923    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b061bb5-718d-4fed-9076-9668e21d4b13-metrics-tls\") pod \"dns-default-wqxcc\" (UID: \"6b061bb5-718d-4fed-9076-9668e21d4b13\") " pod="openshift-dns/dns-default-wqxcc"
Jul 15 13:16:07.372620 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:07.372597    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9ff6l\""
Jul 15 13:16:07.380265 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:07.380248    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d4ff848df-v8kpc"
Jul 15 13:16:07.513120 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:07.513095    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bdsl2\""
Jul 15 13:16:07.516608 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:07.516593    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wqxcc"
Jul 15 13:16:07.543437 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:07.543410    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d4ff848df-v8kpc"]
Jul 15 13:16:07.546295 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:16:07.546268    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91ab3ba4_74ad_465b_8f66_eaafd1b66e40.slice/crio-ea9ec333f4d06b496fcc75a4f811796a6e32f9ddb04f71b6413fa60fdacb684b WatchSource:0}: Error finding container ea9ec333f4d06b496fcc75a4f811796a6e32f9ddb04f71b6413fa60fdacb684b: Status 404 returned error can't find the container with id ea9ec333f4d06b496fcc75a4f811796a6e32f9ddb04f71b6413fa60fdacb684b
Jul 15 13:16:07.662324 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:07.662293    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wqxcc"]
Jul 15 13:16:07.667275 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:16:07.667239    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b061bb5_718d_4fed_9076_9668e21d4b13.slice/crio-8391df373392c76f0783e75623d3acaba65456adfcac6b258f0502b1a78cb829 WatchSource:0}: Error finding container 8391df373392c76f0783e75623d3acaba65456adfcac6b258f0502b1a78cb829: Status 404 returned error can't find the container with id 8391df373392c76f0783e75623d3acaba65456adfcac6b258f0502b1a78cb829
Jul 15 13:16:08.220438 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:08.220403    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-m85z7" event={"ID":"c95927ef-80cb-468c-bac6-ebfd22f92bdf","Type":"ContainerStarted","Data":"6697fae9cb1410d78886e063c22da44714984f8107dffa9e2f0c3dd34bbe29c7"}
Jul 15 13:16:08.220646 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:08.220471    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-m85z7" event={"ID":"c95927ef-80cb-468c-bac6-ebfd22f92bdf","Type":"ContainerStarted","Data":"047caf2098ffe2fdd70908e29abfd9bd2551e1bdace3d4451d1aa1043ed1a65e"}
Jul 15 13:16:08.221648 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:08.221627    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wqxcc" event={"ID":"6b061bb5-718d-4fed-9076-9668e21d4b13","Type":"ContainerStarted","Data":"8391df373392c76f0783e75623d3acaba65456adfcac6b258f0502b1a78cb829"}
Jul 15 13:16:08.223027 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:08.223006    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d4ff848df-v8kpc" event={"ID":"91ab3ba4-74ad-465b-8f66-eaafd1b66e40","Type":"ContainerStarted","Data":"561ff7d56ceaac10c5c2b7e835434dbbf69d32f49c736f49610375395ccaf599"}
Jul 15 13:16:08.223108 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:08.223047    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6d4ff848df-v8kpc"
Jul 15 13:16:08.223108 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:08.223060    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d4ff848df-v8kpc" event={"ID":"91ab3ba4-74ad-465b-8f66-eaafd1b66e40","Type":"ContainerStarted","Data":"ea9ec333f4d06b496fcc75a4f811796a6e32f9ddb04f71b6413fa60fdacb684b"}
Jul 15 13:16:08.239693 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:08.239645    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-m85z7" podStartSLOduration=2.121180145 podStartE2EDuration="3.239629454s" totalImagesPullingTime="1.118449309s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:16:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:16:08.239558302 +0000 UTC m=+288.327345245" watchObservedRunningTime="2026-07-15 13:16:08.239629454 +0000 UTC m=+288.327416400"
Jul 15 13:16:08.264095 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:08.264053    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6d4ff848df-v8kpc" podStartSLOduration=287.264039879 podStartE2EDuration="4m47.264039879s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:11:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:16:08.263263086 +0000 UTC m=+288.351050029" watchObservedRunningTime="2026-07-15 13:16:08.264039879 +0000 UTC m=+288.351826820"
Jul 15 13:16:10.549296 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:10.549262    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4s85b"]
Jul 15 13:16:10.554612 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:10.554591    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4s85b"
Jul 15 13:16:10.560329 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:10.560305    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 15 13:16:10.560446 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:10.560379    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-cqkv2\""
Jul 15 13:16:10.560446 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:10.560423    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 15 13:16:10.560446 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:10.560423    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 15 13:16:10.687915 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:10.687880    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/692752da-6638-487b-80ea-588592654ef1-node-exporter-textfile\") pod \"node-exporter-4s85b\" (UID: \"692752da-6638-487b-80ea-588592654ef1\") " pod="openshift-monitoring/node-exporter-4s85b"
Jul 15 13:16:10.688094 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:10.687930    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vknc\" (UniqueName: \"kubernetes.io/projected/692752da-6638-487b-80ea-588592654ef1-kube-api-access-2vknc\") pod \"node-exporter-4s85b\" (UID: \"692752da-6638-487b-80ea-588592654ef1\") " pod="openshift-monitoring/node-exporter-4s85b"
Jul 15 13:16:10.688094 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:10.687963    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/692752da-6638-487b-80ea-588592654ef1-metrics-client-ca\") pod \"node-exporter-4s85b\" (UID: \"692752da-6638-487b-80ea-588592654ef1\") " pod="openshift-monitoring/node-exporter-4s85b"
Jul 15 13:16:10.688094 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:10.688043    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/692752da-6638-487b-80ea-588592654ef1-node-exporter-tls\") pod \"node-exporter-4s85b\" (UID: \"692752da-6638-487b-80ea-588592654ef1\") " pod="openshift-monitoring/node-exporter-4s85b"
Jul 15 13:16:10.688301 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:10.688095    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/692752da-6638-487b-80ea-588592654ef1-node-exporter-accelerators-collector-config\") pod \"node-exporter-4s85b\" (UID: \"692752da-6638-487b-80ea-588592654ef1\") " pod="openshift-monitoring/node-exporter-4s85b"
Jul 15 13:16:10.688301 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:10.688131    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/692752da-6638-487b-80ea-588592654ef1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4s85b\" (UID: \"692752da-6638-487b-80ea-588592654ef1\") " pod="openshift-monitoring/node-exporter-4s85b"
Jul 15 13:16:10.688301 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:10.688160    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/692752da-6638-487b-80ea-588592654ef1-node-exporter-wtmp\") pod \"node-exporter-4s85b\" (UID: \"692752da-6638-487b-80ea-588592654ef1\") " pod="openshift-monitoring/node-exporter-4s85b"
Jul 15 13:16:10.688301 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:10.688198    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/692752da-6638-487b-80ea-588592654ef1-sys\") pod \"node-exporter-4s85b\" (UID: \"692752da-6638-487b-80ea-588592654ef1\") " pod="openshift-monitoring/node-exporter-4s85b"
Jul 15 13:16:10.688301 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:10.688237    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/692752da-6638-487b-80ea-588592654ef1-root\") pod \"node-exporter-4s85b\" (UID: \"692752da-6638-487b-80ea-588592654ef1\") " pod="openshift-monitoring/node-exporter-4s85b"
Jul 15 13:16:10.789528 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:10.789496    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/692752da-6638-487b-80ea-588592654ef1-node-exporter-textfile\") pod \"node-exporter-4s85b\" (UID: \"692752da-6638-487b-80ea-588592654ef1\") " pod="openshift-monitoring/node-exporter-4s85b"
Jul 15 13:16:10.789713 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:10.789542    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vknc\" (UniqueName: \"kubernetes.io/projected/692752da-6638-487b-80ea-588592654ef1-kube-api-access-2vknc\") pod \"node-exporter-4s85b\" (UID: \"692752da-6638-487b-80ea-588592654ef1\") " pod="openshift-monitoring/node-exporter-4s85b"
Jul 15 13:16:10.789713 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:10.789573    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/692752da-6638-487b-80ea-588592654ef1-metrics-client-ca\") pod \"node-exporter-4s85b\" (UID: \"692752da-6638-487b-80ea-588592654ef1\") " pod="openshift-monitoring/node-exporter-4s85b"
Jul 15 13:16:10.789713 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:10.789629    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/692752da-6638-487b-80ea-588592654ef1-node-exporter-tls\") pod \"node-exporter-4s85b\" (UID: \"692752da-6638-487b-80ea-588592654ef1\") " pod="openshift-monitoring/node-exporter-4s85b"
Jul 15 13:16:10.789713 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:10.789681    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/692752da-6638-487b-80ea-588592654ef1-node-exporter-accelerators-collector-config\") pod \"node-exporter-4s85b\" (UID: \"692752da-6638-487b-80ea-588592654ef1\") " pod="openshift-monitoring/node-exporter-4s85b"
Jul 15 13:16:10.789923 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:10.789716    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/692752da-6638-487b-80ea-588592654ef1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4s85b\" (UID: \"692752da-6638-487b-80ea-588592654ef1\") " pod="openshift-monitoring/node-exporter-4s85b"
Jul 15 13:16:10.789923 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:10.789750    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/692752da-6638-487b-80ea-588592654ef1-node-exporter-wtmp\") pod \"node-exporter-4s85b\" (UID: \"692752da-6638-487b-80ea-588592654ef1\") " pod="openshift-monitoring/node-exporter-4s85b"
Jul 15 13:16:10.789923 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:10.789794    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/692752da-6638-487b-80ea-588592654ef1-sys\") pod \"node-exporter-4s85b\" (UID: \"692752da-6638-487b-80ea-588592654ef1\") " pod="openshift-monitoring/node-exporter-4s85b"
Jul 15 13:16:10.789923 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:10.789831    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/692752da-6638-487b-80ea-588592654ef1-root\") pod \"node-exporter-4s85b\" (UID: \"692752da-6638-487b-80ea-588592654ef1\") " pod="openshift-monitoring/node-exporter-4s85b"
Jul 15 13:16:10.789923 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:10.789909    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/692752da-6638-487b-80ea-588592654ef1-root\") pod \"node-exporter-4s85b\" (UID: \"692752da-6638-487b-80ea-588592654ef1\") " pod="openshift-monitoring/node-exporter-4s85b"
Jul 15 13:16:10.790153 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:10.789954    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/692752da-6638-487b-80ea-588592654ef1-sys\") pod \"node-exporter-4s85b\" (UID: \"692752da-6638-487b-80ea-588592654ef1\") " pod="openshift-monitoring/node-exporter-4s85b"
Jul 15 13:16:10.790153 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:10.789910    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/692752da-6638-487b-80ea-588592654ef1-node-exporter-textfile\") pod \"node-exporter-4s85b\" (UID: \"692752da-6638-487b-80ea-588592654ef1\") " pod="openshift-monitoring/node-exporter-4s85b"
Jul 15 13:16:10.790153 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:10.790012    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/692752da-6638-487b-80ea-588592654ef1-node-exporter-wtmp\") pod \"node-exporter-4s85b\" (UID: \"692752da-6638-487b-80ea-588592654ef1\") " pod="openshift-monitoring/node-exporter-4s85b"
Jul 15 13:16:10.790494 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:10.790462    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/692752da-6638-487b-80ea-588592654ef1-metrics-client-ca\") pod \"node-exporter-4s85b\" (UID: \"692752da-6638-487b-80ea-588592654ef1\") " pod="openshift-monitoring/node-exporter-4s85b"
Jul 15 13:16:10.790588 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:10.790512    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/692752da-6638-487b-80ea-588592654ef1-node-exporter-accelerators-collector-config\") pod \"node-exporter-4s85b\" (UID: \"692752da-6638-487b-80ea-588592654ef1\") " pod="openshift-monitoring/node-exporter-4s85b"
Jul 15 13:16:10.792583 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:10.792556    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/692752da-6638-487b-80ea-588592654ef1-node-exporter-tls\") pod \"node-exporter-4s85b\" (UID: \"692752da-6638-487b-80ea-588592654ef1\") " pod="openshift-monitoring/node-exporter-4s85b"
Jul 15 13:16:10.792681 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:10.792631    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/692752da-6638-487b-80ea-588592654ef1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4s85b\" (UID: \"692752da-6638-487b-80ea-588592654ef1\") " pod="openshift-monitoring/node-exporter-4s85b"
Jul 15 13:16:10.806641 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:10.806582    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vknc\" (UniqueName: \"kubernetes.io/projected/692752da-6638-487b-80ea-588592654ef1-kube-api-access-2vknc\") pod \"node-exporter-4s85b\" (UID: \"692752da-6638-487b-80ea-588592654ef1\") " pod="openshift-monitoring/node-exporter-4s85b"
Jul 15 13:16:10.864692 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:10.864656    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4s85b"
Jul 15 13:16:10.877837 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:16:10.877813    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod692752da_6638_487b_80ea_588592654ef1.slice/crio-fdb67a16b4df7a83e1692963093509a72bdb3fa82c40525e3b37c054bf886057 WatchSource:0}: Error finding container fdb67a16b4df7a83e1692963093509a72bdb3fa82c40525e3b37c054bf886057: Status 404 returned error can't find the container with id fdb67a16b4df7a83e1692963093509a72bdb3fa82c40525e3b37c054bf886057
Jul 15 13:16:11.235860 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:11.235823    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4s85b" event={"ID":"692752da-6638-487b-80ea-588592654ef1","Type":"ContainerStarted","Data":"fdb67a16b4df7a83e1692963093509a72bdb3fa82c40525e3b37c054bf886057"}
Jul 15 13:16:13.245333 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:13.245294    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wqxcc" event={"ID":"6b061bb5-718d-4fed-9076-9668e21d4b13","Type":"ContainerStarted","Data":"3617ff16c2609689234fe4a5c18b630873b8037a44758695aae6bac91d56839c"}
Jul 15 13:16:13.245775 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:13.245350    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wqxcc" event={"ID":"6b061bb5-718d-4fed-9076-9668e21d4b13","Type":"ContainerStarted","Data":"db951305f8a1ea6f901e1e8f17d0c28cf8869308359a19df51f2a50ae4ddb485"}
Jul 15 13:16:13.245775 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:13.245399    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wqxcc"
Jul 15 13:16:13.246879 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:13.246856    2578 generic.go:356] "Generic (PLEG): container finished" podID="692752da-6638-487b-80ea-588592654ef1" containerID="9c6f1767f20f0659a75df9c3861241fe483f9bbabe220cb65db6158842c9cbb4" exitCode=0
Jul 15 13:16:13.246992 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:13.246945    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4s85b" event={"ID":"692752da-6638-487b-80ea-588592654ef1","Type":"ContainerDied","Data":"9c6f1767f20f0659a75df9c3861241fe483f9bbabe220cb65db6158842c9cbb4"}
Jul 15 13:16:13.270338 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:13.270292    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-wqxcc" podStartSLOduration=251.635769901 podStartE2EDuration="4m16.270271931s" totalImagesPullingTime="4.63450203s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:11:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:16:13.269534559 +0000 UTC m=+293.357321493" watchObservedRunningTime="2026-07-15 13:16:13.270271931 +0000 UTC m=+293.358058875"
Jul 15 13:16:13.335108 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:13.335082    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5856457484-mw9wc"]
Jul 15 13:16:13.338384 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:13.338366    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5856457484-mw9wc"
Jul 15 13:16:13.341674 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:13.341652    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 15 13:16:13.341777 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:13.341662    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 15 13:16:13.341777 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:13.341753    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 15 13:16:13.346721 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:13.343806    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 15 13:16:13.346721 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:13.344088    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 15 13:16:13.346721 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:13.344326    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 15 13:16:13.346721 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:13.344343    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 15 13:16:13.346721 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:13.344600    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-dhdpv\""
Jul 15 13:16:13.350020 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:13.350000    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 15 13:16:13.351323 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:13.351300    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5856457484-mw9wc"]
Jul 15 13:16:13.513163 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:13.513073    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4a31575-93d4-4ae9-9821-43f6d784c5fd-trusted-ca-bundle\") pod \"console-5856457484-mw9wc\" (UID: \"d4a31575-93d4-4ae9-9821-43f6d784c5fd\") " pod="openshift-console/console-5856457484-mw9wc"
Jul 15 13:16:13.513334 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:13.513166    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d4a31575-93d4-4ae9-9821-43f6d784c5fd-oauth-serving-cert\") pod \"console-5856457484-mw9wc\" (UID: \"d4a31575-93d4-4ae9-9821-43f6d784c5fd\") " pod="openshift-console/console-5856457484-mw9wc"
Jul 15 13:16:13.513334 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:13.513240    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d4a31575-93d4-4ae9-9821-43f6d784c5fd-console-serving-cert\") pod \"console-5856457484-mw9wc\" (UID: \"d4a31575-93d4-4ae9-9821-43f6d784c5fd\") " pod="openshift-console/console-5856457484-mw9wc"
Jul 15 13:16:13.513334 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:13.513288    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d4a31575-93d4-4ae9-9821-43f6d784c5fd-service-ca\") pod \"console-5856457484-mw9wc\" (UID: \"d4a31575-93d4-4ae9-9821-43f6d784c5fd\") " pod="openshift-console/console-5856457484-mw9wc"
Jul 15 13:16:13.513334 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:13.513314    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d4a31575-93d4-4ae9-9821-43f6d784c5fd-console-config\") pod \"console-5856457484-mw9wc\" (UID: \"d4a31575-93d4-4ae9-9821-43f6d784c5fd\") " pod="openshift-console/console-5856457484-mw9wc"
Jul 15 13:16:13.513489 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:13.513352    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnxmt\" (UniqueName: \"kubernetes.io/projected/d4a31575-93d4-4ae9-9821-43f6d784c5fd-kube-api-access-qnxmt\") pod \"console-5856457484-mw9wc\" (UID: \"d4a31575-93d4-4ae9-9821-43f6d784c5fd\") " pod="openshift-console/console-5856457484-mw9wc"
Jul 15 13:16:13.513489 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:13.513374    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d4a31575-93d4-4ae9-9821-43f6d784c5fd-console-oauth-config\") pod \"console-5856457484-mw9wc\" (UID: \"d4a31575-93d4-4ae9-9821-43f6d784c5fd\") " pod="openshift-console/console-5856457484-mw9wc"
Jul 15 13:16:13.614483 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:13.614441    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d4a31575-93d4-4ae9-9821-43f6d784c5fd-service-ca\") pod \"console-5856457484-mw9wc\" (UID: \"d4a31575-93d4-4ae9-9821-43f6d784c5fd\") " pod="openshift-console/console-5856457484-mw9wc"
Jul 15 13:16:13.614641 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:13.614492    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d4a31575-93d4-4ae9-9821-43f6d784c5fd-console-config\") pod \"console-5856457484-mw9wc\" (UID: \"d4a31575-93d4-4ae9-9821-43f6d784c5fd\") " pod="openshift-console/console-5856457484-mw9wc"
Jul 15 13:16:13.614641 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:13.614527    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnxmt\" (UniqueName: \"kubernetes.io/projected/d4a31575-93d4-4ae9-9821-43f6d784c5fd-kube-api-access-qnxmt\") pod \"console-5856457484-mw9wc\" (UID: \"d4a31575-93d4-4ae9-9821-43f6d784c5fd\") " pod="openshift-console/console-5856457484-mw9wc"
Jul 15 13:16:13.614641 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:13.614554    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d4a31575-93d4-4ae9-9821-43f6d784c5fd-console-oauth-config\") pod \"console-5856457484-mw9wc\" (UID: \"d4a31575-93d4-4ae9-9821-43f6d784c5fd\") " pod="openshift-console/console-5856457484-mw9wc"
Jul 15 13:16:13.614641 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:13.614599    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4a31575-93d4-4ae9-9821-43f6d784c5fd-trusted-ca-bundle\") pod \"console-5856457484-mw9wc\" (UID: \"d4a31575-93d4-4ae9-9821-43f6d784c5fd\") " pod="openshift-console/console-5856457484-mw9wc"
Jul 15 13:16:13.614860 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:13.614650    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d4a31575-93d4-4ae9-9821-43f6d784c5fd-oauth-serving-cert\") pod \"console-5856457484-mw9wc\" (UID: \"d4a31575-93d4-4ae9-9821-43f6d784c5fd\") " pod="openshift-console/console-5856457484-mw9wc"
Jul 15 13:16:13.614860 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:13.614685    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d4a31575-93d4-4ae9-9821-43f6d784c5fd-console-serving-cert\") pod \"console-5856457484-mw9wc\" (UID: \"d4a31575-93d4-4ae9-9821-43f6d784c5fd\") " pod="openshift-console/console-5856457484-mw9wc"
Jul 15 13:16:13.615404 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:13.615376    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d4a31575-93d4-4ae9-9821-43f6d784c5fd-service-ca\") pod \"console-5856457484-mw9wc\" (UID: \"d4a31575-93d4-4ae9-9821-43f6d784c5fd\") " pod="openshift-console/console-5856457484-mw9wc"
Jul 15 13:16:13.615551 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:13.615417    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d4a31575-93d4-4ae9-9821-43f6d784c5fd-console-config\") pod \"console-5856457484-mw9wc\" (UID: \"d4a31575-93d4-4ae9-9821-43f6d784c5fd\") " pod="openshift-console/console-5856457484-mw9wc"
Jul 15 13:16:13.615551 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:13.615417    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d4a31575-93d4-4ae9-9821-43f6d784c5fd-oauth-serving-cert\") pod \"console-5856457484-mw9wc\" (UID: \"d4a31575-93d4-4ae9-9821-43f6d784c5fd\") " pod="openshift-console/console-5856457484-mw9wc"
Jul 15 13:16:13.615551 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:13.615488    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4a31575-93d4-4ae9-9821-43f6d784c5fd-trusted-ca-bundle\") pod \"console-5856457484-mw9wc\" (UID: \"d4a31575-93d4-4ae9-9821-43f6d784c5fd\") " pod="openshift-console/console-5856457484-mw9wc"
Jul 15 13:16:13.617046 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:13.617013    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d4a31575-93d4-4ae9-9821-43f6d784c5fd-console-oauth-config\") pod \"console-5856457484-mw9wc\" (UID: \"d4a31575-93d4-4ae9-9821-43f6d784c5fd\") " pod="openshift-console/console-5856457484-mw9wc"
Jul 15 13:16:13.617136 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:13.617119    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d4a31575-93d4-4ae9-9821-43f6d784c5fd-console-serving-cert\") pod \"console-5856457484-mw9wc\" (UID: \"d4a31575-93d4-4ae9-9821-43f6d784c5fd\") " pod="openshift-console/console-5856457484-mw9wc"
Jul 15 13:16:13.624827 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:13.624804    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnxmt\" (UniqueName: \"kubernetes.io/projected/d4a31575-93d4-4ae9-9821-43f6d784c5fd-kube-api-access-qnxmt\") pod \"console-5856457484-mw9wc\" (UID: \"d4a31575-93d4-4ae9-9821-43f6d784c5fd\") " pod="openshift-console/console-5856457484-mw9wc"
Jul 15 13:16:13.670949 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:13.670922    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5856457484-mw9wc"
Jul 15 13:16:13.801138 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:13.801112    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5856457484-mw9wc"]
Jul 15 13:16:13.803402 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:16:13.803368    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4a31575_93d4_4ae9_9821_43f6d784c5fd.slice/crio-94dd20a52c2c631028c01cf454387c68a6056480a03216ad428e04fd02d04a38 WatchSource:0}: Error finding container 94dd20a52c2c631028c01cf454387c68a6056480a03216ad428e04fd02d04a38: Status 404 returned error can't find the container with id 94dd20a52c2c631028c01cf454387c68a6056480a03216ad428e04fd02d04a38
Jul 15 13:16:14.253992 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:14.253947    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4s85b" event={"ID":"692752da-6638-487b-80ea-588592654ef1","Type":"ContainerStarted","Data":"f0d6b71293146f0fb42ec2ebf88954324765787e38d55bd21065aa5e3eddf681"}
Jul 15 13:16:14.254487 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:14.254029    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4s85b" event={"ID":"692752da-6638-487b-80ea-588592654ef1","Type":"ContainerStarted","Data":"73d8922df919a76ef8b0ae54bd547dc29129b84656809134eeb03f5a5181c425"}
Jul 15 13:16:14.255492 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:14.255458    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5856457484-mw9wc" event={"ID":"d4a31575-93d4-4ae9-9821-43f6d784c5fd","Type":"ContainerStarted","Data":"94dd20a52c2c631028c01cf454387c68a6056480a03216ad428e04fd02d04a38"}
Jul 15 13:16:14.278693 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:14.278642    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4s85b" podStartSLOduration=2.7775815 podStartE2EDuration="4.278622511s" totalImagesPullingTime="1.423888065s" totalInitContainerRuntime="77.152946ms" isStatefulPod=true podCreationTimestamp="2026-07-15 13:16:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:16:14.277687824 +0000 UTC m=+294.365474766" watchObservedRunningTime="2026-07-15 13:16:14.278622511 +0000 UTC m=+294.366409456"
Jul 15 13:16:14.789784 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:14.789751    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7f5749f9c8-kdckd"]
Jul 15 13:16:14.793143 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:14.793120    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7f5749f9c8-kdckd"
Jul 15 13:16:14.796057 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:14.796020    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 15 13:16:14.797486 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:14.797453    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 15 13:16:14.797601 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:14.797491    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-9rqetfakqcajl\""
Jul 15 13:16:14.797601 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:14.797521    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 15 13:16:14.797601 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:14.797539    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-pv248\""
Jul 15 13:16:14.797601 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:14.797453    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 15 13:16:14.805115 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:14.805091    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7f5749f9c8-kdckd"]
Jul 15 13:16:14.927165 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:14.927127    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mn7m\" (UniqueName: \"kubernetes.io/projected/94c7361e-367a-4ff2-a93d-0dd75ae177ea-kube-api-access-9mn7m\") pod \"metrics-server-7f5749f9c8-kdckd\" (UID: \"94c7361e-367a-4ff2-a93d-0dd75ae177ea\") " pod="openshift-monitoring/metrics-server-7f5749f9c8-kdckd"
Jul 15 13:16:14.927345 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:14.927193    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94c7361e-367a-4ff2-a93d-0dd75ae177ea-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7f5749f9c8-kdckd\" (UID: \"94c7361e-367a-4ff2-a93d-0dd75ae177ea\") " pod="openshift-monitoring/metrics-server-7f5749f9c8-kdckd"
Jul 15 13:16:14.927345 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:14.927272    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/94c7361e-367a-4ff2-a93d-0dd75ae177ea-client-ca-bundle\") pod \"metrics-server-7f5749f9c8-kdckd\" (UID: \"94c7361e-367a-4ff2-a93d-0dd75ae177ea\") " pod="openshift-monitoring/metrics-server-7f5749f9c8-kdckd"
Jul 15 13:16:14.927345 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:14.927300    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/94c7361e-367a-4ff2-a93d-0dd75ae177ea-audit-log\") pod \"metrics-server-7f5749f9c8-kdckd\" (UID: \"94c7361e-367a-4ff2-a93d-0dd75ae177ea\") " pod="openshift-monitoring/metrics-server-7f5749f9c8-kdckd"
Jul 15 13:16:14.927345 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:14.927324    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/94c7361e-367a-4ff2-a93d-0dd75ae177ea-secret-metrics-server-tls\") pod \"metrics-server-7f5749f9c8-kdckd\" (UID: \"94c7361e-367a-4ff2-a93d-0dd75ae177ea\") " pod="openshift-monitoring/metrics-server-7f5749f9c8-kdckd"
Jul 15 13:16:14.927540 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:14.927347    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/94c7361e-367a-4ff2-a93d-0dd75ae177ea-metrics-server-audit-profiles\") pod \"metrics-server-7f5749f9c8-kdckd\" (UID: \"94c7361e-367a-4ff2-a93d-0dd75ae177ea\") " pod="openshift-monitoring/metrics-server-7f5749f9c8-kdckd"
Jul 15 13:16:14.927540 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:14.927396    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/94c7361e-367a-4ff2-a93d-0dd75ae177ea-secret-metrics-server-client-certs\") pod \"metrics-server-7f5749f9c8-kdckd\" (UID: \"94c7361e-367a-4ff2-a93d-0dd75ae177ea\") " pod="openshift-monitoring/metrics-server-7f5749f9c8-kdckd"
Jul 15 13:16:15.028045 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:15.028003    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mn7m\" (UniqueName: \"kubernetes.io/projected/94c7361e-367a-4ff2-a93d-0dd75ae177ea-kube-api-access-9mn7m\") pod \"metrics-server-7f5749f9c8-kdckd\" (UID: \"94c7361e-367a-4ff2-a93d-0dd75ae177ea\") " pod="openshift-monitoring/metrics-server-7f5749f9c8-kdckd"
Jul 15 13:16:15.028229 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:15.028065    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94c7361e-367a-4ff2-a93d-0dd75ae177ea-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7f5749f9c8-kdckd\" (UID: \"94c7361e-367a-4ff2-a93d-0dd75ae177ea\") " pod="openshift-monitoring/metrics-server-7f5749f9c8-kdckd"
Jul 15 13:16:15.028229 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:15.028104    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/94c7361e-367a-4ff2-a93d-0dd75ae177ea-client-ca-bundle\") pod \"metrics-server-7f5749f9c8-kdckd\" (UID: \"94c7361e-367a-4ff2-a93d-0dd75ae177ea\") " pod="openshift-monitoring/metrics-server-7f5749f9c8-kdckd"
Jul 15 13:16:15.028229 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:15.028126    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/94c7361e-367a-4ff2-a93d-0dd75ae177ea-audit-log\") pod \"metrics-server-7f5749f9c8-kdckd\" (UID: \"94c7361e-367a-4ff2-a93d-0dd75ae177ea\") " pod="openshift-monitoring/metrics-server-7f5749f9c8-kdckd"
Jul 15 13:16:15.028229 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:15.028157    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/94c7361e-367a-4ff2-a93d-0dd75ae177ea-secret-metrics-server-tls\") pod \"metrics-server-7f5749f9c8-kdckd\" (UID: \"94c7361e-367a-4ff2-a93d-0dd75ae177ea\") " pod="openshift-monitoring/metrics-server-7f5749f9c8-kdckd"
Jul 15 13:16:15.028229 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:15.028181    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/94c7361e-367a-4ff2-a93d-0dd75ae177ea-metrics-server-audit-profiles\") pod \"metrics-server-7f5749f9c8-kdckd\" (UID: \"94c7361e-367a-4ff2-a93d-0dd75ae177ea\") " pod="openshift-monitoring/metrics-server-7f5749f9c8-kdckd"
Jul 15 13:16:15.028490 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:15.028237    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/94c7361e-367a-4ff2-a93d-0dd75ae177ea-secret-metrics-server-client-certs\") pod \"metrics-server-7f5749f9c8-kdckd\" (UID: \"94c7361e-367a-4ff2-a93d-0dd75ae177ea\") " pod="openshift-monitoring/metrics-server-7f5749f9c8-kdckd"
Jul 15 13:16:15.028808 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:15.028782    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/94c7361e-367a-4ff2-a93d-0dd75ae177ea-audit-log\") pod \"metrics-server-7f5749f9c8-kdckd\" (UID: \"94c7361e-367a-4ff2-a93d-0dd75ae177ea\") " pod="openshift-monitoring/metrics-server-7f5749f9c8-kdckd"
Jul 15 13:16:15.028944 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:15.028925    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94c7361e-367a-4ff2-a93d-0dd75ae177ea-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7f5749f9c8-kdckd\" (UID: \"94c7361e-367a-4ff2-a93d-0dd75ae177ea\") " pod="openshift-monitoring/metrics-server-7f5749f9c8-kdckd"
Jul 15 13:16:15.029480 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:15.029451    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/94c7361e-367a-4ff2-a93d-0dd75ae177ea-metrics-server-audit-profiles\") pod \"metrics-server-7f5749f9c8-kdckd\" (UID: \"94c7361e-367a-4ff2-a93d-0dd75ae177ea\") " pod="openshift-monitoring/metrics-server-7f5749f9c8-kdckd"
Jul 15 13:16:15.031055 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:15.031029    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/94c7361e-367a-4ff2-a93d-0dd75ae177ea-secret-metrics-server-client-certs\") pod \"metrics-server-7f5749f9c8-kdckd\" (UID: \"94c7361e-367a-4ff2-a93d-0dd75ae177ea\") " pod="openshift-monitoring/metrics-server-7f5749f9c8-kdckd"
Jul 15 13:16:15.031133 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:15.031065    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/94c7361e-367a-4ff2-a93d-0dd75ae177ea-secret-metrics-server-tls\") pod \"metrics-server-7f5749f9c8-kdckd\" (UID: \"94c7361e-367a-4ff2-a93d-0dd75ae177ea\") " pod="openshift-monitoring/metrics-server-7f5749f9c8-kdckd"
Jul 15 13:16:15.031133 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:15.031088    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/94c7361e-367a-4ff2-a93d-0dd75ae177ea-client-ca-bundle\") pod \"metrics-server-7f5749f9c8-kdckd\" (UID: \"94c7361e-367a-4ff2-a93d-0dd75ae177ea\") " pod="openshift-monitoring/metrics-server-7f5749f9c8-kdckd"
Jul 15 13:16:15.037853 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:15.037832    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mn7m\" (UniqueName: \"kubernetes.io/projected/94c7361e-367a-4ff2-a93d-0dd75ae177ea-kube-api-access-9mn7m\") pod \"metrics-server-7f5749f9c8-kdckd\" (UID: \"94c7361e-367a-4ff2-a93d-0dd75ae177ea\") " pod="openshift-monitoring/metrics-server-7f5749f9c8-kdckd"
Jul 15 13:16:15.104811 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:15.104696    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7f5749f9c8-kdckd"
Jul 15 13:16:15.205792 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:15.205756    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-t2tnc"]
Jul 15 13:16:15.214314 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:15.213526    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-t2tnc"
Jul 15 13:16:15.218360 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:15.218296    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 15 13:16:15.218360 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:15.218342    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-phmn9\""
Jul 15 13:16:15.222581 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:15.221197    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-t2tnc"]
Jul 15 13:16:15.273138 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:15.273098    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7f5749f9c8-kdckd"]
Jul 15 13:16:15.276398 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:16:15.276372    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94c7361e_367a_4ff2_a93d_0dd75ae177ea.slice/crio-5cc5803e0ff48bc237356cf21bf27e022776f5745a8aef72025841661fa2d0f0 WatchSource:0}: Error finding container 5cc5803e0ff48bc237356cf21bf27e022776f5745a8aef72025841661fa2d0f0: Status 404 returned error can't find the container with id 5cc5803e0ff48bc237356cf21bf27e022776f5745a8aef72025841661fa2d0f0
Jul 15 13:16:15.331313 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:15.331282    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/deaf0540-4a33-44b6-9fe7-adc58510c7b8-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-t2tnc\" (UID: \"deaf0540-4a33-44b6-9fe7-adc58510c7b8\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-t2tnc"
Jul 15 13:16:15.331473 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:15.331337    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwhrs\" (UniqueName: \"kubernetes.io/projected/deaf0540-4a33-44b6-9fe7-adc58510c7b8-kube-api-access-fwhrs\") pod \"monitoring-plugin-5f68df7f58-t2tnc\" (UID: \"deaf0540-4a33-44b6-9fe7-adc58510c7b8\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-t2tnc"
Jul 15 13:16:15.431894 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:15.431802    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/deaf0540-4a33-44b6-9fe7-adc58510c7b8-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-t2tnc\" (UID: \"deaf0540-4a33-44b6-9fe7-adc58510c7b8\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-t2tnc"
Jul 15 13:16:15.431894 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:15.431864    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwhrs\" (UniqueName: \"kubernetes.io/projected/deaf0540-4a33-44b6-9fe7-adc58510c7b8-kube-api-access-fwhrs\") pod \"monitoring-plugin-5f68df7f58-t2tnc\" (UID: \"deaf0540-4a33-44b6-9fe7-adc58510c7b8\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-t2tnc"
Jul 15 13:16:15.432108 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:16:15.431971    2578 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 15 13:16:15.432108 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:16:15.432044    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/deaf0540-4a33-44b6-9fe7-adc58510c7b8-monitoring-plugin-cert podName:deaf0540-4a33-44b6-9fe7-adc58510c7b8 nodeName:}" failed. No retries permitted until 2026-07-15 13:16:15.932022301 +0000 UTC m=+296.019809224 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/deaf0540-4a33-44b6-9fe7-adc58510c7b8-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-t2tnc" (UID: "deaf0540-4a33-44b6-9fe7-adc58510c7b8") : secret "monitoring-plugin-cert" not found
Jul 15 13:16:15.442749 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:15.442724    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwhrs\" (UniqueName: \"kubernetes.io/projected/deaf0540-4a33-44b6-9fe7-adc58510c7b8-kube-api-access-fwhrs\") pod \"monitoring-plugin-5f68df7f58-t2tnc\" (UID: \"deaf0540-4a33-44b6-9fe7-adc58510c7b8\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-t2tnc"
Jul 15 13:16:15.938438 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:15.938392    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/deaf0540-4a33-44b6-9fe7-adc58510c7b8-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-t2tnc\" (UID: \"deaf0540-4a33-44b6-9fe7-adc58510c7b8\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-t2tnc"
Jul 15 13:16:15.941157 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:15.941130    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/deaf0540-4a33-44b6-9fe7-adc58510c7b8-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-t2tnc\" (UID: \"deaf0540-4a33-44b6-9fe7-adc58510c7b8\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-t2tnc"
Jul 15 13:16:16.126261 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:16.126230    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-t2tnc"
Jul 15 13:16:16.265642 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:16.265609    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7f5749f9c8-kdckd" event={"ID":"94c7361e-367a-4ff2-a93d-0dd75ae177ea","Type":"ContainerStarted","Data":"5cc5803e0ff48bc237356cf21bf27e022776f5745a8aef72025841661fa2d0f0"}
Jul 15 13:16:16.370647 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:16:16.370600    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-czmkz" podUID="c2029ab2-4966-4b8c-ba6c-e69cf982a372"
Jul 15 13:16:16.475962 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:16.475932    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-t2tnc"]
Jul 15 13:16:16.478759 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:16:16.478730    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddeaf0540_4a33_44b6_9fe7_adc58510c7b8.slice/crio-ae5c3c2930059371bdd89d155733426100756853ab55e7c10209aff1de7b7f75 WatchSource:0}: Error finding container ae5c3c2930059371bdd89d155733426100756853ab55e7c10209aff1de7b7f75: Status 404 returned error can't find the container with id ae5c3c2930059371bdd89d155733426100756853ab55e7c10209aff1de7b7f75
Jul 15 13:16:17.275161 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:17.274849    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5856457484-mw9wc" event={"ID":"d4a31575-93d4-4ae9-9821-43f6d784c5fd","Type":"ContainerStarted","Data":"40154e67e998601b1a464fe85cc9b420f35b4d955b8d0b8e638e3c7498ce86dc"}
Jul 15 13:16:17.276814 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:17.276773    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-t2tnc" event={"ID":"deaf0540-4a33-44b6-9fe7-adc58510c7b8","Type":"ContainerStarted","Data":"ae5c3c2930059371bdd89d155733426100756853ab55e7c10209aff1de7b7f75"}
Jul 15 13:16:17.303017 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:17.302960    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5856457484-mw9wc" podStartSLOduration=1.711469683 podStartE2EDuration="4.302940235s" totalImagesPullingTime="2.591470552s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:16:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:16:17.302238892 +0000 UTC m=+297.390025834" watchObservedRunningTime="2026-07-15 13:16:17.302940235 +0000 UTC m=+297.390727179"
Jul 15 13:16:18.282856 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:18.282820    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7f5749f9c8-kdckd" event={"ID":"94c7361e-367a-4ff2-a93d-0dd75ae177ea","Type":"ContainerStarted","Data":"37db0c4da15e935dbef2433300d9491f5e5e7abc2ac63504279cff4da879e6a3"}
Jul 15 13:16:18.284530 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:18.284490    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-t2tnc" event={"ID":"deaf0540-4a33-44b6-9fe7-adc58510c7b8","Type":"ContainerStarted","Data":"e23d7eb3ab5830df687f8776ce252ea694c6aa7c9976f18536cab59ff2ee44b4"}
Jul 15 13:16:18.303614 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:18.303566    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7f5749f9c8-kdckd" podStartSLOduration=1.7645772929999999 podStartE2EDuration="4.303551233s" totalImagesPullingTime="2.53897394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:16:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:16:18.302238597 +0000 UTC m=+298.390025538" watchObservedRunningTime="2026-07-15 13:16:18.303551233 +0000 UTC m=+298.391338174"
Jul 15 13:16:18.321635 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:18.321591    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-t2tnc" podStartSLOduration=1.982296778 podStartE2EDuration="3.321577237s" totalImagesPullingTime="1.339280459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:16:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:16:18.319873397 +0000 UTC m=+298.407660342" watchObservedRunningTime="2026-07-15 13:16:18.321577237 +0000 UTC m=+298.409364179"
Jul 15 13:16:19.287943 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:19.287906    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-t2tnc"
Jul 15 13:16:19.292560 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:19.292538    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-t2tnc"
Jul 15 13:16:20.259871 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:20.259842    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-t4bfh_c21b11d6-3242-4dd5-8b75-74dad14868e9/console-operator/1.log"
Jul 15 13:16:20.260688 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:20.260664    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-t4bfh_c21b11d6-3242-4dd5-8b75-74dad14868e9/console-operator/1.log"
Jul 15 13:16:20.264099 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:20.264074    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt6q4_49ca8630-3cc0-4dbb-8c80-a948ad0de2b4/ovn-acl-logging/0.log"
Jul 15 13:16:20.264923 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:20.264904    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt6q4_49ca8630-3cc0-4dbb-8c80-a948ad0de2b4/ovn-acl-logging/0.log"
Jul 15 13:16:20.271298 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:20.271279    2578 kubelet.go:1648] "Image garbage collection succeeded"
Jul 15 13:16:23.258380 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:23.258345    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wqxcc"
Jul 15 13:16:23.671638 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:23.671551    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5856457484-mw9wc"
Jul 15 13:16:23.671638 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:23.671632    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5856457484-mw9wc"
Jul 15 13:16:23.673093 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:23.673069    2578 patch_prober.go:28] interesting pod/console-5856457484-mw9wc container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.20:8443/health\": dial tcp 10.132.0.20:8443: connect: connection refused" start-of-body=
Jul 15 13:16:23.673224 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:23.673121    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5856457484-mw9wc" podUID="d4a31575-93d4-4ae9-9821-43f6d784c5fd" containerName="console" probeResult="failure" output="Get \"https://10.132.0.20:8443/health\": dial tcp 10.132.0.20:8443: connect: connection refused"
Jul 15 13:16:27.385905 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:27.385870    2578 patch_prober.go:28] interesting pod/image-registry-6d4ff848df-v8kpc container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 15 13:16:27.386308 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:27.385916    2578 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6d4ff848df-v8kpc" podUID="91ab3ba4-74ad-465b-8f66-eaafd1b66e40" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 13:16:27.623961 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:27.623927    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6d4ff848df-v8kpc"]
Jul 15 13:16:27.628352 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:27.628325    2578 patch_prober.go:28] interesting pod/image-registry-6d4ff848df-v8kpc container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 15 13:16:27.628486 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:27.628364    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6d4ff848df-v8kpc" podUID="91ab3ba4-74ad-465b-8f66-eaafd1b66e40" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 13:16:28.777701 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:28.777668    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5856457484-mw9wc"]
Jul 15 13:16:31.369712 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:31.369682    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-czmkz"
Jul 15 13:16:35.105894 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:35.105817    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7f5749f9c8-kdckd"
Jul 15 13:16:35.105894 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:35.105867    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7f5749f9c8-kdckd"
Jul 15 13:16:37.628301 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:37.628273    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6d4ff848df-v8kpc"
Jul 15 13:16:40.367229 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:40.367181    2578 generic.go:356] "Generic (PLEG): container finished" podID="a1a43adb-5124-4e7d-99d1-7c7eef0d6908" containerID="4b37356dd250ab9dde96994b770f87f7074191a633aea43efb137c53779f8e56" exitCode=0
Jul 15 13:16:40.367229 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:40.367230    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zzpw4" event={"ID":"a1a43adb-5124-4e7d-99d1-7c7eef0d6908","Type":"ContainerDied","Data":"4b37356dd250ab9dde96994b770f87f7074191a633aea43efb137c53779f8e56"}
Jul 15 13:16:40.367646 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:40.367524    2578 scope.go:117] "RemoveContainer" containerID="4b37356dd250ab9dde96994b770f87f7074191a633aea43efb137c53779f8e56"
Jul 15 13:16:41.372554 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:41.372521    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zzpw4" event={"ID":"a1a43adb-5124-4e7d-99d1-7c7eef0d6908","Type":"ContainerStarted","Data":"cb4395630a91a43719356c74fffc30f976f5032d2faeba120cf6082278a1cb1f"}
Jul 15 13:16:52.643663 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:52.643600    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6d4ff848df-v8kpc" podUID="91ab3ba4-74ad-465b-8f66-eaafd1b66e40" containerName="registry" containerID="cri-o://561ff7d56ceaac10c5c2b7e835434dbbf69d32f49c736f49610375395ccaf599" gracePeriod=30
Jul 15 13:16:52.878988 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:52.878964    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d4ff848df-v8kpc"
Jul 15 13:16:52.936727 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:52.936662    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-trusted-ca\") pod \"91ab3ba4-74ad-465b-8f66-eaafd1b66e40\" (UID: \"91ab3ba4-74ad-465b-8f66-eaafd1b66e40\") "
Jul 15 13:16:52.936727 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:52.936695    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-registry-certificates\") pod \"91ab3ba4-74ad-465b-8f66-eaafd1b66e40\" (UID: \"91ab3ba4-74ad-465b-8f66-eaafd1b66e40\") "
Jul 15 13:16:52.936896 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:52.936731    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-installation-pull-secrets\") pod \"91ab3ba4-74ad-465b-8f66-eaafd1b66e40\" (UID: \"91ab3ba4-74ad-465b-8f66-eaafd1b66e40\") "
Jul 15 13:16:52.936896 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:52.936775    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-image-registry-private-configuration\") pod \"91ab3ba4-74ad-465b-8f66-eaafd1b66e40\" (UID: \"91ab3ba4-74ad-465b-8f66-eaafd1b66e40\") "
Jul 15 13:16:52.936896 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:52.936798    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-registry-tls\") pod \"91ab3ba4-74ad-465b-8f66-eaafd1b66e40\" (UID: \"91ab3ba4-74ad-465b-8f66-eaafd1b66e40\") "
Jul 15 13:16:52.936896 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:52.936813    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hhp8h\" (UniqueName: \"kubernetes.io/projected/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-kube-api-access-hhp8h\") pod \"91ab3ba4-74ad-465b-8f66-eaafd1b66e40\" (UID: \"91ab3ba4-74ad-465b-8f66-eaafd1b66e40\") "
Jul 15 13:16:52.936896 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:52.936840    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-bound-sa-token\") pod \"91ab3ba4-74ad-465b-8f66-eaafd1b66e40\" (UID: \"91ab3ba4-74ad-465b-8f66-eaafd1b66e40\") "
Jul 15 13:16:52.936896 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:52.936878    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-ca-trust-extracted\") pod \"91ab3ba4-74ad-465b-8f66-eaafd1b66e40\" (UID: \"91ab3ba4-74ad-465b-8f66-eaafd1b66e40\") "
Jul 15 13:16:52.937185 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:52.937085    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "91ab3ba4-74ad-465b-8f66-eaafd1b66e40" (UID: "91ab3ba4-74ad-465b-8f66-eaafd1b66e40"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:16:52.937185 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:52.937106    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "91ab3ba4-74ad-465b-8f66-eaafd1b66e40" (UID: "91ab3ba4-74ad-465b-8f66-eaafd1b66e40"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:16:52.939352 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:52.939318    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-kube-api-access-hhp8h" (OuterVolumeSpecName: "kube-api-access-hhp8h") pod "91ab3ba4-74ad-465b-8f66-eaafd1b66e40" (UID: "91ab3ba4-74ad-465b-8f66-eaafd1b66e40"). InnerVolumeSpecName "kube-api-access-hhp8h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:16:52.939584 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:52.939559    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "91ab3ba4-74ad-465b-8f66-eaafd1b66e40" (UID: "91ab3ba4-74ad-465b-8f66-eaafd1b66e40"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:16:52.939691 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:52.939620    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "91ab3ba4-74ad-465b-8f66-eaafd1b66e40" (UID: "91ab3ba4-74ad-465b-8f66-eaafd1b66e40"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:16:52.939691 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:52.939665    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "91ab3ba4-74ad-465b-8f66-eaafd1b66e40" (UID: "91ab3ba4-74ad-465b-8f66-eaafd1b66e40"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:16:52.939771 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:52.939745    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "91ab3ba4-74ad-465b-8f66-eaafd1b66e40" (UID: "91ab3ba4-74ad-465b-8f66-eaafd1b66e40"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:16:52.945297 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:52.945271    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "91ab3ba4-74ad-465b-8f66-eaafd1b66e40" (UID: "91ab3ba4-74ad-465b-8f66-eaafd1b66e40"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:16:53.037431 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:53.037408    2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-image-registry-private-configuration\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:16:53.037431 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:53.037429    2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-registry-tls\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:16:53.037549 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:53.037439    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hhp8h\" (UniqueName: \"kubernetes.io/projected/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-kube-api-access-hhp8h\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:16:53.037549 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:53.037449    2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-bound-sa-token\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:16:53.037549 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:53.037457    2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-ca-trust-extracted\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:16:53.037549 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:53.037465    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-trusted-ca\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:16:53.037549 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:53.037474    2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-registry-certificates\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:16:53.037549 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:53.037481    2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/91ab3ba4-74ad-465b-8f66-eaafd1b66e40-installation-pull-secrets\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:16:53.412932 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:53.412895    2578 generic.go:356] "Generic (PLEG): container finished" podID="91ab3ba4-74ad-465b-8f66-eaafd1b66e40" containerID="561ff7d56ceaac10c5c2b7e835434dbbf69d32f49c736f49610375395ccaf599" exitCode=0
Jul 15 13:16:53.412932 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:53.412936    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d4ff848df-v8kpc"
Jul 15 13:16:53.413121 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:53.412978    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d4ff848df-v8kpc" event={"ID":"91ab3ba4-74ad-465b-8f66-eaafd1b66e40","Type":"ContainerDied","Data":"561ff7d56ceaac10c5c2b7e835434dbbf69d32f49c736f49610375395ccaf599"}
Jul 15 13:16:53.413121 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:53.413026    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d4ff848df-v8kpc" event={"ID":"91ab3ba4-74ad-465b-8f66-eaafd1b66e40","Type":"ContainerDied","Data":"ea9ec333f4d06b496fcc75a4f811796a6e32f9ddb04f71b6413fa60fdacb684b"}
Jul 15 13:16:53.413121 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:53.413046    2578 scope.go:117] "RemoveContainer" containerID="561ff7d56ceaac10c5c2b7e835434dbbf69d32f49c736f49610375395ccaf599"
Jul 15 13:16:53.421768 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:53.421750    2578 scope.go:117] "RemoveContainer" containerID="561ff7d56ceaac10c5c2b7e835434dbbf69d32f49c736f49610375395ccaf599"
Jul 15 13:16:53.422019 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:16:53.421999    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"561ff7d56ceaac10c5c2b7e835434dbbf69d32f49c736f49610375395ccaf599\": container with ID starting with 561ff7d56ceaac10c5c2b7e835434dbbf69d32f49c736f49610375395ccaf599 not found: ID does not exist" containerID="561ff7d56ceaac10c5c2b7e835434dbbf69d32f49c736f49610375395ccaf599"
Jul 15 13:16:53.422089 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:53.422031    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"561ff7d56ceaac10c5c2b7e835434dbbf69d32f49c736f49610375395ccaf599"} err="failed to get container status \"561ff7d56ceaac10c5c2b7e835434dbbf69d32f49c736f49610375395ccaf599\": rpc error: code = NotFound desc = could not find container \"561ff7d56ceaac10c5c2b7e835434dbbf69d32f49c736f49610375395ccaf599\": container with ID starting with 561ff7d56ceaac10c5c2b7e835434dbbf69d32f49c736f49610375395ccaf599 not found: ID does not exist"
Jul 15 13:16:53.436328 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:53.436308    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6d4ff848df-v8kpc"]
Jul 15 13:16:53.441611 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:53.441590    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6d4ff848df-v8kpc"]
Jul 15 13:16:53.797251 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:53.797193    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5856457484-mw9wc" podUID="d4a31575-93d4-4ae9-9821-43f6d784c5fd" containerName="console" containerID="cri-o://40154e67e998601b1a464fe85cc9b420f35b4d955b8d0b8e638e3c7498ce86dc" gracePeriod=15
Jul 15 13:16:54.039663 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:54.039641    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5856457484-mw9wc"
Jul 15 13:16:54.145350 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:54.145269    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4a31575-93d4-4ae9-9821-43f6d784c5fd-trusted-ca-bundle\") pod \"d4a31575-93d4-4ae9-9821-43f6d784c5fd\" (UID: \"d4a31575-93d4-4ae9-9821-43f6d784c5fd\") "
Jul 15 13:16:54.145350 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:54.145330    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qnxmt\" (UniqueName: \"kubernetes.io/projected/d4a31575-93d4-4ae9-9821-43f6d784c5fd-kube-api-access-qnxmt\") pod \"d4a31575-93d4-4ae9-9821-43f6d784c5fd\" (UID: \"d4a31575-93d4-4ae9-9821-43f6d784c5fd\") "
Jul 15 13:16:54.145555 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:54.145361    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d4a31575-93d4-4ae9-9821-43f6d784c5fd-oauth-serving-cert\") pod \"d4a31575-93d4-4ae9-9821-43f6d784c5fd\" (UID: \"d4a31575-93d4-4ae9-9821-43f6d784c5fd\") "
Jul 15 13:16:54.145555 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:54.145406    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d4a31575-93d4-4ae9-9821-43f6d784c5fd-console-serving-cert\") pod \"d4a31575-93d4-4ae9-9821-43f6d784c5fd\" (UID: \"d4a31575-93d4-4ae9-9821-43f6d784c5fd\") "
Jul 15 13:16:54.145555 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:54.145432    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d4a31575-93d4-4ae9-9821-43f6d784c5fd-console-config\") pod \"d4a31575-93d4-4ae9-9821-43f6d784c5fd\" (UID: \"d4a31575-93d4-4ae9-9821-43f6d784c5fd\") "
Jul 15 13:16:54.145555 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:54.145471    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d4a31575-93d4-4ae9-9821-43f6d784c5fd-console-oauth-config\") pod \"d4a31575-93d4-4ae9-9821-43f6d784c5fd\" (UID: \"d4a31575-93d4-4ae9-9821-43f6d784c5fd\") "
Jul 15 13:16:54.145555 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:54.145523    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d4a31575-93d4-4ae9-9821-43f6d784c5fd-service-ca\") pod \"d4a31575-93d4-4ae9-9821-43f6d784c5fd\" (UID: \"d4a31575-93d4-4ae9-9821-43f6d784c5fd\") "
Jul 15 13:16:54.145794 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:54.145749    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4a31575-93d4-4ae9-9821-43f6d784c5fd-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d4a31575-93d4-4ae9-9821-43f6d784c5fd" (UID: "d4a31575-93d4-4ae9-9821-43f6d784c5fd"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:16:54.145928 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:54.145858    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4a31575-93d4-4ae9-9821-43f6d784c5fd-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d4a31575-93d4-4ae9-9821-43f6d784c5fd" (UID: "d4a31575-93d4-4ae9-9821-43f6d784c5fd"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:16:54.145928 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:54.145865    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4a31575-93d4-4ae9-9821-43f6d784c5fd-console-config" (OuterVolumeSpecName: "console-config") pod "d4a31575-93d4-4ae9-9821-43f6d784c5fd" (UID: "d4a31575-93d4-4ae9-9821-43f6d784c5fd"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:16:54.146069 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:54.146040    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4a31575-93d4-4ae9-9821-43f6d784c5fd-service-ca" (OuterVolumeSpecName: "service-ca") pod "d4a31575-93d4-4ae9-9821-43f6d784c5fd" (UID: "d4a31575-93d4-4ae9-9821-43f6d784c5fd"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:16:54.147737 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:54.147713    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4a31575-93d4-4ae9-9821-43f6d784c5fd-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d4a31575-93d4-4ae9-9821-43f6d784c5fd" (UID: "d4a31575-93d4-4ae9-9821-43f6d784c5fd"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:16:54.147800 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:54.147718    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4a31575-93d4-4ae9-9821-43f6d784c5fd-kube-api-access-qnxmt" (OuterVolumeSpecName: "kube-api-access-qnxmt") pod "d4a31575-93d4-4ae9-9821-43f6d784c5fd" (UID: "d4a31575-93d4-4ae9-9821-43f6d784c5fd"). InnerVolumeSpecName "kube-api-access-qnxmt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:16:54.147800 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:54.147776    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4a31575-93d4-4ae9-9821-43f6d784c5fd-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d4a31575-93d4-4ae9-9821-43f6d784c5fd" (UID: "d4a31575-93d4-4ae9-9821-43f6d784c5fd"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:16:54.246467 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:54.246409    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d4a31575-93d4-4ae9-9821-43f6d784c5fd-service-ca\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:16:54.246467 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:54.246454    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4a31575-93d4-4ae9-9821-43f6d784c5fd-trusted-ca-bundle\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:16:54.246467 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:54.246464    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qnxmt\" (UniqueName: \"kubernetes.io/projected/d4a31575-93d4-4ae9-9821-43f6d784c5fd-kube-api-access-qnxmt\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:16:54.246467 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:54.246473    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d4a31575-93d4-4ae9-9821-43f6d784c5fd-oauth-serving-cert\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:16:54.246467 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:54.246483    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d4a31575-93d4-4ae9-9821-43f6d784c5fd-console-serving-cert\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:16:54.246755 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:54.246492    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d4a31575-93d4-4ae9-9821-43f6d784c5fd-console-config\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:16:54.246755 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:54.246500    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d4a31575-93d4-4ae9-9821-43f6d784c5fd-console-oauth-config\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:16:54.375607 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:54.375573    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91ab3ba4-74ad-465b-8f66-eaafd1b66e40" path="/var/lib/kubelet/pods/91ab3ba4-74ad-465b-8f66-eaafd1b66e40/volumes"
Jul 15 13:16:54.417966 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:54.417903    2578 generic.go:356] "Generic (PLEG): container finished" podID="d4a31575-93d4-4ae9-9821-43f6d784c5fd" containerID="40154e67e998601b1a464fe85cc9b420f35b4d955b8d0b8e638e3c7498ce86dc" exitCode=0
Jul 15 13:16:54.417966 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:54.417945    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5856457484-mw9wc"
Jul 15 13:16:54.418161 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:54.417946    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5856457484-mw9wc" event={"ID":"d4a31575-93d4-4ae9-9821-43f6d784c5fd","Type":"ContainerDied","Data":"40154e67e998601b1a464fe85cc9b420f35b4d955b8d0b8e638e3c7498ce86dc"}
Jul 15 13:16:54.418161 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:54.418090    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5856457484-mw9wc" event={"ID":"d4a31575-93d4-4ae9-9821-43f6d784c5fd","Type":"ContainerDied","Data":"94dd20a52c2c631028c01cf454387c68a6056480a03216ad428e04fd02d04a38"}
Jul 15 13:16:54.418161 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:54.418123    2578 scope.go:117] "RemoveContainer" containerID="40154e67e998601b1a464fe85cc9b420f35b4d955b8d0b8e638e3c7498ce86dc"
Jul 15 13:16:54.426137 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:54.426118    2578 scope.go:117] "RemoveContainer" containerID="40154e67e998601b1a464fe85cc9b420f35b4d955b8d0b8e638e3c7498ce86dc"
Jul 15 13:16:54.426395 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:16:54.426377    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40154e67e998601b1a464fe85cc9b420f35b4d955b8d0b8e638e3c7498ce86dc\": container with ID starting with 40154e67e998601b1a464fe85cc9b420f35b4d955b8d0b8e638e3c7498ce86dc not found: ID does not exist" containerID="40154e67e998601b1a464fe85cc9b420f35b4d955b8d0b8e638e3c7498ce86dc"
Jul 15 13:16:54.426446 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:54.426403    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40154e67e998601b1a464fe85cc9b420f35b4d955b8d0b8e638e3c7498ce86dc"} err="failed to get container status \"40154e67e998601b1a464fe85cc9b420f35b4d955b8d0b8e638e3c7498ce86dc\": rpc error: code = NotFound desc = could not find container \"40154e67e998601b1a464fe85cc9b420f35b4d955b8d0b8e638e3c7498ce86dc\": container with ID starting with 40154e67e998601b1a464fe85cc9b420f35b4d955b8d0b8e638e3c7498ce86dc not found: ID does not exist"
Jul 15 13:16:54.437755 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:54.437734    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5856457484-mw9wc"]
Jul 15 13:16:54.442417 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:54.442391    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5856457484-mw9wc"]
Jul 15 13:16:55.110883 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:55.110853    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7f5749f9c8-kdckd"
Jul 15 13:16:55.114535 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:55.114510    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7f5749f9c8-kdckd"
Jul 15 13:16:56.374587 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:16:56.374551    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4a31575-93d4-4ae9-9821-43f6d784c5fd" path="/var/lib/kubelet/pods/d4a31575-93d4-4ae9-9821-43f6d784c5fd/volumes"
Jul 15 13:17:00.446033 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:00.445943    2578 generic.go:356] "Generic (PLEG): container finished" podID="46f6ef45-16e7-486e-a44f-6284f36e2add" containerID="fcaca25cd5e8dab2cec7d50996b91ee3be06c1ab11af97035ef8bab46d87ad01" exitCode=0
Jul 15 13:17:00.446033 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:00.446013    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-5vp9j" event={"ID":"46f6ef45-16e7-486e-a44f-6284f36e2add","Type":"ContainerDied","Data":"fcaca25cd5e8dab2cec7d50996b91ee3be06c1ab11af97035ef8bab46d87ad01"}
Jul 15 13:17:00.446494 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:00.446348    2578 scope.go:117] "RemoveContainer" containerID="fcaca25cd5e8dab2cec7d50996b91ee3be06c1ab11af97035ef8bab46d87ad01"
Jul 15 13:17:01.451822 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:01.451790    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-5vp9j" event={"ID":"46f6ef45-16e7-486e-a44f-6284f36e2add","Type":"ContainerStarted","Data":"d4cb000c2d170c52b54b2085d2658a58915cdf30960645d47cc74846f9789da0"}
Jul 15 13:17:34.357571 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:34.357525    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2029ab2-4966-4b8c-ba6c-e69cf982a372-metrics-certs\") pod \"network-metrics-daemon-czmkz\" (UID: \"c2029ab2-4966-4b8c-ba6c-e69cf982a372\") " pod="openshift-multus/network-metrics-daemon-czmkz"
Jul 15 13:17:34.359763 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:34.359743    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2029ab2-4966-4b8c-ba6c-e69cf982a372-metrics-certs\") pod \"network-metrics-daemon-czmkz\" (UID: \"c2029ab2-4966-4b8c-ba6c-e69cf982a372\") " pod="openshift-multus/network-metrics-daemon-czmkz"
Jul 15 13:17:34.373964 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:34.373939    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hh9ms\""
Jul 15 13:17:34.381255 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:34.381235    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-czmkz"
Jul 15 13:17:34.522618 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:34.520293    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-czmkz"]
Jul 15 13:17:34.523942 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:17:34.523915    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2029ab2_4966_4b8c_ba6c_e69cf982a372.slice/crio-1ec4f80d331bb7a74dd86c3e7b15d8f707375ebab22e4b2140ffadc476186514 WatchSource:0}: Error finding container 1ec4f80d331bb7a74dd86c3e7b15d8f707375ebab22e4b2140ffadc476186514: Status 404 returned error can't find the container with id 1ec4f80d331bb7a74dd86c3e7b15d8f707375ebab22e4b2140ffadc476186514
Jul 15 13:17:34.525950 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:34.525930    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 13:17:34.575591 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:34.575553    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-czmkz" event={"ID":"c2029ab2-4966-4b8c-ba6c-e69cf982a372","Type":"ContainerStarted","Data":"1ec4f80d331bb7a74dd86c3e7b15d8f707375ebab22e4b2140ffadc476186514"}
Jul 15 13:17:36.586931 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:36.586895    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-czmkz" event={"ID":"c2029ab2-4966-4b8c-ba6c-e69cf982a372","Type":"ContainerStarted","Data":"09eee1e2293fa97e60787b1b9e52dc22e4665cbead2d4828a30f6c3b5224e7c2"}
Jul 15 13:17:36.587332 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:36.586950    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-czmkz" event={"ID":"c2029ab2-4966-4b8c-ba6c-e69cf982a372","Type":"ContainerStarted","Data":"c52db62d556d998d6a0a4d9981b65f7d352ef9877ec3c8fb1ba1599bd48a9477"}
Jul 15 13:17:36.615886 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:36.615837    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-czmkz" podStartSLOduration=374.639946438 podStartE2EDuration="6m15.615821088s" totalImagesPullingTime="975.87465ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:11:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:17:36.615503076 +0000 UTC m=+376.703290019" watchObservedRunningTime="2026-07-15 13:17:36.615821088 +0000 UTC m=+376.703608031"
Jul 15 13:17:41.781167 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:41.781134    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bd4f4c6b-h46vb"]
Jul 15 13:17:41.781566 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:41.781461    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4a31575-93d4-4ae9-9821-43f6d784c5fd" containerName="console"
Jul 15 13:17:41.781566 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:41.781475    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4a31575-93d4-4ae9-9821-43f6d784c5fd" containerName="console"
Jul 15 13:17:41.781566 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:41.781496    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91ab3ba4-74ad-465b-8f66-eaafd1b66e40" containerName="registry"
Jul 15 13:17:41.781566 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:41.781502    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="91ab3ba4-74ad-465b-8f66-eaafd1b66e40" containerName="registry"
Jul 15 13:17:41.781566 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:41.781557    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="91ab3ba4-74ad-465b-8f66-eaafd1b66e40" containerName="registry"
Jul 15 13:17:41.781566 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:41.781568    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4a31575-93d4-4ae9-9821-43f6d784c5fd" containerName="console"
Jul 15 13:17:41.783856 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:41.783834    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bd4f4c6b-h46vb"
Jul 15 13:17:41.786733 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:41.786709    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 15 13:17:41.788054 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:41.788035    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 15 13:17:41.788175 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:41.788112    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 15 13:17:41.788175 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:41.788138    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-dhdpv\""
Jul 15 13:17:41.788326 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:41.788227    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 15 13:17:41.788326 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:41.788113    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 15 13:17:41.788326 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:41.788265    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 15 13:17:41.788671 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:41.788652    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 15 13:17:41.792923 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:41.792904    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 15 13:17:41.799672 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:41.799648    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bd4f4c6b-h46vb"]
Jul 15 13:17:41.817488 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:41.817462    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1a0c3002-3141-4740-a6db-37f4a3d1c828-console-oauth-config\") pod \"console-7bd4f4c6b-h46vb\" (UID: \"1a0c3002-3141-4740-a6db-37f4a3d1c828\") " pod="openshift-console/console-7bd4f4c6b-h46vb"
Jul 15 13:17:41.817590 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:41.817498    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1a0c3002-3141-4740-a6db-37f4a3d1c828-service-ca\") pod \"console-7bd4f4c6b-h46vb\" (UID: \"1a0c3002-3141-4740-a6db-37f4a3d1c828\") " pod="openshift-console/console-7bd4f4c6b-h46vb"
Jul 15 13:17:41.817590 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:41.817529    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a0c3002-3141-4740-a6db-37f4a3d1c828-trusted-ca-bundle\") pod \"console-7bd4f4c6b-h46vb\" (UID: \"1a0c3002-3141-4740-a6db-37f4a3d1c828\") " pod="openshift-console/console-7bd4f4c6b-h46vb"
Jul 15 13:17:41.817590 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:41.817555    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1a0c3002-3141-4740-a6db-37f4a3d1c828-oauth-serving-cert\") pod \"console-7bd4f4c6b-h46vb\" (UID: \"1a0c3002-3141-4740-a6db-37f4a3d1c828\") " pod="openshift-console/console-7bd4f4c6b-h46vb"
Jul 15 13:17:41.817697 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:41.817618    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1a0c3002-3141-4740-a6db-37f4a3d1c828-console-config\") pod \"console-7bd4f4c6b-h46vb\" (UID: \"1a0c3002-3141-4740-a6db-37f4a3d1c828\") " pod="openshift-console/console-7bd4f4c6b-h46vb"
Jul 15 13:17:41.817697 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:41.817649    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1a0c3002-3141-4740-a6db-37f4a3d1c828-console-serving-cert\") pod \"console-7bd4f4c6b-h46vb\" (UID: \"1a0c3002-3141-4740-a6db-37f4a3d1c828\") " pod="openshift-console/console-7bd4f4c6b-h46vb"
Jul 15 13:17:41.817697 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:41.817678    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hd2nb\" (UniqueName: \"kubernetes.io/projected/1a0c3002-3141-4740-a6db-37f4a3d1c828-kube-api-access-hd2nb\") pod \"console-7bd4f4c6b-h46vb\" (UID: \"1a0c3002-3141-4740-a6db-37f4a3d1c828\") " pod="openshift-console/console-7bd4f4c6b-h46vb"
Jul 15 13:17:41.918576 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:41.918537    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1a0c3002-3141-4740-a6db-37f4a3d1c828-console-oauth-config\") pod \"console-7bd4f4c6b-h46vb\" (UID: \"1a0c3002-3141-4740-a6db-37f4a3d1c828\") " pod="openshift-console/console-7bd4f4c6b-h46vb"
Jul 15 13:17:41.918576 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:41.918580    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1a0c3002-3141-4740-a6db-37f4a3d1c828-service-ca\") pod \"console-7bd4f4c6b-h46vb\" (UID: \"1a0c3002-3141-4740-a6db-37f4a3d1c828\") " pod="openshift-console/console-7bd4f4c6b-h46vb"
Jul 15 13:17:41.918828 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:41.918600    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a0c3002-3141-4740-a6db-37f4a3d1c828-trusted-ca-bundle\") pod \"console-7bd4f4c6b-h46vb\" (UID: \"1a0c3002-3141-4740-a6db-37f4a3d1c828\") " pod="openshift-console/console-7bd4f4c6b-h46vb"
Jul 15 13:17:41.918828 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:41.918622    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1a0c3002-3141-4740-a6db-37f4a3d1c828-oauth-serving-cert\") pod \"console-7bd4f4c6b-h46vb\" (UID: \"1a0c3002-3141-4740-a6db-37f4a3d1c828\") " pod="openshift-console/console-7bd4f4c6b-h46vb"
Jul 15 13:17:41.918828 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:41.918662    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1a0c3002-3141-4740-a6db-37f4a3d1c828-console-config\") pod \"console-7bd4f4c6b-h46vb\" (UID: \"1a0c3002-3141-4740-a6db-37f4a3d1c828\") " pod="openshift-console/console-7bd4f4c6b-h46vb"
Jul 15 13:17:41.918828 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:41.918683    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1a0c3002-3141-4740-a6db-37f4a3d1c828-console-serving-cert\") pod \"console-7bd4f4c6b-h46vb\" (UID: \"1a0c3002-3141-4740-a6db-37f4a3d1c828\") " pod="openshift-console/console-7bd4f4c6b-h46vb"
Jul 15 13:17:41.918828 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:41.918707    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd2nb\" (UniqueName: \"kubernetes.io/projected/1a0c3002-3141-4740-a6db-37f4a3d1c828-kube-api-access-hd2nb\") pod \"console-7bd4f4c6b-h46vb\" (UID: \"1a0c3002-3141-4740-a6db-37f4a3d1c828\") " pod="openshift-console/console-7bd4f4c6b-h46vb"
Jul 15 13:17:41.919506 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:41.919480    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1a0c3002-3141-4740-a6db-37f4a3d1c828-console-config\") pod \"console-7bd4f4c6b-h46vb\" (UID: \"1a0c3002-3141-4740-a6db-37f4a3d1c828\") " pod="openshift-console/console-7bd4f4c6b-h46vb"
Jul 15 13:17:41.919631 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:41.919556    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1a0c3002-3141-4740-a6db-37f4a3d1c828-service-ca\") pod \"console-7bd4f4c6b-h46vb\" (UID: \"1a0c3002-3141-4740-a6db-37f4a3d1c828\") " pod="openshift-console/console-7bd4f4c6b-h46vb"
Jul 15 13:17:41.919697 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:41.919669    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a0c3002-3141-4740-a6db-37f4a3d1c828-trusted-ca-bundle\") pod \"console-7bd4f4c6b-h46vb\" (UID: \"1a0c3002-3141-4740-a6db-37f4a3d1c828\") " pod="openshift-console/console-7bd4f4c6b-h46vb"
Jul 15 13:17:41.920106 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:41.920079    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1a0c3002-3141-4740-a6db-37f4a3d1c828-oauth-serving-cert\") pod \"console-7bd4f4c6b-h46vb\" (UID: \"1a0c3002-3141-4740-a6db-37f4a3d1c828\") " pod="openshift-console/console-7bd4f4c6b-h46vb"
Jul 15 13:17:41.921123 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:41.921103    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1a0c3002-3141-4740-a6db-37f4a3d1c828-console-oauth-config\") pod \"console-7bd4f4c6b-h46vb\" (UID: \"1a0c3002-3141-4740-a6db-37f4a3d1c828\") " pod="openshift-console/console-7bd4f4c6b-h46vb"
Jul 15 13:17:41.921397 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:41.921377    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1a0c3002-3141-4740-a6db-37f4a3d1c828-console-serving-cert\") pod \"console-7bd4f4c6b-h46vb\" (UID: \"1a0c3002-3141-4740-a6db-37f4a3d1c828\") " pod="openshift-console/console-7bd4f4c6b-h46vb"
Jul 15 13:17:41.930267 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:41.930244    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hd2nb\" (UniqueName: \"kubernetes.io/projected/1a0c3002-3141-4740-a6db-37f4a3d1c828-kube-api-access-hd2nb\") pod \"console-7bd4f4c6b-h46vb\" (UID: \"1a0c3002-3141-4740-a6db-37f4a3d1c828\") " pod="openshift-console/console-7bd4f4c6b-h46vb"
Jul 15 13:17:42.094988 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:42.094753    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bd4f4c6b-h46vb"
Jul 15 13:17:42.242649 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:42.242534    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bd4f4c6b-h46vb"]
Jul 15 13:17:42.245891 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:17:42.245854    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a0c3002_3141_4740_a6db_37f4a3d1c828.slice/crio-b70afa262abdd1c69560d39ed5733f99bf01ecf4a5bfec643183ac81381b58a7 WatchSource:0}: Error finding container b70afa262abdd1c69560d39ed5733f99bf01ecf4a5bfec643183ac81381b58a7: Status 404 returned error can't find the container with id b70afa262abdd1c69560d39ed5733f99bf01ecf4a5bfec643183ac81381b58a7
Jul 15 13:17:42.611843 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:42.611806    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bd4f4c6b-h46vb" event={"ID":"1a0c3002-3141-4740-a6db-37f4a3d1c828","Type":"ContainerStarted","Data":"e05865d9a1b0e21557a098955a58b6b07ed2ba41e00833f14c77e491f92481c6"}
Jul 15 13:17:42.612014 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:42.611859    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bd4f4c6b-h46vb" event={"ID":"1a0c3002-3141-4740-a6db-37f4a3d1c828","Type":"ContainerStarted","Data":"b70afa262abdd1c69560d39ed5733f99bf01ecf4a5bfec643183ac81381b58a7"}
Jul 15 13:17:42.637295 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:42.637247    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7bd4f4c6b-h46vb" podStartSLOduration=1.637232714 podStartE2EDuration="1.637232714s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:17:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:17:42.635002425 +0000 UTC m=+382.722789378" watchObservedRunningTime="2026-07-15 13:17:42.637232714 +0000 UTC m=+382.725019653"
Jul 15 13:17:52.095081 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:52.095042    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bd4f4c6b-h46vb"
Jul 15 13:17:52.095510 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:52.095110    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7bd4f4c6b-h46vb"
Jul 15 13:17:52.099896 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:52.099871    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7bd4f4c6b-h46vb"
Jul 15 13:17:52.652618 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:17:52.652588    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7bd4f4c6b-h46vb"
Jul 15 13:19:05.343498 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:19:05.343418    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bd4f4c6b-h46vb"]
Jul 15 13:19:30.365450 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:19:30.365401    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7bd4f4c6b-h46vb" podUID="1a0c3002-3141-4740-a6db-37f4a3d1c828" containerName="console" containerID="cri-o://e05865d9a1b0e21557a098955a58b6b07ed2ba41e00833f14c77e491f92481c6" gracePeriod=15
Jul 15 13:19:30.616195 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:19:30.616125    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bd4f4c6b-h46vb"
Jul 15 13:19:30.761269 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:19:30.761231    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1a0c3002-3141-4740-a6db-37f4a3d1c828-console-oauth-config\") pod \"1a0c3002-3141-4740-a6db-37f4a3d1c828\" (UID: \"1a0c3002-3141-4740-a6db-37f4a3d1c828\") "
Jul 15 13:19:30.761269 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:19:30.761271    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1a0c3002-3141-4740-a6db-37f4a3d1c828-console-config\") pod \"1a0c3002-3141-4740-a6db-37f4a3d1c828\" (UID: \"1a0c3002-3141-4740-a6db-37f4a3d1c828\") "
Jul 15 13:19:30.761461 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:19:30.761298    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1a0c3002-3141-4740-a6db-37f4a3d1c828-console-serving-cert\") pod \"1a0c3002-3141-4740-a6db-37f4a3d1c828\" (UID: \"1a0c3002-3141-4740-a6db-37f4a3d1c828\") "
Jul 15 13:19:30.761461 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:19:30.761333    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hd2nb\" (UniqueName: \"kubernetes.io/projected/1a0c3002-3141-4740-a6db-37f4a3d1c828-kube-api-access-hd2nb\") pod \"1a0c3002-3141-4740-a6db-37f4a3d1c828\" (UID: \"1a0c3002-3141-4740-a6db-37f4a3d1c828\") "
Jul 15 13:19:30.761461 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:19:30.761398    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1a0c3002-3141-4740-a6db-37f4a3d1c828-oauth-serving-cert\") pod \"1a0c3002-3141-4740-a6db-37f4a3d1c828\" (UID: \"1a0c3002-3141-4740-a6db-37f4a3d1c828\") "
Jul 15 13:19:30.761461 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:19:30.761427    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1a0c3002-3141-4740-a6db-37f4a3d1c828-service-ca\") pod \"1a0c3002-3141-4740-a6db-37f4a3d1c828\" (UID: \"1a0c3002-3141-4740-a6db-37f4a3d1c828\") "
Jul 15 13:19:30.761655 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:19:30.761627    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a0c3002-3141-4740-a6db-37f4a3d1c828-trusted-ca-bundle\") pod \"1a0c3002-3141-4740-a6db-37f4a3d1c828\" (UID: \"1a0c3002-3141-4740-a6db-37f4a3d1c828\") "
Jul 15 13:19:30.761714 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:19:30.761638    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a0c3002-3141-4740-a6db-37f4a3d1c828-console-config" (OuterVolumeSpecName: "console-config") pod "1a0c3002-3141-4740-a6db-37f4a3d1c828" (UID: "1a0c3002-3141-4740-a6db-37f4a3d1c828"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:19:30.761896 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:19:30.761864    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1a0c3002-3141-4740-a6db-37f4a3d1c828-console-config\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:19:30.762020 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:19:30.761892    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a0c3002-3141-4740-a6db-37f4a3d1c828-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1a0c3002-3141-4740-a6db-37f4a3d1c828" (UID: "1a0c3002-3141-4740-a6db-37f4a3d1c828"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:19:30.762020 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:19:30.761965    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a0c3002-3141-4740-a6db-37f4a3d1c828-service-ca" (OuterVolumeSpecName: "service-ca") pod "1a0c3002-3141-4740-a6db-37f4a3d1c828" (UID: "1a0c3002-3141-4740-a6db-37f4a3d1c828"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:19:30.762020 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:19:30.761990    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a0c3002-3141-4740-a6db-37f4a3d1c828-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1a0c3002-3141-4740-a6db-37f4a3d1c828" (UID: "1a0c3002-3141-4740-a6db-37f4a3d1c828"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:19:30.763504 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:19:30.763478    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a0c3002-3141-4740-a6db-37f4a3d1c828-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1a0c3002-3141-4740-a6db-37f4a3d1c828" (UID: "1a0c3002-3141-4740-a6db-37f4a3d1c828"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:19:30.763944 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:19:30.763927    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a0c3002-3141-4740-a6db-37f4a3d1c828-kube-api-access-hd2nb" (OuterVolumeSpecName: "kube-api-access-hd2nb") pod "1a0c3002-3141-4740-a6db-37f4a3d1c828" (UID: "1a0c3002-3141-4740-a6db-37f4a3d1c828"). InnerVolumeSpecName "kube-api-access-hd2nb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:19:30.764009 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:19:30.763971    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a0c3002-3141-4740-a6db-37f4a3d1c828-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1a0c3002-3141-4740-a6db-37f4a3d1c828" (UID: "1a0c3002-3141-4740-a6db-37f4a3d1c828"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:19:30.862535 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:19:30.862490    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1a0c3002-3141-4740-a6db-37f4a3d1c828-oauth-serving-cert\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:19:30.862535 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:19:30.862532    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1a0c3002-3141-4740-a6db-37f4a3d1c828-service-ca\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:19:30.862535 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:19:30.862543    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a0c3002-3141-4740-a6db-37f4a3d1c828-trusted-ca-bundle\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:19:30.862535 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:19:30.862552    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1a0c3002-3141-4740-a6db-37f4a3d1c828-console-oauth-config\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:19:30.862788 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:19:30.862560    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1a0c3002-3141-4740-a6db-37f4a3d1c828-console-serving-cert\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:19:30.862788 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:19:30.862568    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hd2nb\" (UniqueName: \"kubernetes.io/projected/1a0c3002-3141-4740-a6db-37f4a3d1c828-kube-api-access-hd2nb\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:19:31.012289 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:19:31.012259    2578 generic.go:356] "Generic (PLEG): container finished" podID="1a0c3002-3141-4740-a6db-37f4a3d1c828" containerID="e05865d9a1b0e21557a098955a58b6b07ed2ba41e00833f14c77e491f92481c6" exitCode=0
Jul 15 13:19:31.012438 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:19:31.012305    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bd4f4c6b-h46vb"
Jul 15 13:19:31.012438 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:19:31.012347    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bd4f4c6b-h46vb" event={"ID":"1a0c3002-3141-4740-a6db-37f4a3d1c828","Type":"ContainerDied","Data":"e05865d9a1b0e21557a098955a58b6b07ed2ba41e00833f14c77e491f92481c6"}
Jul 15 13:19:31.012438 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:19:31.012424    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bd4f4c6b-h46vb" event={"ID":"1a0c3002-3141-4740-a6db-37f4a3d1c828","Type":"ContainerDied","Data":"b70afa262abdd1c69560d39ed5733f99bf01ecf4a5bfec643183ac81381b58a7"}
Jul 15 13:19:31.012558 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:19:31.012447    2578 scope.go:117] "RemoveContainer" containerID="e05865d9a1b0e21557a098955a58b6b07ed2ba41e00833f14c77e491f92481c6"
Jul 15 13:19:31.020788 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:19:31.020773    2578 scope.go:117] "RemoveContainer" containerID="e05865d9a1b0e21557a098955a58b6b07ed2ba41e00833f14c77e491f92481c6"
Jul 15 13:19:31.021034 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:19:31.021018    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e05865d9a1b0e21557a098955a58b6b07ed2ba41e00833f14c77e491f92481c6\": container with ID starting with e05865d9a1b0e21557a098955a58b6b07ed2ba41e00833f14c77e491f92481c6 not found: ID does not exist" containerID="e05865d9a1b0e21557a098955a58b6b07ed2ba41e00833f14c77e491f92481c6"
Jul 15 13:19:31.021080 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:19:31.021042    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e05865d9a1b0e21557a098955a58b6b07ed2ba41e00833f14c77e491f92481c6"} err="failed to get container status \"e05865d9a1b0e21557a098955a58b6b07ed2ba41e00833f14c77e491f92481c6\": rpc error: code = NotFound desc = could not find container \"e05865d9a1b0e21557a098955a58b6b07ed2ba41e00833f14c77e491f92481c6\": container with ID starting with e05865d9a1b0e21557a098955a58b6b07ed2ba41e00833f14c77e491f92481c6 not found: ID does not exist"
Jul 15 13:19:31.034244 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:19:31.034194    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bd4f4c6b-h46vb"]
Jul 15 13:19:31.035805 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:19:31.035780    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7bd4f4c6b-h46vb"]
Jul 15 13:19:32.374646 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:19:32.374606    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a0c3002-3141-4740-a6db-37f4a3d1c828" path="/var/lib/kubelet/pods/1a0c3002-3141-4740-a6db-37f4a3d1c828/volumes"
Jul 15 13:19:58.229910 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:19:58.229875    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tcbmn"]
Jul 15 13:19:58.230330 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:19:58.230171    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a0c3002-3141-4740-a6db-37f4a3d1c828" containerName="console"
Jul 15 13:19:58.230330 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:19:58.230182    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a0c3002-3141-4740-a6db-37f4a3d1c828" containerName="console"
Jul 15 13:19:58.230330 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:19:58.230239    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a0c3002-3141-4740-a6db-37f4a3d1c828" containerName="console"
Jul 15 13:19:58.233052 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:19:58.233035    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tcbmn"
Jul 15 13:19:58.237493 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:19:58.237473    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wxvrz\""
Jul 15 13:19:58.238115 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:19:58.238102    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 15 13:19:58.238781 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:19:58.238765    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 15 13:19:58.247522 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:19:58.247502    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tcbmn"]
Jul 15 13:19:58.269559 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:19:58.269514    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/884ffa53-8df9-49b4-8903-c0b15697683c-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tcbmn\" (UID: \"884ffa53-8df9-49b4-8903-c0b15697683c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tcbmn"
Jul 15 13:19:58.269741 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:19:58.269589    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/884ffa53-8df9-49b4-8903-c0b15697683c-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tcbmn\" (UID: \"884ffa53-8df9-49b4-8903-c0b15697683c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tcbmn"
Jul 15 13:19:58.269741 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:19:58.269636    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pffql\" (UniqueName: \"kubernetes.io/projected/884ffa53-8df9-49b4-8903-c0b15697683c-kube-api-access-pffql\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tcbmn\" (UID: \"884ffa53-8df9-49b4-8903-c0b15697683c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tcbmn"
Jul 15 13:19:58.370854 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:19:58.370815    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/884ffa53-8df9-49b4-8903-c0b15697683c-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tcbmn\" (UID: \"884ffa53-8df9-49b4-8903-c0b15697683c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tcbmn"
Jul 15 13:19:58.371016 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:19:58.370874    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pffql\" (UniqueName: \"kubernetes.io/projected/884ffa53-8df9-49b4-8903-c0b15697683c-kube-api-access-pffql\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tcbmn\" (UID: \"884ffa53-8df9-49b4-8903-c0b15697683c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tcbmn"
Jul 15 13:19:58.371016 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:19:58.370921    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/884ffa53-8df9-49b4-8903-c0b15697683c-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tcbmn\" (UID: \"884ffa53-8df9-49b4-8903-c0b15697683c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tcbmn"
Jul 15 13:19:58.371339 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:19:58.371310    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/884ffa53-8df9-49b4-8903-c0b15697683c-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tcbmn\" (UID: \"884ffa53-8df9-49b4-8903-c0b15697683c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tcbmn"
Jul 15 13:19:58.371427 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:19:58.371340    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/884ffa53-8df9-49b4-8903-c0b15697683c-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tcbmn\" (UID: \"884ffa53-8df9-49b4-8903-c0b15697683c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tcbmn"
Jul 15 13:19:58.380879 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:19:58.380849    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pffql\" (UniqueName: \"kubernetes.io/projected/884ffa53-8df9-49b4-8903-c0b15697683c-kube-api-access-pffql\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tcbmn\" (UID: \"884ffa53-8df9-49b4-8903-c0b15697683c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tcbmn"
Jul 15 13:19:58.542905 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:19:58.542821    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tcbmn"
Jul 15 13:19:58.670065 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:19:58.670036    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tcbmn"]
Jul 15 13:19:58.674709 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:19:58.674685    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod884ffa53_8df9_49b4_8903_c0b15697683c.slice/crio-5557497c5e4fcb6618fc88c93ba9deef3816d4fc44f25066e91db04af3ef3e64 WatchSource:0}: Error finding container 5557497c5e4fcb6618fc88c93ba9deef3816d4fc44f25066e91db04af3ef3e64: Status 404 returned error can't find the container with id 5557497c5e4fcb6618fc88c93ba9deef3816d4fc44f25066e91db04af3ef3e64
Jul 15 13:19:59.123572 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:19:59.123534    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tcbmn" event={"ID":"884ffa53-8df9-49b4-8903-c0b15697683c","Type":"ContainerStarted","Data":"5557497c5e4fcb6618fc88c93ba9deef3816d4fc44f25066e91db04af3ef3e64"}
Jul 15 13:20:06.156729 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:06.156687    2578 generic.go:356] "Generic (PLEG): container finished" podID="884ffa53-8df9-49b4-8903-c0b15697683c" containerID="875839f6c82c8f31abe58197b80c3a66be7fcfb6c30526228ee49f1839be8c06" exitCode=0
Jul 15 13:20:06.157126 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:06.156787    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tcbmn" event={"ID":"884ffa53-8df9-49b4-8903-c0b15697683c","Type":"ContainerDied","Data":"875839f6c82c8f31abe58197b80c3a66be7fcfb6c30526228ee49f1839be8c06"}
Jul 15 13:20:08.167853 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:08.167819    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tcbmn" event={"ID":"884ffa53-8df9-49b4-8903-c0b15697683c","Type":"ContainerStarted","Data":"3b3c3b4621695265d0a3dee06a08a008be67b7f64f26ad261d3d36b028c0cda8"}
Jul 15 13:20:09.173341 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:09.173304    2578 generic.go:356] "Generic (PLEG): container finished" podID="884ffa53-8df9-49b4-8903-c0b15697683c" containerID="3b3c3b4621695265d0a3dee06a08a008be67b7f64f26ad261d3d36b028c0cda8" exitCode=0
Jul 15 13:20:09.173729 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:09.173389    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tcbmn" event={"ID":"884ffa53-8df9-49b4-8903-c0b15697683c","Type":"ContainerDied","Data":"3b3c3b4621695265d0a3dee06a08a008be67b7f64f26ad261d3d36b028c0cda8"}
Jul 15 13:20:16.206629 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:16.206591    2578 generic.go:356] "Generic (PLEG): container finished" podID="884ffa53-8df9-49b4-8903-c0b15697683c" containerID="d35fd4a142b0a3eb7916e012632d9380add5fbe5e842ad4b0dbf68fbb6b03747" exitCode=0
Jul 15 13:20:16.207006 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:16.206661    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tcbmn" event={"ID":"884ffa53-8df9-49b4-8903-c0b15697683c","Type":"ContainerDied","Data":"d35fd4a142b0a3eb7916e012632d9380add5fbe5e842ad4b0dbf68fbb6b03747"}
Jul 15 13:20:17.337724 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:17.337699    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tcbmn"
Jul 15 13:20:17.432343 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:17.432313    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/884ffa53-8df9-49b4-8903-c0b15697683c-bundle\") pod \"884ffa53-8df9-49b4-8903-c0b15697683c\" (UID: \"884ffa53-8df9-49b4-8903-c0b15697683c\") "
Jul 15 13:20:17.432343 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:17.432350    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/884ffa53-8df9-49b4-8903-c0b15697683c-util\") pod \"884ffa53-8df9-49b4-8903-c0b15697683c\" (UID: \"884ffa53-8df9-49b4-8903-c0b15697683c\") "
Jul 15 13:20:17.432585 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:17.432404    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pffql\" (UniqueName: \"kubernetes.io/projected/884ffa53-8df9-49b4-8903-c0b15697683c-kube-api-access-pffql\") pod \"884ffa53-8df9-49b4-8903-c0b15697683c\" (UID: \"884ffa53-8df9-49b4-8903-c0b15697683c\") "
Jul 15 13:20:17.432969 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:17.432941    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/884ffa53-8df9-49b4-8903-c0b15697683c-bundle" (OuterVolumeSpecName: "bundle") pod "884ffa53-8df9-49b4-8903-c0b15697683c" (UID: "884ffa53-8df9-49b4-8903-c0b15697683c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:20:17.434627 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:17.434599    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/884ffa53-8df9-49b4-8903-c0b15697683c-kube-api-access-pffql" (OuterVolumeSpecName: "kube-api-access-pffql") pod "884ffa53-8df9-49b4-8903-c0b15697683c" (UID: "884ffa53-8df9-49b4-8903-c0b15697683c"). InnerVolumeSpecName "kube-api-access-pffql". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:20:17.436563 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:17.436541    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/884ffa53-8df9-49b4-8903-c0b15697683c-util" (OuterVolumeSpecName: "util") pod "884ffa53-8df9-49b4-8903-c0b15697683c" (UID: "884ffa53-8df9-49b4-8903-c0b15697683c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:20:17.532948 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:17.532865    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/884ffa53-8df9-49b4-8903-c0b15697683c-bundle\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:20:17.532948 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:17.532893    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/884ffa53-8df9-49b4-8903-c0b15697683c-util\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:20:17.532948 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:17.532903    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pffql\" (UniqueName: \"kubernetes.io/projected/884ffa53-8df9-49b4-8903-c0b15697683c-kube-api-access-pffql\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:20:18.215777 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:18.215741    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tcbmn" event={"ID":"884ffa53-8df9-49b4-8903-c0b15697683c","Type":"ContainerDied","Data":"5557497c5e4fcb6618fc88c93ba9deef3816d4fc44f25066e91db04af3ef3e64"}
Jul 15 13:20:18.215917 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:18.215788    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5557497c5e4fcb6618fc88c93ba9deef3816d4fc44f25066e91db04af3ef3e64"
Jul 15 13:20:18.215917 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:18.215789    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tcbmn"
Jul 15 13:20:20.949094 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:20.949056    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jcbv8"]
Jul 15 13:20:20.949502 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:20.949357    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="884ffa53-8df9-49b4-8903-c0b15697683c" containerName="pull"
Jul 15 13:20:20.949502 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:20.949369    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="884ffa53-8df9-49b4-8903-c0b15697683c" containerName="pull"
Jul 15 13:20:20.949502 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:20.949384    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="884ffa53-8df9-49b4-8903-c0b15697683c" containerName="util"
Jul 15 13:20:20.949502 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:20.949389    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="884ffa53-8df9-49b4-8903-c0b15697683c" containerName="util"
Jul 15 13:20:20.949502 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:20.949400    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="884ffa53-8df9-49b4-8903-c0b15697683c" containerName="extract"
Jul 15 13:20:20.949502 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:20.949405    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="884ffa53-8df9-49b4-8903-c0b15697683c" containerName="extract"
Jul 15 13:20:20.949502 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:20.949447    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="884ffa53-8df9-49b4-8903-c0b15697683c" containerName="extract"
Jul 15 13:20:20.952423 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:20.952404    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jcbv8"
Jul 15 13:20:20.955544 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:20.955521    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 15 13:20:20.955762 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:20.955746    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-8gqcg\""
Jul 15 13:20:20.955870 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:20.955852    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 15 13:20:20.969407 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:20.969383    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jcbv8"]
Jul 15 13:20:21.059882 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:21.059840    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5s68m\" (UniqueName: \"kubernetes.io/projected/056f5b89-4fe5-4f0a-a3af-c1f3d5a82c9e-kube-api-access-5s68m\") pod \"cert-manager-operator-controller-manager-55c444bf86-jcbv8\" (UID: \"056f5b89-4fe5-4f0a-a3af-c1f3d5a82c9e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jcbv8"
Jul 15 13:20:21.060196 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:21.059915    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/056f5b89-4fe5-4f0a-a3af-c1f3d5a82c9e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-jcbv8\" (UID: \"056f5b89-4fe5-4f0a-a3af-c1f3d5a82c9e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jcbv8"
Jul 15 13:20:21.160668 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:21.160629    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5s68m\" (UniqueName: \"kubernetes.io/projected/056f5b89-4fe5-4f0a-a3af-c1f3d5a82c9e-kube-api-access-5s68m\") pod \"cert-manager-operator-controller-manager-55c444bf86-jcbv8\" (UID: \"056f5b89-4fe5-4f0a-a3af-c1f3d5a82c9e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jcbv8"
Jul 15 13:20:21.160835 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:21.160688    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/056f5b89-4fe5-4f0a-a3af-c1f3d5a82c9e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-jcbv8\" (UID: \"056f5b89-4fe5-4f0a-a3af-c1f3d5a82c9e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jcbv8"
Jul 15 13:20:21.161009 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:21.160994    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/056f5b89-4fe5-4f0a-a3af-c1f3d5a82c9e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-jcbv8\" (UID: \"056f5b89-4fe5-4f0a-a3af-c1f3d5a82c9e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jcbv8"
Jul 15 13:20:21.174037 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:21.174009    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5s68m\" (UniqueName: \"kubernetes.io/projected/056f5b89-4fe5-4f0a-a3af-c1f3d5a82c9e-kube-api-access-5s68m\") pod \"cert-manager-operator-controller-manager-55c444bf86-jcbv8\" (UID: \"056f5b89-4fe5-4f0a-a3af-c1f3d5a82c9e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jcbv8"
Jul 15 13:20:21.261258 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:21.261198    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jcbv8"
Jul 15 13:20:21.402224 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:21.401994    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jcbv8"]
Jul 15 13:20:21.405042 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:20:21.405010    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod056f5b89_4fe5_4f0a_a3af_c1f3d5a82c9e.slice/crio-a439e9dcdeba4fcf83e47641160d03615b9829608641b90928601c5394b98f53 WatchSource:0}: Error finding container a439e9dcdeba4fcf83e47641160d03615b9829608641b90928601c5394b98f53: Status 404 returned error can't find the container with id a439e9dcdeba4fcf83e47641160d03615b9829608641b90928601c5394b98f53
Jul 15 13:20:22.230834 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:22.230798    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jcbv8" event={"ID":"056f5b89-4fe5-4f0a-a3af-c1f3d5a82c9e","Type":"ContainerStarted","Data":"a439e9dcdeba4fcf83e47641160d03615b9829608641b90928601c5394b98f53"}
Jul 15 13:20:25.247872 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:25.247826    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jcbv8" event={"ID":"056f5b89-4fe5-4f0a-a3af-c1f3d5a82c9e","Type":"ContainerStarted","Data":"4d3cc99cca15f828a23d447a9f411485753932c5099a71b285c3068648b6351a"}
Jul 15 13:20:25.277034 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:25.276980    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jcbv8" podStartSLOduration=2.0574707 podStartE2EDuration="5.276963822s" totalImagesPullingTime="3.219493122s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:20:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:20:25.274429129 +0000 UTC m=+545.362216072" watchObservedRunningTime="2026-07-15 13:20:25.276963822 +0000 UTC m=+545.364750764"
Jul 15 13:20:25.764066 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:25.764031    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdjmbn"]
Jul 15 13:20:25.766390 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:25.766374    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdjmbn"
Jul 15 13:20:25.769039 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:25.769003    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 15 13:20:25.770256 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:25.770235    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 15 13:20:25.770346 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:25.770254    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wxvrz\""
Jul 15 13:20:25.785068 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:25.785043    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdjmbn"]
Jul 15 13:20:25.898188 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:25.898155    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6lmt\" (UniqueName: \"kubernetes.io/projected/7a67a246-9bd1-4994-befd-0cae0dda5df8-kube-api-access-h6lmt\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdjmbn\" (UID: \"7a67a246-9bd1-4994-befd-0cae0dda5df8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdjmbn"
Jul 15 13:20:25.898383 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:25.898240    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a67a246-9bd1-4994-befd-0cae0dda5df8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdjmbn\" (UID: \"7a67a246-9bd1-4994-befd-0cae0dda5df8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdjmbn"
Jul 15 13:20:25.898383 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:25.898277    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a67a246-9bd1-4994-befd-0cae0dda5df8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdjmbn\" (UID: \"7a67a246-9bd1-4994-befd-0cae0dda5df8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdjmbn"
Jul 15 13:20:25.999327 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:25.999291    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a67a246-9bd1-4994-befd-0cae0dda5df8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdjmbn\" (UID: \"7a67a246-9bd1-4994-befd-0cae0dda5df8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdjmbn"
Jul 15 13:20:25.999327 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:25.999340    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a67a246-9bd1-4994-befd-0cae0dda5df8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdjmbn\" (UID: \"7a67a246-9bd1-4994-befd-0cae0dda5df8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdjmbn"
Jul 15 13:20:25.999540 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:25.999383    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6lmt\" (UniqueName: \"kubernetes.io/projected/7a67a246-9bd1-4994-befd-0cae0dda5df8-kube-api-access-h6lmt\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdjmbn\" (UID: \"7a67a246-9bd1-4994-befd-0cae0dda5df8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdjmbn"
Jul 15 13:20:25.999791 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:25.999762    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a67a246-9bd1-4994-befd-0cae0dda5df8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdjmbn\" (UID: \"7a67a246-9bd1-4994-befd-0cae0dda5df8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdjmbn"
Jul 15 13:20:25.999833 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:25.999776    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a67a246-9bd1-4994-befd-0cae0dda5df8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdjmbn\" (UID: \"7a67a246-9bd1-4994-befd-0cae0dda5df8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdjmbn"
Jul 15 13:20:26.011504 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:26.011470    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6lmt\" (UniqueName: \"kubernetes.io/projected/7a67a246-9bd1-4994-befd-0cae0dda5df8-kube-api-access-h6lmt\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdjmbn\" (UID: \"7a67a246-9bd1-4994-befd-0cae0dda5df8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdjmbn"
Jul 15 13:20:26.075607 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:26.075519    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdjmbn"
Jul 15 13:20:26.201935 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:26.201905    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdjmbn"]
Jul 15 13:20:26.205319 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:20:26.205293    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a67a246_9bd1_4994_befd_0cae0dda5df8.slice/crio-442ba7e605c3e9090123aa53e963734c9313fc67ccea84322668b4bc99f6212a WatchSource:0}: Error finding container 442ba7e605c3e9090123aa53e963734c9313fc67ccea84322668b4bc99f6212a: Status 404 returned error can't find the container with id 442ba7e605c3e9090123aa53e963734c9313fc67ccea84322668b4bc99f6212a
Jul 15 13:20:26.253940 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:26.253899    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdjmbn" event={"ID":"7a67a246-9bd1-4994-befd-0cae0dda5df8","Type":"ContainerStarted","Data":"442ba7e605c3e9090123aa53e963734c9313fc67ccea84322668b4bc99f6212a"}
Jul 15 13:20:26.576224 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:26.576167    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-gpf47"]
Jul 15 13:20:26.578048 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:26.578028    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-gpf47"
Jul 15 13:20:26.580895 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:26.580875    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 15 13:20:26.582165 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:26.582139    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 15 13:20:26.582261 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:26.582167    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-z4md2\""
Jul 15 13:20:26.588021 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:26.587997    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-gpf47"]
Jul 15 13:20:26.705587 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:26.705559    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5a1d86a9-b4c1-42cb-bcb1-848f44be1e23-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-gpf47\" (UID: \"5a1d86a9-b4c1-42cb-bcb1-848f44be1e23\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gpf47"
Jul 15 13:20:26.705740 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:26.705608    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62st8\" (UniqueName: \"kubernetes.io/projected/5a1d86a9-b4c1-42cb-bcb1-848f44be1e23-kube-api-access-62st8\") pod \"cert-manager-webhook-6486ffd997-gpf47\" (UID: \"5a1d86a9-b4c1-42cb-bcb1-848f44be1e23\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gpf47"
Jul 15 13:20:26.806491 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:26.806454    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5a1d86a9-b4c1-42cb-bcb1-848f44be1e23-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-gpf47\" (UID: \"5a1d86a9-b4c1-42cb-bcb1-848f44be1e23\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gpf47"
Jul 15 13:20:26.806645 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:26.806509    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62st8\" (UniqueName: \"kubernetes.io/projected/5a1d86a9-b4c1-42cb-bcb1-848f44be1e23-kube-api-access-62st8\") pod \"cert-manager-webhook-6486ffd997-gpf47\" (UID: \"5a1d86a9-b4c1-42cb-bcb1-848f44be1e23\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gpf47"
Jul 15 13:20:26.815116 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:26.815092    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5a1d86a9-b4c1-42cb-bcb1-848f44be1e23-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-gpf47\" (UID: \"5a1d86a9-b4c1-42cb-bcb1-848f44be1e23\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gpf47"
Jul 15 13:20:26.815288 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:26.815268    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62st8\" (UniqueName: \"kubernetes.io/projected/5a1d86a9-b4c1-42cb-bcb1-848f44be1e23-kube-api-access-62st8\") pod \"cert-manager-webhook-6486ffd997-gpf47\" (UID: \"5a1d86a9-b4c1-42cb-bcb1-848f44be1e23\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gpf47"
Jul 15 13:20:26.895864 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:26.895785    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-gpf47"
Jul 15 13:20:27.019250 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:27.018884    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-gpf47"]
Jul 15 13:20:27.021959 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:20:27.021927    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5a1d86a9_b4c1_42cb_bcb1_848f44be1e23.slice/crio-cb813e0bbd80976c4e27aaf6453b354aa7a9aeccd07774fd898849b27307c5d9 WatchSource:0}: Error finding container cb813e0bbd80976c4e27aaf6453b354aa7a9aeccd07774fd898849b27307c5d9: Status 404 returned error can't find the container with id cb813e0bbd80976c4e27aaf6453b354aa7a9aeccd07774fd898849b27307c5d9
Jul 15 13:20:27.260022 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:27.259992    2578 generic.go:356] "Generic (PLEG): container finished" podID="7a67a246-9bd1-4994-befd-0cae0dda5df8" containerID="35caeafb05329be8e56d485a40659e945bf5dd3e74829f434525523c1ab1b6db" exitCode=0
Jul 15 13:20:27.260510 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:27.260085    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdjmbn" event={"ID":"7a67a246-9bd1-4994-befd-0cae0dda5df8","Type":"ContainerDied","Data":"35caeafb05329be8e56d485a40659e945bf5dd3e74829f434525523c1ab1b6db"}
Jul 15 13:20:27.261388 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:27.261365    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-gpf47" event={"ID":"5a1d86a9-b4c1-42cb-bcb1-848f44be1e23","Type":"ContainerStarted","Data":"cb813e0bbd80976c4e27aaf6453b354aa7a9aeccd07774fd898849b27307c5d9"}
Jul 15 13:20:28.322456 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:28.322415    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-5h8dj"]
Jul 15 13:20:28.324808 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:28.324778    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5h8dj"
Jul 15 13:20:28.327529 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:28.327506    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-8dq4m\""
Jul 15 13:20:28.335607 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:28.335581    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-5h8dj"]
Jul 15 13:20:28.421240 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:28.421169    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0f1c18dc-9412-4dbb-b101-da1a6d5a091e-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-5h8dj\" (UID: \"0f1c18dc-9412-4dbb-b101-da1a6d5a091e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5h8dj"
Jul 15 13:20:28.421240 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:28.421243    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wm8zk\" (UniqueName: \"kubernetes.io/projected/0f1c18dc-9412-4dbb-b101-da1a6d5a091e-kube-api-access-wm8zk\") pod \"cert-manager-cainjector-559cdd8c87-5h8dj\" (UID: \"0f1c18dc-9412-4dbb-b101-da1a6d5a091e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5h8dj"
Jul 15 13:20:28.522297 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:28.522257    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0f1c18dc-9412-4dbb-b101-da1a6d5a091e-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-5h8dj\" (UID: \"0f1c18dc-9412-4dbb-b101-da1a6d5a091e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5h8dj"
Jul 15 13:20:28.522453 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:28.522317    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wm8zk\" (UniqueName: \"kubernetes.io/projected/0f1c18dc-9412-4dbb-b101-da1a6d5a091e-kube-api-access-wm8zk\") pod \"cert-manager-cainjector-559cdd8c87-5h8dj\" (UID: \"0f1c18dc-9412-4dbb-b101-da1a6d5a091e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5h8dj"
Jul 15 13:20:28.533428 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:28.533396    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0f1c18dc-9412-4dbb-b101-da1a6d5a091e-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-5h8dj\" (UID: \"0f1c18dc-9412-4dbb-b101-da1a6d5a091e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5h8dj"
Jul 15 13:20:28.533676 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:28.533654    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wm8zk\" (UniqueName: \"kubernetes.io/projected/0f1c18dc-9412-4dbb-b101-da1a6d5a091e-kube-api-access-wm8zk\") pod \"cert-manager-cainjector-559cdd8c87-5h8dj\" (UID: \"0f1c18dc-9412-4dbb-b101-da1a6d5a091e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5h8dj"
Jul 15 13:20:28.637571 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:28.637479    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5h8dj"
Jul 15 13:20:28.779868 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:28.779822    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-5h8dj"]
Jul 15 13:20:29.555945 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:20:29.555911    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0f1c18dc_9412_4dbb_b101_da1a6d5a091e.slice/crio-f15ba7de19537a93d642b14ee0952ba361511a0d7c05a7d392012f5245092f76 WatchSource:0}: Error finding container f15ba7de19537a93d642b14ee0952ba361511a0d7c05a7d392012f5245092f76: Status 404 returned error can't find the container with id f15ba7de19537a93d642b14ee0952ba361511a0d7c05a7d392012f5245092f76
Jul 15 13:20:30.279126 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:30.279081    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5h8dj" event={"ID":"0f1c18dc-9412-4dbb-b101-da1a6d5a091e","Type":"ContainerStarted","Data":"25f2dbbc8a48c2160cc096fa70b3d47adafdbed102e511c0f2d38cff2b163104"}
Jul 15 13:20:30.279344 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:30.279139    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5h8dj" event={"ID":"0f1c18dc-9412-4dbb-b101-da1a6d5a091e","Type":"ContainerStarted","Data":"f15ba7de19537a93d642b14ee0952ba361511a0d7c05a7d392012f5245092f76"}
Jul 15 13:20:30.280853 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:30.280817    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-gpf47" event={"ID":"5a1d86a9-b4c1-42cb-bcb1-848f44be1e23","Type":"ContainerStarted","Data":"f99cbb8c4523d646e0dc983b2bed3856180795dfed4814e25ef02b9b018a2cf4"}
Jul 15 13:20:30.280998 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:30.280975    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-gpf47"
Jul 15 13:20:30.307405 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:30.307355    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5h8dj" podStartSLOduration=1.780911026 podStartE2EDuration="2.307339399s" totalImagesPullingTime="526.428373ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:20:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:20:30.305763014 +0000 UTC m=+550.393549958" watchObservedRunningTime="2026-07-15 13:20:30.307339399 +0000 UTC m=+550.395126341"
Jul 15 13:20:30.343771 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:30.343675    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-gpf47" podStartSLOduration=1.781033973 podStartE2EDuration="4.343657715s" totalImagesPullingTime="2.562623742s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:20:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:20:30.343028917 +0000 UTC m=+550.430815860" watchObservedRunningTime="2026-07-15 13:20:30.343657715 +0000 UTC m=+550.431444657"
Jul 15 13:20:31.287194 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:31.287159    2578 generic.go:356] "Generic (PLEG): container finished" podID="7a67a246-9bd1-4994-befd-0cae0dda5df8" containerID="76527619e0e5d846859ee30657300b7a70774d438ee222d33d1484e5d4661e66" exitCode=0
Jul 15 13:20:31.287631 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:31.287245    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdjmbn" event={"ID":"7a67a246-9bd1-4994-befd-0cae0dda5df8","Type":"ContainerDied","Data":"76527619e0e5d846859ee30657300b7a70774d438ee222d33d1484e5d4661e66"}
Jul 15 13:20:32.294030 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:32.293995    2578 generic.go:356] "Generic (PLEG): container finished" podID="7a67a246-9bd1-4994-befd-0cae0dda5df8" containerID="f667169a1cf554fad5a32c8ffdf8c55b81a6761ff548264918f21eb5bbe7fc56" exitCode=0
Jul 15 13:20:32.294435 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:32.294083    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdjmbn" event={"ID":"7a67a246-9bd1-4994-befd-0cae0dda5df8","Type":"ContainerDied","Data":"f667169a1cf554fad5a32c8ffdf8c55b81a6761ff548264918f21eb5bbe7fc56"}
Jul 15 13:20:33.424015 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:33.423991    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdjmbn"
Jul 15 13:20:33.565872 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:33.565788    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h6lmt\" (UniqueName: \"kubernetes.io/projected/7a67a246-9bd1-4994-befd-0cae0dda5df8-kube-api-access-h6lmt\") pod \"7a67a246-9bd1-4994-befd-0cae0dda5df8\" (UID: \"7a67a246-9bd1-4994-befd-0cae0dda5df8\") "
Jul 15 13:20:33.565872 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:33.565856    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a67a246-9bd1-4994-befd-0cae0dda5df8-util\") pod \"7a67a246-9bd1-4994-befd-0cae0dda5df8\" (UID: \"7a67a246-9bd1-4994-befd-0cae0dda5df8\") "
Jul 15 13:20:33.566063 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:33.565890    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a67a246-9bd1-4994-befd-0cae0dda5df8-bundle\") pod \"7a67a246-9bd1-4994-befd-0cae0dda5df8\" (UID: \"7a67a246-9bd1-4994-befd-0cae0dda5df8\") "
Jul 15 13:20:33.566281 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:33.566258    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a67a246-9bd1-4994-befd-0cae0dda5df8-bundle" (OuterVolumeSpecName: "bundle") pod "7a67a246-9bd1-4994-befd-0cae0dda5df8" (UID: "7a67a246-9bd1-4994-befd-0cae0dda5df8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:20:33.567951 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:33.567929    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a67a246-9bd1-4994-befd-0cae0dda5df8-kube-api-access-h6lmt" (OuterVolumeSpecName: "kube-api-access-h6lmt") pod "7a67a246-9bd1-4994-befd-0cae0dda5df8" (UID: "7a67a246-9bd1-4994-befd-0cae0dda5df8"). InnerVolumeSpecName "kube-api-access-h6lmt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:20:33.570725 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:33.570704    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a67a246-9bd1-4994-befd-0cae0dda5df8-util" (OuterVolumeSpecName: "util") pod "7a67a246-9bd1-4994-befd-0cae0dda5df8" (UID: "7a67a246-9bd1-4994-befd-0cae0dda5df8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:20:33.667061 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:33.667022    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h6lmt\" (UniqueName: \"kubernetes.io/projected/7a67a246-9bd1-4994-befd-0cae0dda5df8-kube-api-access-h6lmt\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:20:33.667061 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:33.667053    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a67a246-9bd1-4994-befd-0cae0dda5df8-util\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:20:33.667061 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:33.667064    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a67a246-9bd1-4994-befd-0cae0dda5df8-bundle\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:20:34.304093 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:34.304058    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdjmbn" event={"ID":"7a67a246-9bd1-4994-befd-0cae0dda5df8","Type":"ContainerDied","Data":"442ba7e605c3e9090123aa53e963734c9313fc67ccea84322668b4bc99f6212a"}
Jul 15 13:20:34.304093 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:34.304091    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdjmbn"
Jul 15 13:20:34.304323 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:34.304134    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="442ba7e605c3e9090123aa53e963734c9313fc67ccea84322668b4bc99f6212a"
Jul 15 13:20:36.290404 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:36.290374    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-gpf47"
Jul 15 13:20:40.424783 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:40.424756    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9wqrl"]
Jul 15 13:20:40.425136 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:40.425030    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a67a246-9bd1-4994-befd-0cae0dda5df8" containerName="extract"
Jul 15 13:20:40.425136 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:40.425040    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a67a246-9bd1-4994-befd-0cae0dda5df8" containerName="extract"
Jul 15 13:20:40.425136 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:40.425050    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a67a246-9bd1-4994-befd-0cae0dda5df8" containerName="util"
Jul 15 13:20:40.425136 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:40.425056    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a67a246-9bd1-4994-befd-0cae0dda5df8" containerName="util"
Jul 15 13:20:40.425136 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:40.425063    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a67a246-9bd1-4994-befd-0cae0dda5df8" containerName="pull"
Jul 15 13:20:40.425136 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:40.425069    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a67a246-9bd1-4994-befd-0cae0dda5df8" containerName="pull"
Jul 15 13:20:40.425136 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:40.425121    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a67a246-9bd1-4994-befd-0cae0dda5df8" containerName="extract"
Jul 15 13:20:40.428617 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:40.428599    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9wqrl"
Jul 15 13:20:40.431696 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:40.431673    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 15 13:20:40.431973 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:40.431956    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 15 13:20:40.433015 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:40.432996    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-mgfx9\""
Jul 15 13:20:40.444690 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:40.444666    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9wqrl"]
Jul 15 13:20:40.526380 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:40.526347    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09de1eb0-0f47-4e76-91bd-9256aa4b2e8b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9wqrl\" (UID: \"09de1eb0-0f47-4e76-91bd-9256aa4b2e8b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9wqrl"
Jul 15 13:20:40.526523 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:40.526411    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cp9xs\" (UniqueName: \"kubernetes.io/projected/09de1eb0-0f47-4e76-91bd-9256aa4b2e8b-kube-api-access-cp9xs\") pod \"openshift-lws-operator-fd8ccff4c-9wqrl\" (UID: \"09de1eb0-0f47-4e76-91bd-9256aa4b2e8b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9wqrl"
Jul 15 13:20:40.627622 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:40.627585    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cp9xs\" (UniqueName: \"kubernetes.io/projected/09de1eb0-0f47-4e76-91bd-9256aa4b2e8b-kube-api-access-cp9xs\") pod \"openshift-lws-operator-fd8ccff4c-9wqrl\" (UID: \"09de1eb0-0f47-4e76-91bd-9256aa4b2e8b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9wqrl"
Jul 15 13:20:40.627818 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:40.627641    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09de1eb0-0f47-4e76-91bd-9256aa4b2e8b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9wqrl\" (UID: \"09de1eb0-0f47-4e76-91bd-9256aa4b2e8b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9wqrl"
Jul 15 13:20:40.627987 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:40.627966    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09de1eb0-0f47-4e76-91bd-9256aa4b2e8b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9wqrl\" (UID: \"09de1eb0-0f47-4e76-91bd-9256aa4b2e8b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9wqrl"
Jul 15 13:20:40.638915 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:40.638889    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cp9xs\" (UniqueName: \"kubernetes.io/projected/09de1eb0-0f47-4e76-91bd-9256aa4b2e8b-kube-api-access-cp9xs\") pod \"openshift-lws-operator-fd8ccff4c-9wqrl\" (UID: \"09de1eb0-0f47-4e76-91bd-9256aa4b2e8b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9wqrl"
Jul 15 13:20:40.737747 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:40.737715    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9wqrl"
Jul 15 13:20:40.869567 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:40.869362    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9wqrl"]
Jul 15 13:20:40.872587 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:20:40.872553    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod09de1eb0_0f47_4e76_91bd_9256aa4b2e8b.slice/crio-c9c2a3823d746b1fb5f9b7a72fbb6d67788fc4032847561ecabb3f691b4ed26f WatchSource:0}: Error finding container c9c2a3823d746b1fb5f9b7a72fbb6d67788fc4032847561ecabb3f691b4ed26f: Status 404 returned error can't find the container with id c9c2a3823d746b1fb5f9b7a72fbb6d67788fc4032847561ecabb3f691b4ed26f
Jul 15 13:20:41.338171 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:41.338134    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9wqrl" event={"ID":"09de1eb0-0f47-4e76-91bd-9256aa4b2e8b","Type":"ContainerStarted","Data":"c9c2a3823d746b1fb5f9b7a72fbb6d67788fc4032847561ecabb3f691b4ed26f"}
Jul 15 13:20:43.348326 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:43.348292    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9wqrl" event={"ID":"09de1eb0-0f47-4e76-91bd-9256aa4b2e8b","Type":"ContainerStarted","Data":"b84c4ec935ed97540b6dba03279fbab9efcdc3b69762d0084da7cb0c5530a4d8"}
Jul 15 13:20:43.367957 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:43.367903    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9wqrl" podStartSLOduration=1.366946564 podStartE2EDuration="3.367881574s" totalImagesPullingTime="2.00093501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:20:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:20:43.365705595 +0000 UTC m=+563.453492535" watchObservedRunningTime="2026-07-15 13:20:43.367881574 +0000 UTC m=+563.455668515"
Jul 15 13:20:46.094535 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:46.094500    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvn7vc"]
Jul 15 13:20:46.097807 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:46.097790    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvn7vc"
Jul 15 13:20:46.100704 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:46.100677    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 15 13:20:46.101836 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:46.101818    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 15 13:20:46.101836 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:46.101825    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wxvrz\""
Jul 15 13:20:46.106349 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:46.106324    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvn7vc"]
Jul 15 13:20:46.171632 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:46.171598    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpcn2\" (UniqueName: \"kubernetes.io/projected/d3b50b7d-b477-4edc-b65e-04f694eebfaf-kube-api-access-bpcn2\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvn7vc\" (UID: \"d3b50b7d-b477-4edc-b65e-04f694eebfaf\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvn7vc"
Jul 15 13:20:46.171821 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:46.171656    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3b50b7d-b477-4edc-b65e-04f694eebfaf-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvn7vc\" (UID: \"d3b50b7d-b477-4edc-b65e-04f694eebfaf\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvn7vc"
Jul 15 13:20:46.171821 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:46.171772    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3b50b7d-b477-4edc-b65e-04f694eebfaf-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvn7vc\" (UID: \"d3b50b7d-b477-4edc-b65e-04f694eebfaf\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvn7vc"
Jul 15 13:20:46.272754 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:46.272713    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3b50b7d-b477-4edc-b65e-04f694eebfaf-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvn7vc\" (UID: \"d3b50b7d-b477-4edc-b65e-04f694eebfaf\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvn7vc"
Jul 15 13:20:46.272754 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:46.272758    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpcn2\" (UniqueName: \"kubernetes.io/projected/d3b50b7d-b477-4edc-b65e-04f694eebfaf-kube-api-access-bpcn2\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvn7vc\" (UID: \"d3b50b7d-b477-4edc-b65e-04f694eebfaf\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvn7vc"
Jul 15 13:20:46.272984 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:46.272804    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3b50b7d-b477-4edc-b65e-04f694eebfaf-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvn7vc\" (UID: \"d3b50b7d-b477-4edc-b65e-04f694eebfaf\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvn7vc"
Jul 15 13:20:46.273230 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:46.273178    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3b50b7d-b477-4edc-b65e-04f694eebfaf-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvn7vc\" (UID: \"d3b50b7d-b477-4edc-b65e-04f694eebfaf\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvn7vc"
Jul 15 13:20:46.273313 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:46.273187    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3b50b7d-b477-4edc-b65e-04f694eebfaf-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvn7vc\" (UID: \"d3b50b7d-b477-4edc-b65e-04f694eebfaf\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvn7vc"
Jul 15 13:20:46.282438 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:46.282414    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpcn2\" (UniqueName: \"kubernetes.io/projected/d3b50b7d-b477-4edc-b65e-04f694eebfaf-kube-api-access-bpcn2\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvn7vc\" (UID: \"d3b50b7d-b477-4edc-b65e-04f694eebfaf\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvn7vc"
Jul 15 13:20:46.407281 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:46.407170    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvn7vc"
Jul 15 13:20:46.551589 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:46.551567    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvn7vc"]
Jul 15 13:20:46.554190 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:20:46.554162    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3b50b7d_b477_4edc_b65e_04f694eebfaf.slice/crio-e4683e13408ffd335abf150ad2ab7e2208fc556cbbd979f1a4d740c76cc1532e WatchSource:0}: Error finding container e4683e13408ffd335abf150ad2ab7e2208fc556cbbd979f1a4d740c76cc1532e: Status 404 returned error can't find the container with id e4683e13408ffd335abf150ad2ab7e2208fc556cbbd979f1a4d740c76cc1532e
Jul 15 13:20:47.372977 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:47.372946    2578 generic.go:356] "Generic (PLEG): container finished" podID="d3b50b7d-b477-4edc-b65e-04f694eebfaf" containerID="8a025b05c1c8787e997a7acbb060d630cde0766fd0f63df5b78fa7dba194418b" exitCode=0
Jul 15 13:20:47.373369 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:47.373010    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvn7vc" event={"ID":"d3b50b7d-b477-4edc-b65e-04f694eebfaf","Type":"ContainerDied","Data":"8a025b05c1c8787e997a7acbb060d630cde0766fd0f63df5b78fa7dba194418b"}
Jul 15 13:20:47.373369 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:47.373040    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvn7vc" event={"ID":"d3b50b7d-b477-4edc-b65e-04f694eebfaf","Type":"ContainerStarted","Data":"e4683e13408ffd335abf150ad2ab7e2208fc556cbbd979f1a4d740c76cc1532e"}
Jul 15 13:20:49.382734 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:49.382699    2578 generic.go:356] "Generic (PLEG): container finished" podID="d3b50b7d-b477-4edc-b65e-04f694eebfaf" containerID="229ff490ba661bdbd0a8e16b841b009980c6fc983931b4b78ca65fb74ff7c2a4" exitCode=0
Jul 15 13:20:49.383110 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:49.382774    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvn7vc" event={"ID":"d3b50b7d-b477-4edc-b65e-04f694eebfaf","Type":"ContainerDied","Data":"229ff490ba661bdbd0a8e16b841b009980c6fc983931b4b78ca65fb74ff7c2a4"}
Jul 15 13:20:50.388902 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:50.388868    2578 generic.go:356] "Generic (PLEG): container finished" podID="d3b50b7d-b477-4edc-b65e-04f694eebfaf" containerID="a4664e4e2b46a4e88cfbc5c67ef09fa269977eae819d3f5a3f52197b9d977aca" exitCode=0
Jul 15 13:20:50.389348 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:50.388908    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvn7vc" event={"ID":"d3b50b7d-b477-4edc-b65e-04f694eebfaf","Type":"ContainerDied","Data":"a4664e4e2b46a4e88cfbc5c67ef09fa269977eae819d3f5a3f52197b9d977aca"}
Jul 15 13:20:51.517875 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:51.517850    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvn7vc"
Jul 15 13:20:51.616870 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:51.616831    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bpcn2\" (UniqueName: \"kubernetes.io/projected/d3b50b7d-b477-4edc-b65e-04f694eebfaf-kube-api-access-bpcn2\") pod \"d3b50b7d-b477-4edc-b65e-04f694eebfaf\" (UID: \"d3b50b7d-b477-4edc-b65e-04f694eebfaf\") "
Jul 15 13:20:51.616870 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:51.616871    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3b50b7d-b477-4edc-b65e-04f694eebfaf-bundle\") pod \"d3b50b7d-b477-4edc-b65e-04f694eebfaf\" (UID: \"d3b50b7d-b477-4edc-b65e-04f694eebfaf\") "
Jul 15 13:20:51.617077 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:51.616904    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3b50b7d-b477-4edc-b65e-04f694eebfaf-util\") pod \"d3b50b7d-b477-4edc-b65e-04f694eebfaf\" (UID: \"d3b50b7d-b477-4edc-b65e-04f694eebfaf\") "
Jul 15 13:20:51.617647 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:51.617605    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3b50b7d-b477-4edc-b65e-04f694eebfaf-bundle" (OuterVolumeSpecName: "bundle") pod "d3b50b7d-b477-4edc-b65e-04f694eebfaf" (UID: "d3b50b7d-b477-4edc-b65e-04f694eebfaf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:20:51.618991 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:51.618965    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3b50b7d-b477-4edc-b65e-04f694eebfaf-kube-api-access-bpcn2" (OuterVolumeSpecName: "kube-api-access-bpcn2") pod "d3b50b7d-b477-4edc-b65e-04f694eebfaf" (UID: "d3b50b7d-b477-4edc-b65e-04f694eebfaf"). InnerVolumeSpecName "kube-api-access-bpcn2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:20:51.622482 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:51.622460    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3b50b7d-b477-4edc-b65e-04f694eebfaf-util" (OuterVolumeSpecName: "util") pod "d3b50b7d-b477-4edc-b65e-04f694eebfaf" (UID: "d3b50b7d-b477-4edc-b65e-04f694eebfaf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:20:51.718166 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:51.718135    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3b50b7d-b477-4edc-b65e-04f694eebfaf-util\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:20:51.718166 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:51.718165    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bpcn2\" (UniqueName: \"kubernetes.io/projected/d3b50b7d-b477-4edc-b65e-04f694eebfaf-kube-api-access-bpcn2\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:20:51.718451 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:51.718176    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3b50b7d-b477-4edc-b65e-04f694eebfaf-bundle\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:20:52.398700 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:52.398669    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvn7vc"
Jul 15 13:20:52.398700 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:52.398686    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvn7vc" event={"ID":"d3b50b7d-b477-4edc-b65e-04f694eebfaf","Type":"ContainerDied","Data":"e4683e13408ffd335abf150ad2ab7e2208fc556cbbd979f1a4d740c76cc1532e"}
Jul 15 13:20:52.398872 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:20:52.398729    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e4683e13408ffd335abf150ad2ab7e2208fc556cbbd979f1a4d740c76cc1532e"
Jul 15 13:21:02.077932 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:02.077894    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-kd8s4"]
Jul 15 13:21:02.078372 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:02.078229    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3b50b7d-b477-4edc-b65e-04f694eebfaf" containerName="pull"
Jul 15 13:21:02.078372 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:02.078244    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3b50b7d-b477-4edc-b65e-04f694eebfaf" containerName="pull"
Jul 15 13:21:02.078372 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:02.078252    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3b50b7d-b477-4edc-b65e-04f694eebfaf" containerName="util"
Jul 15 13:21:02.078372 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:02.078258    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3b50b7d-b477-4edc-b65e-04f694eebfaf" containerName="util"
Jul 15 13:21:02.078372 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:02.078276    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3b50b7d-b477-4edc-b65e-04f694eebfaf" containerName="extract"
Jul 15 13:21:02.078372 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:02.078281    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3b50b7d-b477-4edc-b65e-04f694eebfaf" containerName="extract"
Jul 15 13:21:02.078372 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:02.078349    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3b50b7d-b477-4edc-b65e-04f694eebfaf" containerName="extract"
Jul 15 13:21:02.119750 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:02.119711    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-kd8s4"]
Jul 15 13:21:02.119905 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:02.119814    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-kd8s4"
Jul 15 13:21:02.123804 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:02.123779    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 15 13:21:02.124523 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:02.124500    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-bqztw\""
Jul 15 13:21:02.124523 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:02.124515    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 15 13:21:02.124723 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:02.124515    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 15 13:21:02.125057 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:02.125042    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 15 13:21:02.209290 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:02.209248    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bade1880-aa01-4b14-af8c-fd371573ae59-tmp\") pod \"opendatahub-operator-controller-manager-5f7f774c7f-kd8s4\" (UID: \"bade1880-aa01-4b14-af8c-fd371573ae59\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-kd8s4"
Jul 15 13:21:02.209290 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:02.209287    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bade1880-aa01-4b14-af8c-fd371573ae59-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f7f774c7f-kd8s4\" (UID: \"bade1880-aa01-4b14-af8c-fd371573ae59\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-kd8s4"
Jul 15 13:21:02.209577 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:02.209309    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bade1880-aa01-4b14-af8c-fd371573ae59-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f7f774c7f-kd8s4\" (UID: \"bade1880-aa01-4b14-af8c-fd371573ae59\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-kd8s4"
Jul 15 13:21:02.209577 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:02.209365    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfms9\" (UniqueName: \"kubernetes.io/projected/bade1880-aa01-4b14-af8c-fd371573ae59-kube-api-access-pfms9\") pod \"opendatahub-operator-controller-manager-5f7f774c7f-kd8s4\" (UID: \"bade1880-aa01-4b14-af8c-fd371573ae59\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-kd8s4"
Jul 15 13:21:02.209577 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:02.209403    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bade1880-aa01-4b14-af8c-fd371573ae59-manifests\") pod \"opendatahub-operator-controller-manager-5f7f774c7f-kd8s4\" (UID: \"bade1880-aa01-4b14-af8c-fd371573ae59\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-kd8s4"
Jul 15 13:21:02.309994 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:02.309956    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bade1880-aa01-4b14-af8c-fd371573ae59-tmp\") pod \"opendatahub-operator-controller-manager-5f7f774c7f-kd8s4\" (UID: \"bade1880-aa01-4b14-af8c-fd371573ae59\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-kd8s4"
Jul 15 13:21:02.310173 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:02.309998    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bade1880-aa01-4b14-af8c-fd371573ae59-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f7f774c7f-kd8s4\" (UID: \"bade1880-aa01-4b14-af8c-fd371573ae59\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-kd8s4"
Jul 15 13:21:02.310173 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:02.310035    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bade1880-aa01-4b14-af8c-fd371573ae59-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f7f774c7f-kd8s4\" (UID: \"bade1880-aa01-4b14-af8c-fd371573ae59\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-kd8s4"
Jul 15 13:21:02.310173 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:02.310080    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfms9\" (UniqueName: \"kubernetes.io/projected/bade1880-aa01-4b14-af8c-fd371573ae59-kube-api-access-pfms9\") pod \"opendatahub-operator-controller-manager-5f7f774c7f-kd8s4\" (UID: \"bade1880-aa01-4b14-af8c-fd371573ae59\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-kd8s4"
Jul 15 13:21:02.310173 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:02.310139    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bade1880-aa01-4b14-af8c-fd371573ae59-manifests\") pod \"opendatahub-operator-controller-manager-5f7f774c7f-kd8s4\" (UID: \"bade1880-aa01-4b14-af8c-fd371573ae59\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-kd8s4"
Jul 15 13:21:02.310521 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:02.310499    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bade1880-aa01-4b14-af8c-fd371573ae59-manifests\") pod \"opendatahub-operator-controller-manager-5f7f774c7f-kd8s4\" (UID: \"bade1880-aa01-4b14-af8c-fd371573ae59\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-kd8s4"
Jul 15 13:21:02.312399 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:02.312372    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bade1880-aa01-4b14-af8c-fd371573ae59-tmp\") pod \"opendatahub-operator-controller-manager-5f7f774c7f-kd8s4\" (UID: \"bade1880-aa01-4b14-af8c-fd371573ae59\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-kd8s4"
Jul 15 13:21:02.312701 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:02.312679    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bade1880-aa01-4b14-af8c-fd371573ae59-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f7f774c7f-kd8s4\" (UID: \"bade1880-aa01-4b14-af8c-fd371573ae59\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-kd8s4"
Jul 15 13:21:02.312778 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:02.312685    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bade1880-aa01-4b14-af8c-fd371573ae59-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f7f774c7f-kd8s4\" (UID: \"bade1880-aa01-4b14-af8c-fd371573ae59\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-kd8s4"
Jul 15 13:21:02.322903 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:02.322869    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfms9\" (UniqueName: \"kubernetes.io/projected/bade1880-aa01-4b14-af8c-fd371573ae59-kube-api-access-pfms9\") pod \"opendatahub-operator-controller-manager-5f7f774c7f-kd8s4\" (UID: \"bade1880-aa01-4b14-af8c-fd371573ae59\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-kd8s4"
Jul 15 13:21:02.432258 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:02.432153    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-kd8s4"
Jul 15 13:21:02.585701 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:02.585666    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-kd8s4"]
Jul 15 13:21:02.589323 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:21:02.589297    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbade1880_aa01_4b14_af8c_fd371573ae59.slice/crio-99a62c5228972eb475b75e570f4cea2e81a6955e396546195a544ca8f7276af3 WatchSource:0}: Error finding container 99a62c5228972eb475b75e570f4cea2e81a6955e396546195a544ca8f7276af3: Status 404 returned error can't find the container with id 99a62c5228972eb475b75e570f4cea2e81a6955e396546195a544ca8f7276af3
Jul 15 13:21:03.456814 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:03.456772    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-kd8s4" event={"ID":"bade1880-aa01-4b14-af8c-fd371573ae59","Type":"ContainerStarted","Data":"99a62c5228972eb475b75e570f4cea2e81a6955e396546195a544ca8f7276af3"}
Jul 15 13:21:06.474346 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:06.474313    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-kd8s4" event={"ID":"bade1880-aa01-4b14-af8c-fd371573ae59","Type":"ContainerStarted","Data":"cb26945980c28323db5249a8759794ab3b8f8736ba596b520df342cdc151732a"}
Jul 15 13:21:07.481410 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:07.481377    2578 generic.go:356] "Generic (PLEG): container finished" podID="bade1880-aa01-4b14-af8c-fd371573ae59" containerID="cb26945980c28323db5249a8759794ab3b8f8736ba596b520df342cdc151732a" exitCode=0
Jul 15 13:21:07.481779 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:07.481433    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-kd8s4" event={"ID":"bade1880-aa01-4b14-af8c-fd371573ae59","Type":"ContainerDied","Data":"cb26945980c28323db5249a8759794ab3b8f8736ba596b520df342cdc151732a"}
Jul 15 13:21:08.487734 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:08.487694    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-kd8s4" event={"ID":"bade1880-aa01-4b14-af8c-fd371573ae59","Type":"ContainerStarted","Data":"e17ae4efbb7e5ed9bed3e6a762c855f252e76691d02d573383434aceec0761cc"}
Jul 15 13:21:08.488092 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:08.487797    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-kd8s4"
Jul 15 13:21:19.495373 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:19.495339    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-kd8s4"
Jul 15 13:21:19.521223 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:19.521155    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-kd8s4" podStartSLOduration=12.790159073 podStartE2EDuration="17.521138149s" totalImagesPullingTime="3.687236186s" totalInitContainerRuntime="1.04374289s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:21:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:21:08.527879808 +0000 UTC m=+588.615666750" watchObservedRunningTime="2026-07-15 13:21:19.521138149 +0000 UTC m=+599.608925090"
Jul 15 13:21:20.289962 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:20.289936    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-t4bfh_c21b11d6-3242-4dd5-8b75-74dad14868e9/console-operator/1.log"
Jul 15 13:21:20.290383 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:20.290358    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-t4bfh_c21b11d6-3242-4dd5-8b75-74dad14868e9/console-operator/1.log"
Jul 15 13:21:20.293861 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:20.293842    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt6q4_49ca8630-3cc0-4dbb-8c80-a948ad0de2b4/ovn-acl-logging/0.log"
Jul 15 13:21:20.294460 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:20.294443    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt6q4_49ca8630-3cc0-4dbb-8c80-a948ad0de2b4/ovn-acl-logging/0.log"
Jul 15 13:21:22.146454 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:22.146417    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-78dd6b4fb5-pzxw7"]
Jul 15 13:21:22.151416 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:22.151397    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-78dd6b4fb5-pzxw7"
Jul 15 13:21:22.163026 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:22.163005    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 15 13:21:22.163133 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:22.163005    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 15 13:21:22.163133 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:22.163072    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-mx7rx\""
Jul 15 13:21:22.174415 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:22.174383    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-78dd6b4fb5-pzxw7"]
Jul 15 13:21:22.263941 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:22.263910    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpr2m\" (UniqueName: \"kubernetes.io/projected/0d58d809-78e5-42cd-958a-2ea9d273a160-kube-api-access-rpr2m\") pod \"kube-auth-proxy-78dd6b4fb5-pzxw7\" (UID: \"0d58d809-78e5-42cd-958a-2ea9d273a160\") " pod="openshift-ingress/kube-auth-proxy-78dd6b4fb5-pzxw7"
Jul 15 13:21:22.264126 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:22.263959    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0d58d809-78e5-42cd-958a-2ea9d273a160-tmp\") pod \"kube-auth-proxy-78dd6b4fb5-pzxw7\" (UID: \"0d58d809-78e5-42cd-958a-2ea9d273a160\") " pod="openshift-ingress/kube-auth-proxy-78dd6b4fb5-pzxw7"
Jul 15 13:21:22.264126 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:22.264001    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d58d809-78e5-42cd-958a-2ea9d273a160-tls-certs\") pod \"kube-auth-proxy-78dd6b4fb5-pzxw7\" (UID: \"0d58d809-78e5-42cd-958a-2ea9d273a160\") " pod="openshift-ingress/kube-auth-proxy-78dd6b4fb5-pzxw7"
Jul 15 13:21:22.365034 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:22.364996    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0d58d809-78e5-42cd-958a-2ea9d273a160-tmp\") pod \"kube-auth-proxy-78dd6b4fb5-pzxw7\" (UID: \"0d58d809-78e5-42cd-958a-2ea9d273a160\") " pod="openshift-ingress/kube-auth-proxy-78dd6b4fb5-pzxw7"
Jul 15 13:21:22.365034 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:22.365036    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d58d809-78e5-42cd-958a-2ea9d273a160-tls-certs\") pod \"kube-auth-proxy-78dd6b4fb5-pzxw7\" (UID: \"0d58d809-78e5-42cd-958a-2ea9d273a160\") " pod="openshift-ingress/kube-auth-proxy-78dd6b4fb5-pzxw7"
Jul 15 13:21:22.365322 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:22.365092    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpr2m\" (UniqueName: \"kubernetes.io/projected/0d58d809-78e5-42cd-958a-2ea9d273a160-kube-api-access-rpr2m\") pod \"kube-auth-proxy-78dd6b4fb5-pzxw7\" (UID: \"0d58d809-78e5-42cd-958a-2ea9d273a160\") " pod="openshift-ingress/kube-auth-proxy-78dd6b4fb5-pzxw7"
Jul 15 13:21:22.365322 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:21:22.365236    2578 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 15 13:21:22.365322 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:21:22.365320    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d58d809-78e5-42cd-958a-2ea9d273a160-tls-certs podName:0d58d809-78e5-42cd-958a-2ea9d273a160 nodeName:}" failed. No retries permitted until 2026-07-15 13:21:22.865294602 +0000 UTC m=+602.953081526 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/0d58d809-78e5-42cd-958a-2ea9d273a160-tls-certs") pod "kube-auth-proxy-78dd6b4fb5-pzxw7" (UID: "0d58d809-78e5-42cd-958a-2ea9d273a160") : secret "kube-auth-proxy-tls" not found
Jul 15 13:21:22.367288 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:22.367265    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0d58d809-78e5-42cd-958a-2ea9d273a160-tmp\") pod \"kube-auth-proxy-78dd6b4fb5-pzxw7\" (UID: \"0d58d809-78e5-42cd-958a-2ea9d273a160\") " pod="openshift-ingress/kube-auth-proxy-78dd6b4fb5-pzxw7"
Jul 15 13:21:22.391218 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:22.391181    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpr2m\" (UniqueName: \"kubernetes.io/projected/0d58d809-78e5-42cd-958a-2ea9d273a160-kube-api-access-rpr2m\") pod \"kube-auth-proxy-78dd6b4fb5-pzxw7\" (UID: \"0d58d809-78e5-42cd-958a-2ea9d273a160\") " pod="openshift-ingress/kube-auth-proxy-78dd6b4fb5-pzxw7"
Jul 15 13:21:22.870016 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:22.869975    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d58d809-78e5-42cd-958a-2ea9d273a160-tls-certs\") pod \"kube-auth-proxy-78dd6b4fb5-pzxw7\" (UID: \"0d58d809-78e5-42cd-958a-2ea9d273a160\") " pod="openshift-ingress/kube-auth-proxy-78dd6b4fb5-pzxw7"
Jul 15 13:21:22.872441 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:22.872413    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d58d809-78e5-42cd-958a-2ea9d273a160-tls-certs\") pod \"kube-auth-proxy-78dd6b4fb5-pzxw7\" (UID: \"0d58d809-78e5-42cd-958a-2ea9d273a160\") " pod="openshift-ingress/kube-auth-proxy-78dd6b4fb5-pzxw7"
Jul 15 13:21:23.060627 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:23.060592    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-78dd6b4fb5-pzxw7"
Jul 15 13:21:23.212345 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:21:23.212318    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d58d809_78e5_42cd_958a_2ea9d273a160.slice/crio-312b645917ab09fba4e661300af661eca1d11d249c854855ed7fb36eeff7ffd8 WatchSource:0}: Error finding container 312b645917ab09fba4e661300af661eca1d11d249c854855ed7fb36eeff7ffd8: Status 404 returned error can't find the container with id 312b645917ab09fba4e661300af661eca1d11d249c854855ed7fb36eeff7ffd8
Jul 15 13:21:23.217917 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:23.217895    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-78dd6b4fb5-pzxw7"]
Jul 15 13:21:23.557247 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:23.557197    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-78dd6b4fb5-pzxw7" event={"ID":"0d58d809-78e5-42cd-958a-2ea9d273a160","Type":"ContainerStarted","Data":"312b645917ab09fba4e661300af661eca1d11d249c854855ed7fb36eeff7ffd8"}
Jul 15 13:21:26.572590 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:26.572556    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-78dd6b4fb5-pzxw7" event={"ID":"0d58d809-78e5-42cd-958a-2ea9d273a160","Type":"ContainerStarted","Data":"302e8173f1f7fbda959e18d4c4cb2570ffe056eb1a72a209cb0bdb9d36c32045"}
Jul 15 13:21:26.593609 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:26.593560    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-78dd6b4fb5-pzxw7" podStartSLOduration=1.646849019 podStartE2EDuration="4.593546175s" totalImagesPullingTime="2.946697156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:21:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:21:26.592127406 +0000 UTC m=+606.679914347" watchObservedRunningTime="2026-07-15 13:21:26.593546175 +0000 UTC m=+606.681333117"
Jul 15 13:21:30.483370 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:30.483332    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678986s8"]
Jul 15 13:21:30.486866 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:30.486843    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678986s8"
Jul 15 13:21:30.501972 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:30.501954    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 15 13:21:30.502115 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:30.502097    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-jc77n\""
Jul 15 13:21:30.526621 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:30.526597    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678986s8"]
Jul 15 13:21:30.539006 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:30.538984    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9ba2ba5-446b-40cf-9af9-7e5012f717df-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678986s8\" (UID: \"a9ba2ba5-446b-40cf-9af9-7e5012f717df\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678986s8"
Jul 15 13:21:30.539141 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:30.539015    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9ba2ba5-446b-40cf-9af9-7e5012f717df-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678986s8\" (UID: \"a9ba2ba5-446b-40cf-9af9-7e5012f717df\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678986s8"
Jul 15 13:21:30.539141 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:30.539032    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9ba2ba5-446b-40cf-9af9-7e5012f717df-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678986s8\" (UID: \"a9ba2ba5-446b-40cf-9af9-7e5012f717df\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678986s8"
Jul 15 13:21:30.539141 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:30.539057    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6qtx\" (UniqueName: \"kubernetes.io/projected/a9ba2ba5-446b-40cf-9af9-7e5012f717df-kube-api-access-j6qtx\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678986s8\" (UID: \"a9ba2ba5-446b-40cf-9af9-7e5012f717df\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678986s8"
Jul 15 13:21:30.539336 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:30.539161    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9ba2ba5-446b-40cf-9af9-7e5012f717df-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678986s8\" (UID: \"a9ba2ba5-446b-40cf-9af9-7e5012f717df\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678986s8"
Jul 15 13:21:30.539336 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:30.539221    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9ba2ba5-446b-40cf-9af9-7e5012f717df-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678986s8\" (UID: \"a9ba2ba5-446b-40cf-9af9-7e5012f717df\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678986s8"
Jul 15 13:21:30.539336 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:30.539264    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9ba2ba5-446b-40cf-9af9-7e5012f717df-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678986s8\" (UID: \"a9ba2ba5-446b-40cf-9af9-7e5012f717df\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678986s8"
Jul 15 13:21:30.539336 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:30.539314    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9ba2ba5-446b-40cf-9af9-7e5012f717df-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678986s8\" (UID: \"a9ba2ba5-446b-40cf-9af9-7e5012f717df\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678986s8"
Jul 15 13:21:30.539471 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:30.539373    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9ba2ba5-446b-40cf-9af9-7e5012f717df-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678986s8\" (UID: \"a9ba2ba5-446b-40cf-9af9-7e5012f717df\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678986s8"
Jul 15 13:21:30.640711 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:30.640679    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9ba2ba5-446b-40cf-9af9-7e5012f717df-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678986s8\" (UID: \"a9ba2ba5-446b-40cf-9af9-7e5012f717df\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678986s8"
Jul 15 13:21:30.640888 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:30.640734    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9ba2ba5-446b-40cf-9af9-7e5012f717df-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678986s8\" (UID: \"a9ba2ba5-446b-40cf-9af9-7e5012f717df\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678986s8"
Jul 15 13:21:30.640888 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:30.640774    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9ba2ba5-446b-40cf-9af9-7e5012f717df-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678986s8\" (UID: \"a9ba2ba5-446b-40cf-9af9-7e5012f717df\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678986s8"
Jul 15 13:21:30.640888 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:30.640811    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9ba2ba5-446b-40cf-9af9-7e5012f717df-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678986s8\" (UID: \"a9ba2ba5-446b-40cf-9af9-7e5012f717df\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678986s8"
Jul 15 13:21:30.640888 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:30.640837    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9ba2ba5-446b-40cf-9af9-7e5012f717df-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678986s8\" (UID: \"a9ba2ba5-446b-40cf-9af9-7e5012f717df\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678986s8"
Jul 15 13:21:30.640888 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:30.640861    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9ba2ba5-446b-40cf-9af9-7e5012f717df-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678986s8\" (UID: \"a9ba2ba5-446b-40cf-9af9-7e5012f717df\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678986s8"
Jul 15 13:21:30.641153 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:30.640891    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6qtx\" (UniqueName: \"kubernetes.io/projected/a9ba2ba5-446b-40cf-9af9-7e5012f717df-kube-api-access-j6qtx\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678986s8\" (UID: \"a9ba2ba5-446b-40cf-9af9-7e5012f717df\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678986s8"
Jul 15 13:21:30.641153 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:30.640969    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9ba2ba5-446b-40cf-9af9-7e5012f717df-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678986s8\" (UID: \"a9ba2ba5-446b-40cf-9af9-7e5012f717df\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678986s8"
Jul 15 13:21:30.641153 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:30.641003    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9ba2ba5-446b-40cf-9af9-7e5012f717df-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678986s8\" (UID: \"a9ba2ba5-446b-40cf-9af9-7e5012f717df\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678986s8"
Jul 15 13:21:30.641318 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:30.641224    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9ba2ba5-446b-40cf-9af9-7e5012f717df-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678986s8\" (UID: \"a9ba2ba5-446b-40cf-9af9-7e5012f717df\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678986s8"
Jul 15 13:21:30.641318 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:30.641263    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9ba2ba5-446b-40cf-9af9-7e5012f717df-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678986s8\" (UID: \"a9ba2ba5-446b-40cf-9af9-7e5012f717df\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678986s8"
Jul 15 13:21:30.641429 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:30.641379    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9ba2ba5-446b-40cf-9af9-7e5012f717df-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678986s8\" (UID: \"a9ba2ba5-446b-40cf-9af9-7e5012f717df\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678986s8"
Jul 15 13:21:30.641481 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:30.641423    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9ba2ba5-446b-40cf-9af9-7e5012f717df-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678986s8\" (UID: \"a9ba2ba5-446b-40cf-9af9-7e5012f717df\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678986s8"
Jul 15 13:21:30.641726 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:30.641707    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9ba2ba5-446b-40cf-9af9-7e5012f717df-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678986s8\" (UID: \"a9ba2ba5-446b-40cf-9af9-7e5012f717df\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678986s8"
Jul 15 13:21:30.643133 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:30.643110    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9ba2ba5-446b-40cf-9af9-7e5012f717df-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678986s8\" (UID: \"a9ba2ba5-446b-40cf-9af9-7e5012f717df\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678986s8"
Jul 15 13:21:30.643246 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:30.643231    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9ba2ba5-446b-40cf-9af9-7e5012f717df-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678986s8\" (UID: \"a9ba2ba5-446b-40cf-9af9-7e5012f717df\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678986s8"
Jul 15 13:21:30.656142 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:30.656114    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9ba2ba5-446b-40cf-9af9-7e5012f717df-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678986s8\" (UID: \"a9ba2ba5-446b-40cf-9af9-7e5012f717df\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678986s8"
Jul 15 13:21:30.656839 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:30.656810    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6qtx\" (UniqueName: \"kubernetes.io/projected/a9ba2ba5-446b-40cf-9af9-7e5012f717df-kube-api-access-j6qtx\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678986s8\" (UID: \"a9ba2ba5-446b-40cf-9af9-7e5012f717df\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678986s8"
Jul 15 13:21:30.796936 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:30.796845    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678986s8"
Jul 15 13:21:30.942326 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:30.942291    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678986s8"]
Jul 15 13:21:30.942708 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:21:30.942684    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9ba2ba5_446b_40cf_9af9_7e5012f717df.slice/crio-be3117f24178fe1660e7ddacd0ec1fa407cfdbe4a7af4d0ac3856eed359dc64b WatchSource:0}: Error finding container be3117f24178fe1660e7ddacd0ec1fa407cfdbe4a7af4d0ac3856eed359dc64b: Status 404 returned error can't find the container with id be3117f24178fe1660e7ddacd0ec1fa407cfdbe4a7af4d0ac3856eed359dc64b
Jul 15 13:21:31.600337 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:31.600296    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678986s8" event={"ID":"a9ba2ba5-446b-40cf-9af9-7e5012f717df","Type":"ContainerStarted","Data":"be3117f24178fe1660e7ddacd0ec1fa407cfdbe4a7af4d0ac3856eed359dc64b"}
Jul 15 13:21:32.472560 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:32.472527    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7557b79948-t48hq"]
Jul 15 13:21:32.479466 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:32.479441    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7557b79948-t48hq"
Jul 15 13:21:32.485333 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:32.485292    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 15 13:21:32.485468 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:32.485423    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-gnlqz\""
Jul 15 13:21:32.486685 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:32.486654    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 15 13:21:32.486867 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:32.486759    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 15 13:21:32.505775 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:32.505740    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7557b79948-t48hq"]
Jul 15 13:21:32.556866 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:32.556833    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/23a225cb-5a6d-4cf6-8770-def8ec6794af-cert\") pod \"lws-controller-manager-7557b79948-t48hq\" (UID: \"23a225cb-5a6d-4cf6-8770-def8ec6794af\") " pod="openshift-lws-operator/lws-controller-manager-7557b79948-t48hq"
Jul 15 13:21:32.557050 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:32.556878    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jsr9\" (UniqueName: \"kubernetes.io/projected/23a225cb-5a6d-4cf6-8770-def8ec6794af-kube-api-access-8jsr9\") pod \"lws-controller-manager-7557b79948-t48hq\" (UID: \"23a225cb-5a6d-4cf6-8770-def8ec6794af\") " pod="openshift-lws-operator/lws-controller-manager-7557b79948-t48hq"
Jul 15 13:21:32.557050 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:32.556933    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/23a225cb-5a6d-4cf6-8770-def8ec6794af-manager-config\") pod \"lws-controller-manager-7557b79948-t48hq\" (UID: \"23a225cb-5a6d-4cf6-8770-def8ec6794af\") " pod="openshift-lws-operator/lws-controller-manager-7557b79948-t48hq"
Jul 15 13:21:32.557050 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:32.556956    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/23a225cb-5a6d-4cf6-8770-def8ec6794af-metrics-cert\") pod \"lws-controller-manager-7557b79948-t48hq\" (UID: \"23a225cb-5a6d-4cf6-8770-def8ec6794af\") " pod="openshift-lws-operator/lws-controller-manager-7557b79948-t48hq"
Jul 15 13:21:32.657656 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:32.657602    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jsr9\" (UniqueName: \"kubernetes.io/projected/23a225cb-5a6d-4cf6-8770-def8ec6794af-kube-api-access-8jsr9\") pod \"lws-controller-manager-7557b79948-t48hq\" (UID: \"23a225cb-5a6d-4cf6-8770-def8ec6794af\") " pod="openshift-lws-operator/lws-controller-manager-7557b79948-t48hq"
Jul 15 13:21:32.659752 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:32.657672    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/23a225cb-5a6d-4cf6-8770-def8ec6794af-manager-config\") pod \"lws-controller-manager-7557b79948-t48hq\" (UID: \"23a225cb-5a6d-4cf6-8770-def8ec6794af\") " pod="openshift-lws-operator/lws-controller-manager-7557b79948-t48hq"
Jul 15 13:21:32.659752 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:32.657701    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/23a225cb-5a6d-4cf6-8770-def8ec6794af-metrics-cert\") pod \"lws-controller-manager-7557b79948-t48hq\" (UID: \"23a225cb-5a6d-4cf6-8770-def8ec6794af\") " pod="openshift-lws-operator/lws-controller-manager-7557b79948-t48hq"
Jul 15 13:21:32.659752 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:32.657797    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/23a225cb-5a6d-4cf6-8770-def8ec6794af-cert\") pod \"lws-controller-manager-7557b79948-t48hq\" (UID: \"23a225cb-5a6d-4cf6-8770-def8ec6794af\") " pod="openshift-lws-operator/lws-controller-manager-7557b79948-t48hq"
Jul 15 13:21:32.659752 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:32.658695    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/23a225cb-5a6d-4cf6-8770-def8ec6794af-manager-config\") pod \"lws-controller-manager-7557b79948-t48hq\" (UID: \"23a225cb-5a6d-4cf6-8770-def8ec6794af\") " pod="openshift-lws-operator/lws-controller-manager-7557b79948-t48hq"
Jul 15 13:21:32.661927 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:32.661901    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/23a225cb-5a6d-4cf6-8770-def8ec6794af-metrics-cert\") pod \"lws-controller-manager-7557b79948-t48hq\" (UID: \"23a225cb-5a6d-4cf6-8770-def8ec6794af\") " pod="openshift-lws-operator/lws-controller-manager-7557b79948-t48hq"
Jul 15 13:21:32.662535 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:32.662507    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/23a225cb-5a6d-4cf6-8770-def8ec6794af-cert\") pod \"lws-controller-manager-7557b79948-t48hq\" (UID: \"23a225cb-5a6d-4cf6-8770-def8ec6794af\") " pod="openshift-lws-operator/lws-controller-manager-7557b79948-t48hq"
Jul 15 13:21:32.687180 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:32.687145    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jsr9\" (UniqueName: \"kubernetes.io/projected/23a225cb-5a6d-4cf6-8770-def8ec6794af-kube-api-access-8jsr9\") pod \"lws-controller-manager-7557b79948-t48hq\" (UID: \"23a225cb-5a6d-4cf6-8770-def8ec6794af\") " pod="openshift-lws-operator/lws-controller-manager-7557b79948-t48hq"
Jul 15 13:21:32.791360 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:32.791226    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7557b79948-t48hq"
Jul 15 13:21:33.405193 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:33.405154    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 13:21:33.405338 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:33.405256    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 13:21:33.405338 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:33.405304    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 13:21:33.563842 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:33.563816    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7557b79948-t48hq"]
Jul 15 13:21:33.566442 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:21:33.566415    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23a225cb_5a6d_4cf6_8770_def8ec6794af.slice/crio-c0ef029ee19db32ae03fad002be30cd08dfa5c64bef9dc6a83b1e23225d85031 WatchSource:0}: Error finding container c0ef029ee19db32ae03fad002be30cd08dfa5c64bef9dc6a83b1e23225d85031: Status 404 returned error can't find the container with id c0ef029ee19db32ae03fad002be30cd08dfa5c64bef9dc6a83b1e23225d85031
Jul 15 13:21:33.615267 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:33.615157    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678986s8" event={"ID":"a9ba2ba5-446b-40cf-9af9-7e5012f717df","Type":"ContainerStarted","Data":"a7076e96c5b3f58a11246f11793912b5dfdcb3da01970dd4bd204de071eb27ee"}
Jul 15 13:21:33.616401 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:33.616372    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7557b79948-t48hq" event={"ID":"23a225cb-5a6d-4cf6-8770-def8ec6794af","Type":"ContainerStarted","Data":"c0ef029ee19db32ae03fad002be30cd08dfa5c64bef9dc6a83b1e23225d85031"}
Jul 15 13:21:33.682488 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:33.682438    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678986s8" podStartSLOduration=1.22243733 podStartE2EDuration="3.682420059s" totalImagesPullingTime="2.459982729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:21:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:21:33.680580991 +0000 UTC m=+613.768367935" watchObservedRunningTime="2026-07-15 13:21:33.682420059 +0000 UTC m=+613.770207000"
Jul 15 13:21:33.797694 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:33.797663    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678986s8"
Jul 15 13:21:34.802328 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:34.802301    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678986s8"
Jul 15 13:21:35.626378 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:35.626350    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678986s8"
Jul 15 13:21:35.627325 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:35.627299    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678986s8"
Jul 15 13:21:37.637652 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:37.637615    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7557b79948-t48hq" event={"ID":"23a225cb-5a6d-4cf6-8770-def8ec6794af","Type":"ContainerStarted","Data":"d9f3593c262be96b371e36a53d5b32ef883bad48faf8214712d6b83b3aad03d6"}
Jul 15 13:21:37.638101 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:37.637715    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7557b79948-t48hq"
Jul 15 13:21:37.742634 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:37.742578    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7557b79948-t48hq" podStartSLOduration=2.342231405 podStartE2EDuration="5.742561824s" totalImagesPullingTime="3.400330419s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:21:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:21:37.739542033 +0000 UTC m=+617.827328975" watchObservedRunningTime="2026-07-15 13:21:37.742561824 +0000 UTC m=+617.830348766"
Jul 15 13:21:48.644855 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:21:48.644776    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7557b79948-t48hq"
Jul 15 13:22:38.054334 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:38.054299    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736glz6"]
Jul 15 13:22:38.057857 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:38.057839    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736glz6"
Jul 15 13:22:38.061363 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:38.061338    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vmzhp\""
Jul 15 13:22:38.062598 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:38.062579    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 15 13:22:38.062673 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:38.062579    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 15 13:22:38.069882 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:38.069858    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736glz6"]
Jul 15 13:22:38.185998 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:38.185963    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a56bdd9-ada6-43be-bfa4-cce886e45c67-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736glz6\" (UID: \"9a56bdd9-ada6-43be-bfa4-cce886e45c67\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736glz6"
Jul 15 13:22:38.186164 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:38.186023    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x68rc\" (UniqueName: \"kubernetes.io/projected/9a56bdd9-ada6-43be-bfa4-cce886e45c67-kube-api-access-x68rc\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736glz6\" (UID: \"9a56bdd9-ada6-43be-bfa4-cce886e45c67\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736glz6"
Jul 15 13:22:38.186164 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:38.186050    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a56bdd9-ada6-43be-bfa4-cce886e45c67-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736glz6\" (UID: \"9a56bdd9-ada6-43be-bfa4-cce886e45c67\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736glz6"
Jul 15 13:22:38.286493 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:38.286463    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a56bdd9-ada6-43be-bfa4-cce886e45c67-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736glz6\" (UID: \"9a56bdd9-ada6-43be-bfa4-cce886e45c67\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736glz6"
Jul 15 13:22:38.286664 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:38.286525    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x68rc\" (UniqueName: \"kubernetes.io/projected/9a56bdd9-ada6-43be-bfa4-cce886e45c67-kube-api-access-x68rc\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736glz6\" (UID: \"9a56bdd9-ada6-43be-bfa4-cce886e45c67\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736glz6"
Jul 15 13:22:38.286664 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:38.286555    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a56bdd9-ada6-43be-bfa4-cce886e45c67-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736glz6\" (UID: \"9a56bdd9-ada6-43be-bfa4-cce886e45c67\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736glz6"
Jul 15 13:22:38.286906 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:38.286884    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a56bdd9-ada6-43be-bfa4-cce886e45c67-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736glz6\" (UID: \"9a56bdd9-ada6-43be-bfa4-cce886e45c67\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736glz6"
Jul 15 13:22:38.286972 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:38.286906    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a56bdd9-ada6-43be-bfa4-cce886e45c67-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736glz6\" (UID: \"9a56bdd9-ada6-43be-bfa4-cce886e45c67\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736glz6"
Jul 15 13:22:38.296510 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:38.296485    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x68rc\" (UniqueName: \"kubernetes.io/projected/9a56bdd9-ada6-43be-bfa4-cce886e45c67-kube-api-access-x68rc\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736glz6\" (UID: \"9a56bdd9-ada6-43be-bfa4-cce886e45c67\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736glz6"
Jul 15 13:22:38.367419 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:38.367354    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736glz6"
Jul 15 13:22:38.500556 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:38.500529    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736glz6"]
Jul 15 13:22:38.504228 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:22:38.504065    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a56bdd9_ada6_43be_bfa4_cce886e45c67.slice/crio-f8c072f77bc100c08a586f1789a4ca6e3ba530c9c6dfda517bbeb0fefa0e5e41 WatchSource:0}: Error finding container f8c072f77bc100c08a586f1789a4ca6e3ba530c9c6dfda517bbeb0fefa0e5e41: Status 404 returned error can't find the container with id f8c072f77bc100c08a586f1789a4ca6e3ba530c9c6dfda517bbeb0fefa0e5e41
Jul 15 13:22:38.631486 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:38.631428    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12j2kz"]
Jul 15 13:22:38.634986 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:38.634971    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12j2kz"
Jul 15 13:22:38.645539 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:38.645515    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12j2kz"]
Jul 15 13:22:38.689666 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:38.689646    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd219c47-32b2-47bc-b1c8-3a0c87d641bc-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12j2kz\" (UID: \"bd219c47-32b2-47bc-b1c8-3a0c87d641bc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12j2kz"
Jul 15 13:22:38.689776 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:38.689682    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd219c47-32b2-47bc-b1c8-3a0c87d641bc-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12j2kz\" (UID: \"bd219c47-32b2-47bc-b1c8-3a0c87d641bc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12j2kz"
Jul 15 13:22:38.689776 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:38.689708    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hz2h8\" (UniqueName: \"kubernetes.io/projected/bd219c47-32b2-47bc-b1c8-3a0c87d641bc-kube-api-access-hz2h8\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12j2kz\" (UID: \"bd219c47-32b2-47bc-b1c8-3a0c87d641bc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12j2kz"
Jul 15 13:22:38.790312 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:38.790281    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd219c47-32b2-47bc-b1c8-3a0c87d641bc-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12j2kz\" (UID: \"bd219c47-32b2-47bc-b1c8-3a0c87d641bc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12j2kz"
Jul 15 13:22:38.790459 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:38.790327    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd219c47-32b2-47bc-b1c8-3a0c87d641bc-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12j2kz\" (UID: \"bd219c47-32b2-47bc-b1c8-3a0c87d641bc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12j2kz"
Jul 15 13:22:38.790459 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:38.790441    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz2h8\" (UniqueName: \"kubernetes.io/projected/bd219c47-32b2-47bc-b1c8-3a0c87d641bc-kube-api-access-hz2h8\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12j2kz\" (UID: \"bd219c47-32b2-47bc-b1c8-3a0c87d641bc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12j2kz"
Jul 15 13:22:38.790645 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:38.790629    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd219c47-32b2-47bc-b1c8-3a0c87d641bc-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12j2kz\" (UID: \"bd219c47-32b2-47bc-b1c8-3a0c87d641bc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12j2kz"
Jul 15 13:22:38.790707 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:38.790667    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd219c47-32b2-47bc-b1c8-3a0c87d641bc-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12j2kz\" (UID: \"bd219c47-32b2-47bc-b1c8-3a0c87d641bc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12j2kz"
Jul 15 13:22:38.803110 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:38.803080    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hz2h8\" (UniqueName: \"kubernetes.io/projected/bd219c47-32b2-47bc-b1c8-3a0c87d641bc-kube-api-access-hz2h8\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12j2kz\" (UID: \"bd219c47-32b2-47bc-b1c8-3a0c87d641bc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12j2kz"
Jul 15 13:22:38.930571 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:38.930496    2578 generic.go:356] "Generic (PLEG): container finished" podID="9a56bdd9-ada6-43be-bfa4-cce886e45c67" containerID="500fdba69ac571a49ede9818654971865c7fd47daf908af0d2c9a8770f5d37a2" exitCode=0
Jul 15 13:22:38.930571 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:38.930530    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736glz6" event={"ID":"9a56bdd9-ada6-43be-bfa4-cce886e45c67","Type":"ContainerDied","Data":"500fdba69ac571a49ede9818654971865c7fd47daf908af0d2c9a8770f5d37a2"}
Jul 15 13:22:38.930571 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:38.930564    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736glz6" event={"ID":"9a56bdd9-ada6-43be-bfa4-cce886e45c67","Type":"ContainerStarted","Data":"f8c072f77bc100c08a586f1789a4ca6e3ba530c9c6dfda517bbeb0fefa0e5e41"}
Jul 15 13:22:38.930984 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:38.930970    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 13:22:38.983429 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:38.983404    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12j2kz"
Jul 15 13:22:39.112586 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:39.112554    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12j2kz"]
Jul 15 13:22:39.115049 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:22:39.115022    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd219c47_32b2_47bc_b1c8_3a0c87d641bc.slice/crio-c872882253505241ea2c6ebf126bf0e10409ec61122bf6180e57a51d02c35028 WatchSource:0}: Error finding container c872882253505241ea2c6ebf126bf0e10409ec61122bf6180e57a51d02c35028: Status 404 returned error can't find the container with id c872882253505241ea2c6ebf126bf0e10409ec61122bf6180e57a51d02c35028
Jul 15 13:22:39.219515 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:39.219487    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05r9cs"]
Jul 15 13:22:39.222775 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:39.222756    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05r9cs"
Jul 15 13:22:39.232068 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:39.232044    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05r9cs"]
Jul 15 13:22:39.294335 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:39.294309    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b8bc7ef-7a64-43ee-863c-7bfe22851f03-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05r9cs\" (UID: \"6b8bc7ef-7a64-43ee-863c-7bfe22851f03\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05r9cs"
Jul 15 13:22:39.294471 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:39.294354    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bn48b\" (UniqueName: \"kubernetes.io/projected/6b8bc7ef-7a64-43ee-863c-7bfe22851f03-kube-api-access-bn48b\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05r9cs\" (UID: \"6b8bc7ef-7a64-43ee-863c-7bfe22851f03\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05r9cs"
Jul 15 13:22:39.294471 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:39.294445    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b8bc7ef-7a64-43ee-863c-7bfe22851f03-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05r9cs\" (UID: \"6b8bc7ef-7a64-43ee-863c-7bfe22851f03\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05r9cs"
Jul 15 13:22:39.395578 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:39.395545    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bn48b\" (UniqueName: \"kubernetes.io/projected/6b8bc7ef-7a64-43ee-863c-7bfe22851f03-kube-api-access-bn48b\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05r9cs\" (UID: \"6b8bc7ef-7a64-43ee-863c-7bfe22851f03\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05r9cs"
Jul 15 13:22:39.395706 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:39.395631    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b8bc7ef-7a64-43ee-863c-7bfe22851f03-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05r9cs\" (UID: \"6b8bc7ef-7a64-43ee-863c-7bfe22851f03\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05r9cs"
Jul 15 13:22:39.395706 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:39.395676    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b8bc7ef-7a64-43ee-863c-7bfe22851f03-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05r9cs\" (UID: \"6b8bc7ef-7a64-43ee-863c-7bfe22851f03\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05r9cs"
Jul 15 13:22:39.396034 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:39.396017    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b8bc7ef-7a64-43ee-863c-7bfe22851f03-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05r9cs\" (UID: \"6b8bc7ef-7a64-43ee-863c-7bfe22851f03\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05r9cs"
Jul 15 13:22:39.396069 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:39.396047    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b8bc7ef-7a64-43ee-863c-7bfe22851f03-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05r9cs\" (UID: \"6b8bc7ef-7a64-43ee-863c-7bfe22851f03\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05r9cs"
Jul 15 13:22:39.406269 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:39.406247    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bn48b\" (UniqueName: \"kubernetes.io/projected/6b8bc7ef-7a64-43ee-863c-7bfe22851f03-kube-api-access-bn48b\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05r9cs\" (UID: \"6b8bc7ef-7a64-43ee-863c-7bfe22851f03\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05r9cs"
Jul 15 13:22:39.576250 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:39.576147    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05r9cs"
Jul 15 13:22:39.619516 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:39.619484    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759trpkn"]
Jul 15 13:22:39.623080 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:39.623059    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759trpkn"
Jul 15 13:22:39.635928 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:39.635900    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759trpkn"]
Jul 15 13:22:39.698003 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:39.697970    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/41b88d50-8e20-41ab-b16f-e2afb8ca9815-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759trpkn\" (UID: \"41b88d50-8e20-41ab-b16f-e2afb8ca9815\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759trpkn"
Jul 15 13:22:39.698155 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:39.698017    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/41b88d50-8e20-41ab-b16f-e2afb8ca9815-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759trpkn\" (UID: \"41b88d50-8e20-41ab-b16f-e2afb8ca9815\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759trpkn"
Jul 15 13:22:39.698155 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:39.698105    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gp5r\" (UniqueName: \"kubernetes.io/projected/41b88d50-8e20-41ab-b16f-e2afb8ca9815-kube-api-access-8gp5r\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759trpkn\" (UID: \"41b88d50-8e20-41ab-b16f-e2afb8ca9815\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759trpkn"
Jul 15 13:22:39.714133 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:39.714111    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05r9cs"]
Jul 15 13:22:39.715797 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:22:39.715769    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b8bc7ef_7a64_43ee_863c_7bfe22851f03.slice/crio-ff245db7a2050786919cc9061e12829884e8fc56d36f15eb94438bf9f6978719 WatchSource:0}: Error finding container ff245db7a2050786919cc9061e12829884e8fc56d36f15eb94438bf9f6978719: Status 404 returned error can't find the container with id ff245db7a2050786919cc9061e12829884e8fc56d36f15eb94438bf9f6978719
Jul 15 13:22:39.799556 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:39.799526    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/41b88d50-8e20-41ab-b16f-e2afb8ca9815-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759trpkn\" (UID: \"41b88d50-8e20-41ab-b16f-e2afb8ca9815\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759trpkn"
Jul 15 13:22:39.799739 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:39.799571    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/41b88d50-8e20-41ab-b16f-e2afb8ca9815-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759trpkn\" (UID: \"41b88d50-8e20-41ab-b16f-e2afb8ca9815\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759trpkn"
Jul 15 13:22:39.799739 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:39.799614    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gp5r\" (UniqueName: \"kubernetes.io/projected/41b88d50-8e20-41ab-b16f-e2afb8ca9815-kube-api-access-8gp5r\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759trpkn\" (UID: \"41b88d50-8e20-41ab-b16f-e2afb8ca9815\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759trpkn"
Jul 15 13:22:39.799905 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:39.799884    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/41b88d50-8e20-41ab-b16f-e2afb8ca9815-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759trpkn\" (UID: \"41b88d50-8e20-41ab-b16f-e2afb8ca9815\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759trpkn"
Jul 15 13:22:39.799996 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:39.799975    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/41b88d50-8e20-41ab-b16f-e2afb8ca9815-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759trpkn\" (UID: \"41b88d50-8e20-41ab-b16f-e2afb8ca9815\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759trpkn"
Jul 15 13:22:39.811239 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:39.811190    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gp5r\" (UniqueName: \"kubernetes.io/projected/41b88d50-8e20-41ab-b16f-e2afb8ca9815-kube-api-access-8gp5r\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759trpkn\" (UID: \"41b88d50-8e20-41ab-b16f-e2afb8ca9815\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759trpkn"
Jul 15 13:22:39.937605 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:39.937513    2578 generic.go:356] "Generic (PLEG): container finished" podID="6b8bc7ef-7a64-43ee-863c-7bfe22851f03" containerID="eb97da038c345e67c30ba7c480a1667b0576ee04a5af5a063fc6e8d93980af27" exitCode=0
Jul 15 13:22:39.937744 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:39.937606    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05r9cs" event={"ID":"6b8bc7ef-7a64-43ee-863c-7bfe22851f03","Type":"ContainerDied","Data":"eb97da038c345e67c30ba7c480a1667b0576ee04a5af5a063fc6e8d93980af27"}
Jul 15 13:22:39.937744 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:39.937662    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05r9cs" event={"ID":"6b8bc7ef-7a64-43ee-863c-7bfe22851f03","Type":"ContainerStarted","Data":"ff245db7a2050786919cc9061e12829884e8fc56d36f15eb94438bf9f6978719"}
Jul 15 13:22:39.940137 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:39.940107    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759trpkn"
Jul 15 13:22:39.942089 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:39.941115    2578 generic.go:356] "Generic (PLEG): container finished" podID="bd219c47-32b2-47bc-b1c8-3a0c87d641bc" containerID="6c41c7897534a7f012f1f4c90271eb28b54ab0f0b24c678432e3956e53574f09" exitCode=0
Jul 15 13:22:39.942089 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:39.941173    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12j2kz" event={"ID":"bd219c47-32b2-47bc-b1c8-3a0c87d641bc","Type":"ContainerDied","Data":"6c41c7897534a7f012f1f4c90271eb28b54ab0f0b24c678432e3956e53574f09"}
Jul 15 13:22:39.942089 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:39.941231    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12j2kz" event={"ID":"bd219c47-32b2-47bc-b1c8-3a0c87d641bc","Type":"ContainerStarted","Data":"c872882253505241ea2c6ebf126bf0e10409ec61122bf6180e57a51d02c35028"}
Jul 15 13:22:40.074233 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:40.074194    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759trpkn"]
Jul 15 13:22:40.076017 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:22:40.075990    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41b88d50_8e20_41ab_b16f_e2afb8ca9815.slice/crio-a3e6f2574ac55122ec7bad9652fc4294ed80bfd40eeecb7595c74b0b2dc77d6a WatchSource:0}: Error finding container a3e6f2574ac55122ec7bad9652fc4294ed80bfd40eeecb7595c74b0b2dc77d6a: Status 404 returned error can't find the container with id a3e6f2574ac55122ec7bad9652fc4294ed80bfd40eeecb7595c74b0b2dc77d6a
Jul 15 13:22:40.949556 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:40.949528    2578 generic.go:356] "Generic (PLEG): container finished" podID="bd219c47-32b2-47bc-b1c8-3a0c87d641bc" containerID="c7628783e01e7b91f0921b3d2a20f19d8e36a95ef1f0b56ade978f393bb35545" exitCode=0
Jul 15 13:22:40.949889 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:40.949607    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12j2kz" event={"ID":"bd219c47-32b2-47bc-b1c8-3a0c87d641bc","Type":"ContainerDied","Data":"c7628783e01e7b91f0921b3d2a20f19d8e36a95ef1f0b56ade978f393bb35545"}
Jul 15 13:22:40.951695 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:40.951674    2578 generic.go:356] "Generic (PLEG): container finished" podID="9a56bdd9-ada6-43be-bfa4-cce886e45c67" containerID="b1f0fb6434c7ef87cce877a4d4cb2e3795558df4058f64c1b66c061f10daa355" exitCode=0
Jul 15 13:22:40.951799 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:40.951755    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736glz6" event={"ID":"9a56bdd9-ada6-43be-bfa4-cce886e45c67","Type":"ContainerDied","Data":"b1f0fb6434c7ef87cce877a4d4cb2e3795558df4058f64c1b66c061f10daa355"}
Jul 15 13:22:40.953574 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:40.953555    2578 generic.go:356] "Generic (PLEG): container finished" podID="6b8bc7ef-7a64-43ee-863c-7bfe22851f03" containerID="d468f7345916bd5c958efbd969853c6d55e84308ccefe1b81a8a9b5a32997345" exitCode=0
Jul 15 13:22:40.953706 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:40.953597    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05r9cs" event={"ID":"6b8bc7ef-7a64-43ee-863c-7bfe22851f03","Type":"ContainerDied","Data":"d468f7345916bd5c958efbd969853c6d55e84308ccefe1b81a8a9b5a32997345"}
Jul 15 13:22:40.955235 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:40.955214    2578 generic.go:356] "Generic (PLEG): container finished" podID="41b88d50-8e20-41ab-b16f-e2afb8ca9815" containerID="57b772a02992e1de8f1d1779147cbe3cac0f5e810168966a5d90d368122804b0" exitCode=0
Jul 15 13:22:40.955313 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:40.955231    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759trpkn" event={"ID":"41b88d50-8e20-41ab-b16f-e2afb8ca9815","Type":"ContainerDied","Data":"57b772a02992e1de8f1d1779147cbe3cac0f5e810168966a5d90d368122804b0"}
Jul 15 13:22:40.955313 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:40.955273    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759trpkn" event={"ID":"41b88d50-8e20-41ab-b16f-e2afb8ca9815","Type":"ContainerStarted","Data":"a3e6f2574ac55122ec7bad9652fc4294ed80bfd40eeecb7595c74b0b2dc77d6a"}
Jul 15 13:22:41.965722 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:41.965689    2578 generic.go:356] "Generic (PLEG): container finished" podID="bd219c47-32b2-47bc-b1c8-3a0c87d641bc" containerID="7f7cd295357fd99dc532ebb23c2580166167d7be7e7a207f14fced80d1c34118" exitCode=0
Jul 15 13:22:41.966115 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:41.965763    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12j2kz" event={"ID":"bd219c47-32b2-47bc-b1c8-3a0c87d641bc","Type":"ContainerDied","Data":"7f7cd295357fd99dc532ebb23c2580166167d7be7e7a207f14fced80d1c34118"}
Jul 15 13:22:41.967773 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:41.967749    2578 generic.go:356] "Generic (PLEG): container finished" podID="9a56bdd9-ada6-43be-bfa4-cce886e45c67" containerID="84db8c3b15229c1200b8910eb6aee7e2fbad4e638518101f45b19d9d7c101949" exitCode=0
Jul 15 13:22:41.967883 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:41.967844    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736glz6" event={"ID":"9a56bdd9-ada6-43be-bfa4-cce886e45c67","Type":"ContainerDied","Data":"84db8c3b15229c1200b8910eb6aee7e2fbad4e638518101f45b19d9d7c101949"}
Jul 15 13:22:41.969813 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:41.969792    2578 generic.go:356] "Generic (PLEG): container finished" podID="6b8bc7ef-7a64-43ee-863c-7bfe22851f03" containerID="af8192e4c52fe633e6a300caadb59b39201af03977a9364413a1036a04dea06a" exitCode=0
Jul 15 13:22:41.969902 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:41.969863    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05r9cs" event={"ID":"6b8bc7ef-7a64-43ee-863c-7bfe22851f03","Type":"ContainerDied","Data":"af8192e4c52fe633e6a300caadb59b39201af03977a9364413a1036a04dea06a"}
Jul 15 13:22:41.971389 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:41.971371    2578 generic.go:356] "Generic (PLEG): container finished" podID="41b88d50-8e20-41ab-b16f-e2afb8ca9815" containerID="945c2dfddc78f57830eb84f90153c3a75dcaeae0f45114ef100ff4675d16c59e" exitCode=0
Jul 15 13:22:41.971461 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:41.971425    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759trpkn" event={"ID":"41b88d50-8e20-41ab-b16f-e2afb8ca9815","Type":"ContainerDied","Data":"945c2dfddc78f57830eb84f90153c3a75dcaeae0f45114ef100ff4675d16c59e"}
Jul 15 13:22:42.978775 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:42.978734    2578 generic.go:356] "Generic (PLEG): container finished" podID="41b88d50-8e20-41ab-b16f-e2afb8ca9815" containerID="6c870ad96c1af9408a91f158cc5cb30dc24707924ff9a026938d1999d4c6f4c8" exitCode=0
Jul 15 13:22:42.979219 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:42.978807    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759trpkn" event={"ID":"41b88d50-8e20-41ab-b16f-e2afb8ca9815","Type":"ContainerDied","Data":"6c870ad96c1af9408a91f158cc5cb30dc24707924ff9a026938d1999d4c6f4c8"}
Jul 15 13:22:43.131651 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:43.131624    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736glz6"
Jul 15 13:22:43.175761 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:43.175737    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05r9cs"
Jul 15 13:22:43.179692 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:43.179668    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12j2kz"
Jul 15 13:22:43.227939 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:43.227909    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a56bdd9-ada6-43be-bfa4-cce886e45c67-util\") pod \"9a56bdd9-ada6-43be-bfa4-cce886e45c67\" (UID: \"9a56bdd9-ada6-43be-bfa4-cce886e45c67\") "
Jul 15 13:22:43.228107 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:43.227961    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a56bdd9-ada6-43be-bfa4-cce886e45c67-bundle\") pod \"9a56bdd9-ada6-43be-bfa4-cce886e45c67\" (UID: \"9a56bdd9-ada6-43be-bfa4-cce886e45c67\") "
Jul 15 13:22:43.228107 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:43.228000    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x68rc\" (UniqueName: \"kubernetes.io/projected/9a56bdd9-ada6-43be-bfa4-cce886e45c67-kube-api-access-x68rc\") pod \"9a56bdd9-ada6-43be-bfa4-cce886e45c67\" (UID: \"9a56bdd9-ada6-43be-bfa4-cce886e45c67\") "
Jul 15 13:22:43.228107 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:43.228045    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hz2h8\" (UniqueName: \"kubernetes.io/projected/bd219c47-32b2-47bc-b1c8-3a0c87d641bc-kube-api-access-hz2h8\") pod \"bd219c47-32b2-47bc-b1c8-3a0c87d641bc\" (UID: \"bd219c47-32b2-47bc-b1c8-3a0c87d641bc\") "
Jul 15 13:22:43.228107 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:43.228074    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b8bc7ef-7a64-43ee-863c-7bfe22851f03-bundle\") pod \"6b8bc7ef-7a64-43ee-863c-7bfe22851f03\" (UID: \"6b8bc7ef-7a64-43ee-863c-7bfe22851f03\") "
Jul 15 13:22:43.228340 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:43.228112    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b8bc7ef-7a64-43ee-863c-7bfe22851f03-util\") pod \"6b8bc7ef-7a64-43ee-863c-7bfe22851f03\" (UID: \"6b8bc7ef-7a64-43ee-863c-7bfe22851f03\") "
Jul 15 13:22:43.228340 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:43.228140    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd219c47-32b2-47bc-b1c8-3a0c87d641bc-bundle\") pod \"bd219c47-32b2-47bc-b1c8-3a0c87d641bc\" (UID: \"bd219c47-32b2-47bc-b1c8-3a0c87d641bc\") "
Jul 15 13:22:43.228340 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:43.228166    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bn48b\" (UniqueName: \"kubernetes.io/projected/6b8bc7ef-7a64-43ee-863c-7bfe22851f03-kube-api-access-bn48b\") pod \"6b8bc7ef-7a64-43ee-863c-7bfe22851f03\" (UID: \"6b8bc7ef-7a64-43ee-863c-7bfe22851f03\") "
Jul 15 13:22:43.228340 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:43.228237    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd219c47-32b2-47bc-b1c8-3a0c87d641bc-util\") pod \"bd219c47-32b2-47bc-b1c8-3a0c87d641bc\" (UID: \"bd219c47-32b2-47bc-b1c8-3a0c87d641bc\") "
Jul 15 13:22:43.229180 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:43.229107    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a56bdd9-ada6-43be-bfa4-cce886e45c67-bundle" (OuterVolumeSpecName: "bundle") pod "9a56bdd9-ada6-43be-bfa4-cce886e45c67" (UID: "9a56bdd9-ada6-43be-bfa4-cce886e45c67"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:22:43.229180 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:43.229110    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd219c47-32b2-47bc-b1c8-3a0c87d641bc-bundle" (OuterVolumeSpecName: "bundle") pod "bd219c47-32b2-47bc-b1c8-3a0c87d641bc" (UID: "bd219c47-32b2-47bc-b1c8-3a0c87d641bc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:22:43.229806 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:43.229778    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b8bc7ef-7a64-43ee-863c-7bfe22851f03-bundle" (OuterVolumeSpecName: "bundle") pod "6b8bc7ef-7a64-43ee-863c-7bfe22851f03" (UID: "6b8bc7ef-7a64-43ee-863c-7bfe22851f03"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:22:43.231001 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:43.230956    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd219c47-32b2-47bc-b1c8-3a0c87d641bc-kube-api-access-hz2h8" (OuterVolumeSpecName: "kube-api-access-hz2h8") pod "bd219c47-32b2-47bc-b1c8-3a0c87d641bc" (UID: "bd219c47-32b2-47bc-b1c8-3a0c87d641bc"). InnerVolumeSpecName "kube-api-access-hz2h8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:22:43.231101 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:43.231016    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b8bc7ef-7a64-43ee-863c-7bfe22851f03-kube-api-access-bn48b" (OuterVolumeSpecName: "kube-api-access-bn48b") pod "6b8bc7ef-7a64-43ee-863c-7bfe22851f03" (UID: "6b8bc7ef-7a64-43ee-863c-7bfe22851f03"). InnerVolumeSpecName "kube-api-access-bn48b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:22:43.231101 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:43.231037    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a56bdd9-ada6-43be-bfa4-cce886e45c67-kube-api-access-x68rc" (OuterVolumeSpecName: "kube-api-access-x68rc") pod "9a56bdd9-ada6-43be-bfa4-cce886e45c67" (UID: "9a56bdd9-ada6-43be-bfa4-cce886e45c67"). InnerVolumeSpecName "kube-api-access-x68rc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:22:43.234921 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:43.234898    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b8bc7ef-7a64-43ee-863c-7bfe22851f03-util" (OuterVolumeSpecName: "util") pod "6b8bc7ef-7a64-43ee-863c-7bfe22851f03" (UID: "6b8bc7ef-7a64-43ee-863c-7bfe22851f03"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:22:43.235097 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:43.235079    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd219c47-32b2-47bc-b1c8-3a0c87d641bc-util" (OuterVolumeSpecName: "util") pod "bd219c47-32b2-47bc-b1c8-3a0c87d641bc" (UID: "bd219c47-32b2-47bc-b1c8-3a0c87d641bc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:22:43.237607 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:43.237582    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a56bdd9-ada6-43be-bfa4-cce886e45c67-util" (OuterVolumeSpecName: "util") pod "9a56bdd9-ada6-43be-bfa4-cce886e45c67" (UID: "9a56bdd9-ada6-43be-bfa4-cce886e45c67"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:22:43.329581 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:43.329551    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd219c47-32b2-47bc-b1c8-3a0c87d641bc-util\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:22:43.329581 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:43.329575    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a56bdd9-ada6-43be-bfa4-cce886e45c67-util\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:22:43.329581 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:43.329584    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a56bdd9-ada6-43be-bfa4-cce886e45c67-bundle\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:22:43.329798 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:43.329594    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x68rc\" (UniqueName: \"kubernetes.io/projected/9a56bdd9-ada6-43be-bfa4-cce886e45c67-kube-api-access-x68rc\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:22:43.329798 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:43.329604    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hz2h8\" (UniqueName: \"kubernetes.io/projected/bd219c47-32b2-47bc-b1c8-3a0c87d641bc-kube-api-access-hz2h8\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:22:43.329798 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:43.329613    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b8bc7ef-7a64-43ee-863c-7bfe22851f03-bundle\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:22:43.329798 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:43.329623    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b8bc7ef-7a64-43ee-863c-7bfe22851f03-util\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:22:43.329798 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:43.329630    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd219c47-32b2-47bc-b1c8-3a0c87d641bc-bundle\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:22:43.329798 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:43.329637    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bn48b\" (UniqueName: \"kubernetes.io/projected/6b8bc7ef-7a64-43ee-863c-7bfe22851f03-kube-api-access-bn48b\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:22:43.985930 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:43.985902    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12j2kz"
Jul 15 13:22:43.986358 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:43.985901    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12j2kz" event={"ID":"bd219c47-32b2-47bc-b1c8-3a0c87d641bc","Type":"ContainerDied","Data":"c872882253505241ea2c6ebf126bf0e10409ec61122bf6180e57a51d02c35028"}
Jul 15 13:22:43.986358 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:43.986001    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c872882253505241ea2c6ebf126bf0e10409ec61122bf6180e57a51d02c35028"
Jul 15 13:22:43.987898 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:43.987874    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736glz6"
Jul 15 13:22:43.987898 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:43.987892    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736glz6" event={"ID":"9a56bdd9-ada6-43be-bfa4-cce886e45c67","Type":"ContainerDied","Data":"f8c072f77bc100c08a586f1789a4ca6e3ba530c9c6dfda517bbeb0fefa0e5e41"}
Jul 15 13:22:43.988047 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:43.987930    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f8c072f77bc100c08a586f1789a4ca6e3ba530c9c6dfda517bbeb0fefa0e5e41"
Jul 15 13:22:43.989933 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:43.989916    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05r9cs"
Jul 15 13:22:43.990024 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:43.989953    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05r9cs" event={"ID":"6b8bc7ef-7a64-43ee-863c-7bfe22851f03","Type":"ContainerDied","Data":"ff245db7a2050786919cc9061e12829884e8fc56d36f15eb94438bf9f6978719"}
Jul 15 13:22:43.990024 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:43.989997    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ff245db7a2050786919cc9061e12829884e8fc56d36f15eb94438bf9f6978719"
Jul 15 13:22:44.107135 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:44.107112    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759trpkn"
Jul 15 13:22:44.237865 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:44.237780    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/41b88d50-8e20-41ab-b16f-e2afb8ca9815-bundle\") pod \"41b88d50-8e20-41ab-b16f-e2afb8ca9815\" (UID: \"41b88d50-8e20-41ab-b16f-e2afb8ca9815\") "
Jul 15 13:22:44.237865 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:44.237827    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8gp5r\" (UniqueName: \"kubernetes.io/projected/41b88d50-8e20-41ab-b16f-e2afb8ca9815-kube-api-access-8gp5r\") pod \"41b88d50-8e20-41ab-b16f-e2afb8ca9815\" (UID: \"41b88d50-8e20-41ab-b16f-e2afb8ca9815\") "
Jul 15 13:22:44.237865 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:44.237865    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/41b88d50-8e20-41ab-b16f-e2afb8ca9815-util\") pod \"41b88d50-8e20-41ab-b16f-e2afb8ca9815\" (UID: \"41b88d50-8e20-41ab-b16f-e2afb8ca9815\") "
Jul 15 13:22:44.238341 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:44.238318    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41b88d50-8e20-41ab-b16f-e2afb8ca9815-bundle" (OuterVolumeSpecName: "bundle") pod "41b88d50-8e20-41ab-b16f-e2afb8ca9815" (UID: "41b88d50-8e20-41ab-b16f-e2afb8ca9815"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:22:44.239914 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:44.239889    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41b88d50-8e20-41ab-b16f-e2afb8ca9815-kube-api-access-8gp5r" (OuterVolumeSpecName: "kube-api-access-8gp5r") pod "41b88d50-8e20-41ab-b16f-e2afb8ca9815" (UID: "41b88d50-8e20-41ab-b16f-e2afb8ca9815"). InnerVolumeSpecName "kube-api-access-8gp5r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:22:44.243242 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:44.243196    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41b88d50-8e20-41ab-b16f-e2afb8ca9815-util" (OuterVolumeSpecName: "util") pod "41b88d50-8e20-41ab-b16f-e2afb8ca9815" (UID: "41b88d50-8e20-41ab-b16f-e2afb8ca9815"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:22:44.339417 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:44.339389    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/41b88d50-8e20-41ab-b16f-e2afb8ca9815-bundle\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:22:44.339417 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:44.339413    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8gp5r\" (UniqueName: \"kubernetes.io/projected/41b88d50-8e20-41ab-b16f-e2afb8ca9815-kube-api-access-8gp5r\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:22:44.339417 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:44.339424    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/41b88d50-8e20-41ab-b16f-e2afb8ca9815-util\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:22:44.996861 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:44.996832    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759trpkn"
Jul 15 13:22:44.997332 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:44.996866    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759trpkn" event={"ID":"41b88d50-8e20-41ab-b16f-e2afb8ca9815","Type":"ContainerDied","Data":"a3e6f2574ac55122ec7bad9652fc4294ed80bfd40eeecb7595c74b0b2dc77d6a"}
Jul 15 13:22:44.997332 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:22:44.996911    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a3e6f2574ac55122ec7bad9652fc4294ed80bfd40eeecb7595c74b0b2dc77d6a"
Jul 15 13:24:19.805835 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:19.805801    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-tj294"]
Jul 15 13:24:19.806320 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:19.806113    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a56bdd9-ada6-43be-bfa4-cce886e45c67" containerName="extract"
Jul 15 13:24:19.806320 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:19.806125    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a56bdd9-ada6-43be-bfa4-cce886e45c67" containerName="extract"
Jul 15 13:24:19.806320 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:19.806134    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41b88d50-8e20-41ab-b16f-e2afb8ca9815" containerName="extract"
Jul 15 13:24:19.806320 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:19.806140    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="41b88d50-8e20-41ab-b16f-e2afb8ca9815" containerName="extract"
Jul 15 13:24:19.806320 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:19.806149    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd219c47-32b2-47bc-b1c8-3a0c87d641bc" containerName="pull"
Jul 15 13:24:19.806320 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:19.806155    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd219c47-32b2-47bc-b1c8-3a0c87d641bc" containerName="pull"
Jul 15 13:24:19.806320 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:19.806161    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41b88d50-8e20-41ab-b16f-e2afb8ca9815" containerName="pull"
Jul 15 13:24:19.806320 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:19.806166    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="41b88d50-8e20-41ab-b16f-e2afb8ca9815" containerName="pull"
Jul 15 13:24:19.806320 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:19.806173    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd219c47-32b2-47bc-b1c8-3a0c87d641bc" containerName="extract"
Jul 15 13:24:19.806320 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:19.806178    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd219c47-32b2-47bc-b1c8-3a0c87d641bc" containerName="extract"
Jul 15 13:24:19.806320 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:19.806185    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a56bdd9-ada6-43be-bfa4-cce886e45c67" containerName="pull"
Jul 15 13:24:19.806320 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:19.806190    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a56bdd9-ada6-43be-bfa4-cce886e45c67" containerName="pull"
Jul 15 13:24:19.806320 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:19.806196    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd219c47-32b2-47bc-b1c8-3a0c87d641bc" containerName="util"
Jul 15 13:24:19.806320 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:19.806215    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd219c47-32b2-47bc-b1c8-3a0c87d641bc" containerName="util"
Jul 15 13:24:19.806320 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:19.806225    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b8bc7ef-7a64-43ee-863c-7bfe22851f03" containerName="pull"
Jul 15 13:24:19.806320 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:19.806233    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b8bc7ef-7a64-43ee-863c-7bfe22851f03" containerName="pull"
Jul 15 13:24:19.806320 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:19.806249    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b8bc7ef-7a64-43ee-863c-7bfe22851f03" containerName="util"
Jul 15 13:24:19.806320 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:19.806257    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b8bc7ef-7a64-43ee-863c-7bfe22851f03" containerName="util"
Jul 15 13:24:19.806320 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:19.806268    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a56bdd9-ada6-43be-bfa4-cce886e45c67" containerName="util"
Jul 15 13:24:19.806320 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:19.806273    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a56bdd9-ada6-43be-bfa4-cce886e45c67" containerName="util"
Jul 15 13:24:19.806320 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:19.806278    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b8bc7ef-7a64-43ee-863c-7bfe22851f03" containerName="extract"
Jul 15 13:24:19.806320 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:19.806283    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b8bc7ef-7a64-43ee-863c-7bfe22851f03" containerName="extract"
Jul 15 13:24:19.806320 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:19.806290    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41b88d50-8e20-41ab-b16f-e2afb8ca9815" containerName="util"
Jul 15 13:24:19.806320 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:19.806294    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="41b88d50-8e20-41ab-b16f-e2afb8ca9815" containerName="util"
Jul 15 13:24:19.807046 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:19.806350    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a56bdd9-ada6-43be-bfa4-cce886e45c67" containerName="extract"
Jul 15 13:24:19.807046 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:19.806360    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="41b88d50-8e20-41ab-b16f-e2afb8ca9815" containerName="extract"
Jul 15 13:24:19.807046 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:19.806366    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd219c47-32b2-47bc-b1c8-3a0c87d641bc" containerName="extract"
Jul 15 13:24:19.807046 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:19.806372    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b8bc7ef-7a64-43ee-863c-7bfe22851f03" containerName="extract"
Jul 15 13:24:19.809066 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:19.809049    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-tj294"
Jul 15 13:24:19.811902 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:19.811876    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 15 13:24:19.813082 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:19.813063    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-nqc98\""
Jul 15 13:24:19.813182 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:19.813089    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 15 13:24:19.818900 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:19.818877    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-tj294"]
Jul 15 13:24:19.902425 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:19.902396    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jr4v2\" (UniqueName: \"kubernetes.io/projected/c747c76f-d73c-4f14-a949-6e888c618310-kube-api-access-jr4v2\") pod \"authorino-58cd955675-tj294\" (UID: \"c747c76f-d73c-4f14-a949-6e888c618310\") " pod="kuadrant-system/authorino-58cd955675-tj294"
Jul 15 13:24:20.003742 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:20.003709    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr4v2\" (UniqueName: \"kubernetes.io/projected/c747c76f-d73c-4f14-a949-6e888c618310-kube-api-access-jr4v2\") pod \"authorino-58cd955675-tj294\" (UID: \"c747c76f-d73c-4f14-a949-6e888c618310\") " pod="kuadrant-system/authorino-58cd955675-tj294"
Jul 15 13:24:20.019735 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:20.019705    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jr4v2\" (UniqueName: \"kubernetes.io/projected/c747c76f-d73c-4f14-a949-6e888c618310-kube-api-access-jr4v2\") pod \"authorino-58cd955675-tj294\" (UID: \"c747c76f-d73c-4f14-a949-6e888c618310\") " pod="kuadrant-system/authorino-58cd955675-tj294"
Jul 15 13:24:20.118669 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:20.118599    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-tj294"
Jul 15 13:24:20.247734 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:20.247704    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-tj294"]
Jul 15 13:24:20.251057 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:24:20.251027    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc747c76f_d73c_4f14_a949_6e888c618310.slice/crio-03b69d8f6fa1c93bfc64e46110adcb93383ee03731b94ed4ce715c0e968f2555 WatchSource:0}: Error finding container 03b69d8f6fa1c93bfc64e46110adcb93383ee03731b94ed4ce715c0e968f2555: Status 404 returned error can't find the container with id 03b69d8f6fa1c93bfc64e46110adcb93383ee03731b94ed4ce715c0e968f2555
Jul 15 13:24:20.478938 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:20.478905    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-tj294" event={"ID":"c747c76f-d73c-4f14-a949-6e888c618310","Type":"ContainerStarted","Data":"03b69d8f6fa1c93bfc64e46110adcb93383ee03731b94ed4ce715c0e968f2555"}
Jul 15 13:24:23.497677 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:23.497645    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-tj294" event={"ID":"c747c76f-d73c-4f14-a949-6e888c618310","Type":"ContainerStarted","Data":"e950c2044174aa92c3afb61772e27cac07980d47a009593e602bb6236b4b0459"}
Jul 15 13:24:23.516339 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:23.516296    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-tj294" podStartSLOduration=1.348802359 podStartE2EDuration="4.516281045s" totalImagesPullingTime="3.167478686s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:24:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:24:23.514948086 +0000 UTC m=+783.602735027" watchObservedRunningTime="2026-07-15 13:24:23.516281045 +0000 UTC m=+783.604067986"
Jul 15 13:24:25.896139 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:25.896103    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-tj294"]
Jul 15 13:24:25.896672 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:25.896278    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-tj294" podUID="c747c76f-d73c-4f14-a949-6e888c618310" containerName="authorino" containerID="cri-o://e950c2044174aa92c3afb61772e27cac07980d47a009593e602bb6236b4b0459" gracePeriod=30
Jul 15 13:24:26.153724 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:26.153671    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-tj294"
Jul 15 13:24:26.256335 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:26.256299    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jr4v2\" (UniqueName: \"kubernetes.io/projected/c747c76f-d73c-4f14-a949-6e888c618310-kube-api-access-jr4v2\") pod \"c747c76f-d73c-4f14-a949-6e888c618310\" (UID: \"c747c76f-d73c-4f14-a949-6e888c618310\") "
Jul 15 13:24:26.258457 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:26.258431    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c747c76f-d73c-4f14-a949-6e888c618310-kube-api-access-jr4v2" (OuterVolumeSpecName: "kube-api-access-jr4v2") pod "c747c76f-d73c-4f14-a949-6e888c618310" (UID: "c747c76f-d73c-4f14-a949-6e888c618310"). InnerVolumeSpecName "kube-api-access-jr4v2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:24:26.357732 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:26.357700    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jr4v2\" (UniqueName: \"kubernetes.io/projected/c747c76f-d73c-4f14-a949-6e888c618310-kube-api-access-jr4v2\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:24:26.513864 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:26.513832    2578 generic.go:356] "Generic (PLEG): container finished" podID="c747c76f-d73c-4f14-a949-6e888c618310" containerID="e950c2044174aa92c3afb61772e27cac07980d47a009593e602bb6236b4b0459" exitCode=0
Jul 15 13:24:26.514006 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:26.513874    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-tj294"
Jul 15 13:24:26.514006 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:26.513877    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-tj294" event={"ID":"c747c76f-d73c-4f14-a949-6e888c618310","Type":"ContainerDied","Data":"e950c2044174aa92c3afb61772e27cac07980d47a009593e602bb6236b4b0459"}
Jul 15 13:24:26.514006 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:26.513920    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-tj294" event={"ID":"c747c76f-d73c-4f14-a949-6e888c618310","Type":"ContainerDied","Data":"03b69d8f6fa1c93bfc64e46110adcb93383ee03731b94ed4ce715c0e968f2555"}
Jul 15 13:24:26.514006 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:26.513942    2578 scope.go:117] "RemoveContainer" containerID="e950c2044174aa92c3afb61772e27cac07980d47a009593e602bb6236b4b0459"
Jul 15 13:24:26.522495 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:26.522472    2578 scope.go:117] "RemoveContainer" containerID="e950c2044174aa92c3afb61772e27cac07980d47a009593e602bb6236b4b0459"
Jul 15 13:24:26.522735 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:24:26.522716    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e950c2044174aa92c3afb61772e27cac07980d47a009593e602bb6236b4b0459\": container with ID starting with e950c2044174aa92c3afb61772e27cac07980d47a009593e602bb6236b4b0459 not found: ID does not exist" containerID="e950c2044174aa92c3afb61772e27cac07980d47a009593e602bb6236b4b0459"
Jul 15 13:24:26.522797 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:26.522746    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e950c2044174aa92c3afb61772e27cac07980d47a009593e602bb6236b4b0459"} err="failed to get container status \"e950c2044174aa92c3afb61772e27cac07980d47a009593e602bb6236b4b0459\": rpc error: code = NotFound desc = could not find container \"e950c2044174aa92c3afb61772e27cac07980d47a009593e602bb6236b4b0459\": container with ID starting with e950c2044174aa92c3afb61772e27cac07980d47a009593e602bb6236b4b0459 not found: ID does not exist"
Jul 15 13:24:26.530965 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:26.530940    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-tj294"]
Jul 15 13:24:26.536615 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:26.536594    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-tj294"]
Jul 15 13:24:28.380153 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:28.380121    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c747c76f-d73c-4f14-a949-6e888c618310" path="/var/lib/kubelet/pods/c747c76f-d73c-4f14-a949-6e888c618310/volumes"
Jul 15 13:24:58.749381 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:58.749305    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-76fb7df86-5mg52"]
Jul 15 13:24:58.749809 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:58.749636    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c747c76f-d73c-4f14-a949-6e888c618310" containerName="authorino"
Jul 15 13:24:58.749809 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:58.749648    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c747c76f-d73c-4f14-a949-6e888c618310" containerName="authorino"
Jul 15 13:24:58.749809 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:58.749722    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c747c76f-d73c-4f14-a949-6e888c618310" containerName="authorino"
Jul 15 13:24:58.753774 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:58.753754    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76fb7df86-5mg52"
Jul 15 13:24:58.757052 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:58.756998    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 15 13:24:58.757155 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:58.757034    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-2v7pw\""
Jul 15 13:24:58.757155 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:58.757075    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 15 13:24:58.763753 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:58.763730    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76fb7df86-5mg52"]
Jul 15 13:24:58.827486 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:58.827457    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/61c6556e-1b79-4cda-9be3-342e7f610e05-webhook-cert\") pod \"maas-controller-76fb7df86-5mg52\" (UID: \"61c6556e-1b79-4cda-9be3-342e7f610e05\") " pod="opendatahub/maas-controller-76fb7df86-5mg52"
Jul 15 13:24:58.827619 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:58.827500    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xv9w4\" (UniqueName: \"kubernetes.io/projected/61c6556e-1b79-4cda-9be3-342e7f610e05-kube-api-access-xv9w4\") pod \"maas-controller-76fb7df86-5mg52\" (UID: \"61c6556e-1b79-4cda-9be3-342e7f610e05\") " pod="opendatahub/maas-controller-76fb7df86-5mg52"
Jul 15 13:24:58.928726 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:58.928697    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/61c6556e-1b79-4cda-9be3-342e7f610e05-webhook-cert\") pod \"maas-controller-76fb7df86-5mg52\" (UID: \"61c6556e-1b79-4cda-9be3-342e7f610e05\") " pod="opendatahub/maas-controller-76fb7df86-5mg52"
Jul 15 13:24:58.928879 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:58.928739    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xv9w4\" (UniqueName: \"kubernetes.io/projected/61c6556e-1b79-4cda-9be3-342e7f610e05-kube-api-access-xv9w4\") pod \"maas-controller-76fb7df86-5mg52\" (UID: \"61c6556e-1b79-4cda-9be3-342e7f610e05\") " pod="opendatahub/maas-controller-76fb7df86-5mg52"
Jul 15 13:24:58.931299 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:58.931274    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/61c6556e-1b79-4cda-9be3-342e7f610e05-webhook-cert\") pod \"maas-controller-76fb7df86-5mg52\" (UID: \"61c6556e-1b79-4cda-9be3-342e7f610e05\") " pod="opendatahub/maas-controller-76fb7df86-5mg52"
Jul 15 13:24:58.938081 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:58.938045    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xv9w4\" (UniqueName: \"kubernetes.io/projected/61c6556e-1b79-4cda-9be3-342e7f610e05-kube-api-access-xv9w4\") pod \"maas-controller-76fb7df86-5mg52\" (UID: \"61c6556e-1b79-4cda-9be3-342e7f610e05\") " pod="opendatahub/maas-controller-76fb7df86-5mg52"
Jul 15 13:24:59.066082 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:59.066004    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76fb7df86-5mg52"
Jul 15 13:24:59.216825 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:59.216801    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76fb7df86-5mg52"]
Jul 15 13:24:59.218416 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:24:59.218387    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61c6556e_1b79_4cda_9be3_342e7f610e05.slice/crio-23d409cba101631fe393d66f4734af42cf744a4b240c63266cdbe3872145f61d WatchSource:0}: Error finding container 23d409cba101631fe393d66f4734af42cf744a4b240c63266cdbe3872145f61d: Status 404 returned error can't find the container with id 23d409cba101631fe393d66f4734af42cf744a4b240c63266cdbe3872145f61d
Jul 15 13:24:59.679869 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:24:59.679828    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76fb7df86-5mg52" event={"ID":"61c6556e-1b79-4cda-9be3-342e7f610e05","Type":"ContainerStarted","Data":"23d409cba101631fe393d66f4734af42cf744a4b240c63266cdbe3872145f61d"}
Jul 15 13:25:01.694179 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:01.694140    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76fb7df86-5mg52" event={"ID":"61c6556e-1b79-4cda-9be3-342e7f610e05","Type":"ContainerStarted","Data":"61c762ffb63937978e8972548219397424617f6623dc70086de45887879f963a"}
Jul 15 13:25:01.694572 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:01.694290    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-76fb7df86-5mg52"
Jul 15 13:25:01.718423 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:01.718378    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-76fb7df86-5mg52" podStartSLOduration=1.489324267 podStartE2EDuration="3.71836345s" totalImagesPullingTime="2.229039183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:24:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:25:01.716734078 +0000 UTC m=+821.804521023" watchObservedRunningTime="2026-07-15 13:25:01.71836345 +0000 UTC m=+821.806150407"
Jul 15 13:25:12.701622 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:12.701591    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-76fb7df86-5mg52"
Jul 15 13:25:14.076533 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:14.076496    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76fb7df86-5mg52"]
Jul 15 13:25:14.076958 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:14.076693    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-76fb7df86-5mg52" podUID="61c6556e-1b79-4cda-9be3-342e7f610e05" containerName="manager" containerID="cri-o://61c762ffb63937978e8972548219397424617f6623dc70086de45887879f963a" gracePeriod=30
Jul 15 13:25:14.319581 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:14.319554    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76fb7df86-5mg52"
Jul 15 13:25:14.468667 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:14.468641    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/61c6556e-1b79-4cda-9be3-342e7f610e05-webhook-cert\") pod \"61c6556e-1b79-4cda-9be3-342e7f610e05\" (UID: \"61c6556e-1b79-4cda-9be3-342e7f610e05\") "
Jul 15 13:25:14.468844 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:14.468695    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xv9w4\" (UniqueName: \"kubernetes.io/projected/61c6556e-1b79-4cda-9be3-342e7f610e05-kube-api-access-xv9w4\") pod \"61c6556e-1b79-4cda-9be3-342e7f610e05\" (UID: \"61c6556e-1b79-4cda-9be3-342e7f610e05\") "
Jul 15 13:25:14.470778 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:14.470751    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61c6556e-1b79-4cda-9be3-342e7f610e05-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "61c6556e-1b79-4cda-9be3-342e7f610e05" (UID: "61c6556e-1b79-4cda-9be3-342e7f610e05"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:25:14.470778 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:14.470772    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61c6556e-1b79-4cda-9be3-342e7f610e05-kube-api-access-xv9w4" (OuterVolumeSpecName: "kube-api-access-xv9w4") pod "61c6556e-1b79-4cda-9be3-342e7f610e05" (UID: "61c6556e-1b79-4cda-9be3-342e7f610e05"). InnerVolumeSpecName "kube-api-access-xv9w4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:25:14.569987 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:14.569947    2578 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/61c6556e-1b79-4cda-9be3-342e7f610e05-webhook-cert\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:25:14.569987 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:14.569985    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xv9w4\" (UniqueName: \"kubernetes.io/projected/61c6556e-1b79-4cda-9be3-342e7f610e05-kube-api-access-xv9w4\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:25:14.760544 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:14.760457    2578 generic.go:356] "Generic (PLEG): container finished" podID="61c6556e-1b79-4cda-9be3-342e7f610e05" containerID="61c762ffb63937978e8972548219397424617f6623dc70086de45887879f963a" exitCode=0
Jul 15 13:25:14.760702 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:14.760563    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76fb7df86-5mg52"
Jul 15 13:25:14.760702 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:14.760578    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76fb7df86-5mg52" event={"ID":"61c6556e-1b79-4cda-9be3-342e7f610e05","Type":"ContainerDied","Data":"61c762ffb63937978e8972548219397424617f6623dc70086de45887879f963a"}
Jul 15 13:25:14.760702 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:14.760634    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76fb7df86-5mg52" event={"ID":"61c6556e-1b79-4cda-9be3-342e7f610e05","Type":"ContainerDied","Data":"23d409cba101631fe393d66f4734af42cf744a4b240c63266cdbe3872145f61d"}
Jul 15 13:25:14.760702 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:14.760662    2578 scope.go:117] "RemoveContainer" containerID="61c762ffb63937978e8972548219397424617f6623dc70086de45887879f963a"
Jul 15 13:25:14.770130 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:14.770114    2578 scope.go:117] "RemoveContainer" containerID="61c762ffb63937978e8972548219397424617f6623dc70086de45887879f963a"
Jul 15 13:25:14.770443 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:25:14.770425    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61c762ffb63937978e8972548219397424617f6623dc70086de45887879f963a\": container with ID starting with 61c762ffb63937978e8972548219397424617f6623dc70086de45887879f963a not found: ID does not exist" containerID="61c762ffb63937978e8972548219397424617f6623dc70086de45887879f963a"
Jul 15 13:25:14.770489 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:14.770452    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61c762ffb63937978e8972548219397424617f6623dc70086de45887879f963a"} err="failed to get container status \"61c762ffb63937978e8972548219397424617f6623dc70086de45887879f963a\": rpc error: code = NotFound desc = could not find container \"61c762ffb63937978e8972548219397424617f6623dc70086de45887879f963a\": container with ID starting with 61c762ffb63937978e8972548219397424617f6623dc70086de45887879f963a not found: ID does not exist"
Jul 15 13:25:14.783003 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:14.782983    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76fb7df86-5mg52"]
Jul 15 13:25:14.786716 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:14.786697    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-76fb7df86-5mg52"]
Jul 15 13:25:16.375371 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:16.375340    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61c6556e-1b79-4cda-9be3-342e7f610e05" path="/var/lib/kubelet/pods/61c6556e-1b79-4cda-9be3-342e7f610e05/volumes"
Jul 15 13:25:38.008568 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:38.008534    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-65bf6b495c-d8225"]
Jul 15 13:25:38.008959 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:38.008868    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61c6556e-1b79-4cda-9be3-342e7f610e05" containerName="manager"
Jul 15 13:25:38.008959 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:38.008879    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="61c6556e-1b79-4cda-9be3-342e7f610e05" containerName="manager"
Jul 15 13:25:38.008959 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:38.008944    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="61c6556e-1b79-4cda-9be3-342e7f610e05" containerName="manager"
Jul 15 13:25:38.013355 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:38.013338    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-65bf6b495c-d8225"
Jul 15 13:25:38.016741 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:38.016723    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 13:25:38.016853 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:38.016725    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 15 13:25:38.016853 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:38.016788    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 13:25:38.026509 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:38.026485    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-65bf6b495c-d8225"]
Jul 15 13:25:38.034752 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:38.034732    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2s5zz\" (UniqueName: \"kubernetes.io/projected/71bc0d31-17e3-46bc-b44c-4301ae1d7b72-kube-api-access-2s5zz\") pod \"maas-api-65bf6b495c-d8225\" (UID: \"71bc0d31-17e3-46bc-b44c-4301ae1d7b72\") " pod="odh-ai-gateway-infra/maas-api-65bf6b495c-d8225"
Jul 15 13:25:38.034842 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:38.034782    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71bc0d31-17e3-46bc-b44c-4301ae1d7b72-openshift-service-ca\") pod \"maas-api-65bf6b495c-d8225\" (UID: \"71bc0d31-17e3-46bc-b44c-4301ae1d7b72\") " pod="odh-ai-gateway-infra/maas-api-65bf6b495c-d8225"
Jul 15 13:25:38.034842 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:38.034835    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71bc0d31-17e3-46bc-b44c-4301ae1d7b72-maas-api-tls\") pod \"maas-api-65bf6b495c-d8225\" (UID: \"71bc0d31-17e3-46bc-b44c-4301ae1d7b72\") " pod="odh-ai-gateway-infra/maas-api-65bf6b495c-d8225"
Jul 15 13:25:38.135323 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:38.135294    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71bc0d31-17e3-46bc-b44c-4301ae1d7b72-openshift-service-ca\") pod \"maas-api-65bf6b495c-d8225\" (UID: \"71bc0d31-17e3-46bc-b44c-4301ae1d7b72\") " pod="odh-ai-gateway-infra/maas-api-65bf6b495c-d8225"
Jul 15 13:25:38.135469 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:38.135347    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71bc0d31-17e3-46bc-b44c-4301ae1d7b72-maas-api-tls\") pod \"maas-api-65bf6b495c-d8225\" (UID: \"71bc0d31-17e3-46bc-b44c-4301ae1d7b72\") " pod="odh-ai-gateway-infra/maas-api-65bf6b495c-d8225"
Jul 15 13:25:38.135469 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:38.135385    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2s5zz\" (UniqueName: \"kubernetes.io/projected/71bc0d31-17e3-46bc-b44c-4301ae1d7b72-kube-api-access-2s5zz\") pod \"maas-api-65bf6b495c-d8225\" (UID: \"71bc0d31-17e3-46bc-b44c-4301ae1d7b72\") " pod="odh-ai-gateway-infra/maas-api-65bf6b495c-d8225"
Jul 15 13:25:38.135544 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:25:38.135505    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 15 13:25:38.135577 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:25:38.135565    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71bc0d31-17e3-46bc-b44c-4301ae1d7b72-maas-api-tls podName:71bc0d31-17e3-46bc-b44c-4301ae1d7b72 nodeName:}" failed. No retries permitted until 2026-07-15 13:25:38.635546169 +0000 UTC m=+858.723333094 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/71bc0d31-17e3-46bc-b44c-4301ae1d7b72-maas-api-tls") pod "maas-api-65bf6b495c-d8225" (UID: "71bc0d31-17e3-46bc-b44c-4301ae1d7b72") : secret "maas-api-serving-cert" not found
Jul 15 13:25:38.135969 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:38.135951    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71bc0d31-17e3-46bc-b44c-4301ae1d7b72-openshift-service-ca\") pod \"maas-api-65bf6b495c-d8225\" (UID: \"71bc0d31-17e3-46bc-b44c-4301ae1d7b72\") " pod="odh-ai-gateway-infra/maas-api-65bf6b495c-d8225"
Jul 15 13:25:38.149715 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:38.149683    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2s5zz\" (UniqueName: \"kubernetes.io/projected/71bc0d31-17e3-46bc-b44c-4301ae1d7b72-kube-api-access-2s5zz\") pod \"maas-api-65bf6b495c-d8225\" (UID: \"71bc0d31-17e3-46bc-b44c-4301ae1d7b72\") " pod="odh-ai-gateway-infra/maas-api-65bf6b495c-d8225"
Jul 15 13:25:38.639270 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:38.639227    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71bc0d31-17e3-46bc-b44c-4301ae1d7b72-maas-api-tls\") pod \"maas-api-65bf6b495c-d8225\" (UID: \"71bc0d31-17e3-46bc-b44c-4301ae1d7b72\") " pod="odh-ai-gateway-infra/maas-api-65bf6b495c-d8225"
Jul 15 13:25:38.641585 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:38.641560    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71bc0d31-17e3-46bc-b44c-4301ae1d7b72-maas-api-tls\") pod \"maas-api-65bf6b495c-d8225\" (UID: \"71bc0d31-17e3-46bc-b44c-4301ae1d7b72\") " pod="odh-ai-gateway-infra/maas-api-65bf6b495c-d8225"
Jul 15 13:25:38.681929 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:38.681902    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-xm5qw"]
Jul 15 13:25:38.684294 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:38.684278    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-xm5qw"
Jul 15 13:25:38.687173 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:38.687154    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 15 13:25:38.687297 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:38.687157    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-l68nn\""
Jul 15 13:25:38.693673 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:38.693651    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-xm5qw"]
Jul 15 13:25:38.739731 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:38.739697    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dbe59ffc-3cf4-474d-885f-1834195492ed-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-xm5qw\" (UID: \"dbe59ffc-3cf4-474d-885f-1834195492ed\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-xm5qw"
Jul 15 13:25:38.739889 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:38.739760    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8ngx\" (UniqueName: \"kubernetes.io/projected/dbe59ffc-3cf4-474d-885f-1834195492ed-kube-api-access-c8ngx\") pod \"payload-pre-processing-74584bb9f8-xm5qw\" (UID: \"dbe59ffc-3cf4-474d-885f-1834195492ed\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-xm5qw"
Jul 15 13:25:38.841001 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:38.840966    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dbe59ffc-3cf4-474d-885f-1834195492ed-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-xm5qw\" (UID: \"dbe59ffc-3cf4-474d-885f-1834195492ed\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-xm5qw"
Jul 15 13:25:38.841165 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:38.841029    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8ngx\" (UniqueName: \"kubernetes.io/projected/dbe59ffc-3cf4-474d-885f-1834195492ed-kube-api-access-c8ngx\") pod \"payload-pre-processing-74584bb9f8-xm5qw\" (UID: \"dbe59ffc-3cf4-474d-885f-1834195492ed\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-xm5qw"
Jul 15 13:25:38.841685 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:38.841666    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dbe59ffc-3cf4-474d-885f-1834195492ed-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-xm5qw\" (UID: \"dbe59ffc-3cf4-474d-885f-1834195492ed\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-xm5qw"
Jul 15 13:25:38.852566 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:38.852537    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8ngx\" (UniqueName: \"kubernetes.io/projected/dbe59ffc-3cf4-474d-885f-1834195492ed-kube-api-access-c8ngx\") pod \"payload-pre-processing-74584bb9f8-xm5qw\" (UID: \"dbe59ffc-3cf4-474d-885f-1834195492ed\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-xm5qw"
Jul 15 13:25:38.922893 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:38.922811    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-65bf6b495c-d8225"
Jul 15 13:25:38.995088 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:38.995057    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-xm5qw"
Jul 15 13:25:39.053084 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:39.053011    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-65bf6b495c-d8225"]
Jul 15 13:25:39.054752 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:25:39.054702    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71bc0d31_17e3_46bc_b44c_4301ae1d7b72.slice/crio-b25121b22c6c7832caba7d92a5be55e84bc15f9d29d73fed5e9ec5ca87cbb94c WatchSource:0}: Error finding container b25121b22c6c7832caba7d92a5be55e84bc15f9d29d73fed5e9ec5ca87cbb94c: Status 404 returned error can't find the container with id b25121b22c6c7832caba7d92a5be55e84bc15f9d29d73fed5e9ec5ca87cbb94c
Jul 15 13:25:39.134586 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:39.134561    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-xm5qw"]
Jul 15 13:25:39.135868 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:25:39.135841    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbe59ffc_3cf4_474d_885f_1834195492ed.slice/crio-3a0bfaf63f774d37dd5d48f3827e40e369d62a997966ca9d9990b3ae4a6bedbb WatchSource:0}: Error finding container 3a0bfaf63f774d37dd5d48f3827e40e369d62a997966ca9d9990b3ae4a6bedbb: Status 404 returned error can't find the container with id 3a0bfaf63f774d37dd5d48f3827e40e369d62a997966ca9d9990b3ae4a6bedbb
Jul 15 13:25:39.887186 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:39.887146    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-65bf6b495c-d8225" event={"ID":"71bc0d31-17e3-46bc-b44c-4301ae1d7b72","Type":"ContainerStarted","Data":"b25121b22c6c7832caba7d92a5be55e84bc15f9d29d73fed5e9ec5ca87cbb94c"}
Jul 15 13:25:39.888570 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:39.888541    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-xm5qw" event={"ID":"dbe59ffc-3cf4-474d-885f-1834195492ed","Type":"ContainerStarted","Data":"3a0bfaf63f774d37dd5d48f3827e40e369d62a997966ca9d9990b3ae4a6bedbb"}
Jul 15 13:25:40.894828 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:40.894792    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-xm5qw" event={"ID":"dbe59ffc-3cf4-474d-885f-1834195492ed","Type":"ContainerStarted","Data":"ac2bb2887da484888c1c88bed635c270974956dec0d857a21ee90e3338d0787d"}
Jul 15 13:25:40.895244 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:40.894853    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-xm5qw"
Jul 15 13:25:40.913247 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:40.913170    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-74584bb9f8-xm5qw" podStartSLOduration=1.7410161720000001 podStartE2EDuration="2.91315407s" totalImagesPullingTime="1.172137898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:25:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:25:40.912402324 +0000 UTC m=+861.000189259" watchObservedRunningTime="2026-07-15 13:25:40.91315407 +0000 UTC m=+861.000941011"
Jul 15 13:25:42.906889 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:42.906852    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-65bf6b495c-d8225" event={"ID":"71bc0d31-17e3-46bc-b44c-4301ae1d7b72","Type":"ContainerStarted","Data":"f824f1f4caf5d5254df062cb6dc67f13fa4be4040eecb558e6f07082aca6d321"}
Jul 15 13:25:42.907288 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:42.906962    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-65bf6b495c-d8225"
Jul 15 13:25:42.926838 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:42.926790    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-65bf6b495c-d8225" podStartSLOduration=2.8713388699999998 podStartE2EDuration="5.926777288s" totalImagesPullingTime="3.055438418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:25:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:25:42.925072095 +0000 UTC m=+863.012859038" watchObservedRunningTime="2026-07-15 13:25:42.926777288 +0000 UTC m=+863.014564230"
Jul 15 13:25:48.917647 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:48.917617    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-65bf6b495c-d8225"
Jul 15 13:25:51.903346 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:25:51.903317    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-xm5qw"
Jul 15 13:26:20.324711 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:26:20.324686    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-t4bfh_c21b11d6-3242-4dd5-8b75-74dad14868e9/console-operator/1.log"
Jul 15 13:26:20.328074 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:26:20.328053    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-t4bfh_c21b11d6-3242-4dd5-8b75-74dad14868e9/console-operator/1.log"
Jul 15 13:26:20.329309 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:26:20.329291    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt6q4_49ca8630-3cc0-4dbb-8c80-a948ad0de2b4/ovn-acl-logging/0.log"
Jul 15 13:26:20.332515 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:26:20.332499    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt6q4_49ca8630-3cc0-4dbb-8c80-a948ad0de2b4/ovn-acl-logging/0.log"
Jul 15 13:26:38.997136 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:26:38.997099    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-kfkgd"]
Jul 15 13:26:39.000023 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:26:39.000002    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kfkgd"
Jul 15 13:26:39.003113 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:26:39.003092    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 15 13:26:39.003259 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:26:39.003166    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 15 13:26:39.005605 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:26:39.004683    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-gr4gv\""
Jul 15 13:26:39.005605 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:26:39.004776    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 15 13:26:39.014486 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:26:39.014458    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-kfkgd"]
Jul 15 13:26:39.120512 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:26:39.120474    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98010981-e654-42c0-974b-5543f0976fff-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kfkgd\" (UID: \"98010981-e654-42c0-974b-5543f0976fff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kfkgd"
Jul 15 13:26:39.120512 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:26:39.120512    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98010981-e654-42c0-974b-5543f0976fff-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kfkgd\" (UID: \"98010981-e654-42c0-974b-5543f0976fff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kfkgd"
Jul 15 13:26:39.120715 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:26:39.120534    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98010981-e654-42c0-974b-5543f0976fff-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kfkgd\" (UID: \"98010981-e654-42c0-974b-5543f0976fff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kfkgd"
Jul 15 13:26:39.120715 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:26:39.120653    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98010981-e654-42c0-974b-5543f0976fff-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kfkgd\" (UID: \"98010981-e654-42c0-974b-5543f0976fff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kfkgd"
Jul 15 13:26:39.120715 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:26:39.120696    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98010981-e654-42c0-974b-5543f0976fff-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kfkgd\" (UID: \"98010981-e654-42c0-974b-5543f0976fff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kfkgd"
Jul 15 13:26:39.120819 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:26:39.120761    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8l5k\" (UniqueName: \"kubernetes.io/projected/98010981-e654-42c0-974b-5543f0976fff-kube-api-access-v8l5k\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kfkgd\" (UID: \"98010981-e654-42c0-974b-5543f0976fff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kfkgd"
Jul 15 13:26:39.222047 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:26:39.222014    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98010981-e654-42c0-974b-5543f0976fff-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kfkgd\" (UID: \"98010981-e654-42c0-974b-5543f0976fff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kfkgd"
Jul 15 13:26:39.222242 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:26:39.222067    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98010981-e654-42c0-974b-5543f0976fff-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kfkgd\" (UID: \"98010981-e654-42c0-974b-5543f0976fff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kfkgd"
Jul 15 13:26:39.222242 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:26:39.222163    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8l5k\" (UniqueName: \"kubernetes.io/projected/98010981-e654-42c0-974b-5543f0976fff-kube-api-access-v8l5k\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kfkgd\" (UID: \"98010981-e654-42c0-974b-5543f0976fff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kfkgd"
Jul 15 13:26:39.222371 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:26:39.222245    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98010981-e654-42c0-974b-5543f0976fff-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kfkgd\" (UID: \"98010981-e654-42c0-974b-5543f0976fff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kfkgd"
Jul 15 13:26:39.222371 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:26:39.222270    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98010981-e654-42c0-974b-5543f0976fff-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kfkgd\" (UID: \"98010981-e654-42c0-974b-5543f0976fff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kfkgd"
Jul 15 13:26:39.222371 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:26:39.222289    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98010981-e654-42c0-974b-5543f0976fff-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kfkgd\" (UID: \"98010981-e654-42c0-974b-5543f0976fff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kfkgd"
Jul 15 13:26:39.222579 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:26:39.222556    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98010981-e654-42c0-974b-5543f0976fff-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kfkgd\" (UID: \"98010981-e654-42c0-974b-5543f0976fff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kfkgd"
Jul 15 13:26:39.222693 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:26:39.222666    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98010981-e654-42c0-974b-5543f0976fff-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kfkgd\" (UID: \"98010981-e654-42c0-974b-5543f0976fff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kfkgd"
Jul 15 13:26:39.222693 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:26:39.222670    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98010981-e654-42c0-974b-5543f0976fff-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kfkgd\" (UID: \"98010981-e654-42c0-974b-5543f0976fff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kfkgd"
Jul 15 13:26:39.224339 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:26:39.224316    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98010981-e654-42c0-974b-5543f0976fff-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kfkgd\" (UID: \"98010981-e654-42c0-974b-5543f0976fff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kfkgd"
Jul 15 13:26:39.224647 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:26:39.224628    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98010981-e654-42c0-974b-5543f0976fff-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kfkgd\" (UID: \"98010981-e654-42c0-974b-5543f0976fff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kfkgd"
Jul 15 13:26:39.231042 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:26:39.231019    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8l5k\" (UniqueName: \"kubernetes.io/projected/98010981-e654-42c0-974b-5543f0976fff-kube-api-access-v8l5k\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kfkgd\" (UID: \"98010981-e654-42c0-974b-5543f0976fff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kfkgd"
Jul 15 13:26:39.315916 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:26:39.315826    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kfkgd"
Jul 15 13:26:39.450701 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:26:39.450672    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-kfkgd"]
Jul 15 13:26:39.451894 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:26:39.451851    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98010981_e654_42c0_974b_5543f0976fff.slice/crio-203cf93c97fc915f8969f3aa3cd9cd20723b584fa0b8c136c20839a32866a2fd WatchSource:0}: Error finding container 203cf93c97fc915f8969f3aa3cd9cd20723b584fa0b8c136c20839a32866a2fd: Status 404 returned error can't find the container with id 203cf93c97fc915f8969f3aa3cd9cd20723b584fa0b8c136c20839a32866a2fd
Jul 15 13:26:40.200596 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:26:40.200557    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kfkgd" event={"ID":"98010981-e654-42c0-974b-5543f0976fff","Type":"ContainerStarted","Data":"203cf93c97fc915f8969f3aa3cd9cd20723b584fa0b8c136c20839a32866a2fd"}
Jul 15 13:26:41.206943 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:26:41.206912    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kfkgd" event={"ID":"98010981-e654-42c0-974b-5543f0976fff","Type":"ContainerStarted","Data":"3d2379c7c8e071bd207e7501a14fdd17e562938ccaf1181470357635cccd7dff"}
Jul 15 13:26:41.228351 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:26:41.228304    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kfkgd" podStartSLOduration=2.103367308 podStartE2EDuration="3.228287244s" totalImagesPullingTime="1.124919936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:26:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:26:41.226357655 +0000 UTC m=+921.314144599" watchObservedRunningTime="2026-07-15 13:26:41.228287244 +0000 UTC m=+921.316074186"
Jul 15 13:26:49.316297 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:26:49.316259    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kfkgd"
Jul 15 13:26:49.316728 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:26:49.316323    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kfkgd"
Jul 15 13:26:49.328807 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:26:49.328782    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kfkgd"
Jul 15 13:26:50.262345 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:26:50.262318    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kfkgd"
Jul 15 13:27:03.488459 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:03.488424    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-n7rvz"]
Jul 15 13:27:03.494559 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:03.494542    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n7rvz"
Jul 15 13:27:03.497654 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:03.497625    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 15 13:27:03.503328 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:03.503304    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-n7rvz"]
Jul 15 13:27:03.522723 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:03.522696    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvxnp\" (UniqueName: \"kubernetes.io/projected/c5c411c1-1945-4ad5-a956-a181c353a54f-kube-api-access-fvxnp\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n7rvz\" (UID: \"c5c411c1-1945-4ad5-a956-a181c353a54f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n7rvz"
Jul 15 13:27:03.522869 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:03.522763    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5c411c1-1945-4ad5-a956-a181c353a54f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n7rvz\" (UID: \"c5c411c1-1945-4ad5-a956-a181c353a54f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n7rvz"
Jul 15 13:27:03.522869 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:03.522785    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5c411c1-1945-4ad5-a956-a181c353a54f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n7rvz\" (UID: \"c5c411c1-1945-4ad5-a956-a181c353a54f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n7rvz"
Jul 15 13:27:03.522869 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:03.522811    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5c411c1-1945-4ad5-a956-a181c353a54f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n7rvz\" (UID: \"c5c411c1-1945-4ad5-a956-a181c353a54f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n7rvz"
Jul 15 13:27:03.522869 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:03.522826    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c5c411c1-1945-4ad5-a956-a181c353a54f-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n7rvz\" (UID: \"c5c411c1-1945-4ad5-a956-a181c353a54f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n7rvz"
Jul 15 13:27:03.522869 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:03.522840    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c5c411c1-1945-4ad5-a956-a181c353a54f-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n7rvz\" (UID: \"c5c411c1-1945-4ad5-a956-a181c353a54f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n7rvz"
Jul 15 13:27:03.623765 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:03.623725    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5c411c1-1945-4ad5-a956-a181c353a54f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n7rvz\" (UID: \"c5c411c1-1945-4ad5-a956-a181c353a54f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n7rvz"
Jul 15 13:27:03.623765 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:03.623767    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5c411c1-1945-4ad5-a956-a181c353a54f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n7rvz\" (UID: \"c5c411c1-1945-4ad5-a956-a181c353a54f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n7rvz"
Jul 15 13:27:03.624003 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:03.623793    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5c411c1-1945-4ad5-a956-a181c353a54f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n7rvz\" (UID: \"c5c411c1-1945-4ad5-a956-a181c353a54f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n7rvz"
Jul 15 13:27:03.624003 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:03.623812    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c5c411c1-1945-4ad5-a956-a181c353a54f-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n7rvz\" (UID: \"c5c411c1-1945-4ad5-a956-a181c353a54f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n7rvz"
Jul 15 13:27:03.624003 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:03.623828    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c5c411c1-1945-4ad5-a956-a181c353a54f-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n7rvz\" (UID: \"c5c411c1-1945-4ad5-a956-a181c353a54f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n7rvz"
Jul 15 13:27:03.624003 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:03.623854    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvxnp\" (UniqueName: \"kubernetes.io/projected/c5c411c1-1945-4ad5-a956-a181c353a54f-kube-api-access-fvxnp\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n7rvz\" (UID: \"c5c411c1-1945-4ad5-a956-a181c353a54f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n7rvz"
Jul 15 13:27:03.624226 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:03.624133    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5c411c1-1945-4ad5-a956-a181c353a54f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n7rvz\" (UID: \"c5c411c1-1945-4ad5-a956-a181c353a54f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n7rvz"
Jul 15 13:27:03.624289 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:03.624270    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5c411c1-1945-4ad5-a956-a181c353a54f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n7rvz\" (UID: \"c5c411c1-1945-4ad5-a956-a181c353a54f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n7rvz"
Jul 15 13:27:03.624335 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:03.624297    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c5c411c1-1945-4ad5-a956-a181c353a54f-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n7rvz\" (UID: \"c5c411c1-1945-4ad5-a956-a181c353a54f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n7rvz"
Jul 15 13:27:03.626122 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:03.626100    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c5c411c1-1945-4ad5-a956-a181c353a54f-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n7rvz\" (UID: \"c5c411c1-1945-4ad5-a956-a181c353a54f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n7rvz"
Jul 15 13:27:03.626317 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:03.626299    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5c411c1-1945-4ad5-a956-a181c353a54f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n7rvz\" (UID: \"c5c411c1-1945-4ad5-a956-a181c353a54f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n7rvz"
Jul 15 13:27:03.636069 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:03.636046    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvxnp\" (UniqueName: \"kubernetes.io/projected/c5c411c1-1945-4ad5-a956-a181c353a54f-kube-api-access-fvxnp\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n7rvz\" (UID: \"c5c411c1-1945-4ad5-a956-a181c353a54f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n7rvz"
Jul 15 13:27:03.806445 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:03.806351    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n7rvz"
Jul 15 13:27:03.942738 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:03.942714    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-n7rvz"]
Jul 15 13:27:03.944447 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:27:03.944419    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5c411c1_1945_4ad5_a956_a181c353a54f.slice/crio-143f1144653e6312ff8c11b9db8dd8e1a0641d9d5a96897df352889ff58c4de0 WatchSource:0}: Error finding container 143f1144653e6312ff8c11b9db8dd8e1a0641d9d5a96897df352889ff58c4de0: Status 404 returned error can't find the container with id 143f1144653e6312ff8c11b9db8dd8e1a0641d9d5a96897df352889ff58c4de0
Jul 15 13:27:04.330371 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:04.330338    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n7rvz" event={"ID":"c5c411c1-1945-4ad5-a956-a181c353a54f","Type":"ContainerStarted","Data":"143f1144653e6312ff8c11b9db8dd8e1a0641d9d5a96897df352889ff58c4de0"}
Jul 15 13:27:05.337565 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:05.337529    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n7rvz" event={"ID":"c5c411c1-1945-4ad5-a956-a181c353a54f","Type":"ContainerStarted","Data":"3cc29df07b8289f76e55841f895581e2527ff950b9950585be1247be512ae3b0"}
Jul 15 13:27:05.359421 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:05.359377    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n7rvz" podStartSLOduration=1.9813243470000002 podStartE2EDuration="2.359361987s" totalImagesPullingTime="378.03764ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:27:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:27:05.357719842 +0000 UTC m=+945.445506906" watchObservedRunningTime="2026-07-15 13:27:05.359361987 +0000 UTC m=+945.447148928"
Jul 15 13:27:13.806683 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:13.806643    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n7rvz"
Jul 15 13:27:13.807074 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:13.806716    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n7rvz"
Jul 15 13:27:13.819266 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:13.819244    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n7rvz"
Jul 15 13:27:14.393717 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:14.393682    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n7rvz"
Jul 15 13:27:15.493179 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:15.493144    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2rh8w"]
Jul 15 13:27:15.496688 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:15.496669    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2rh8w"
Jul 15 13:27:15.499531 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:15.499513    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 15 13:27:15.516174 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:15.516146    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2rh8w"]
Jul 15 13:27:15.627013 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:15.626980    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9579ecb6-73dc-4cfc-98c6-7af7959da1f7-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-2rh8w\" (UID: \"9579ecb6-73dc-4cfc-98c6-7af7959da1f7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2rh8w"
Jul 15 13:27:15.627013 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:15.627015    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9579ecb6-73dc-4cfc-98c6-7af7959da1f7-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-2rh8w\" (UID: \"9579ecb6-73dc-4cfc-98c6-7af7959da1f7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2rh8w"
Jul 15 13:27:15.627308 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:15.627037    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9579ecb6-73dc-4cfc-98c6-7af7959da1f7-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-2rh8w\" (UID: \"9579ecb6-73dc-4cfc-98c6-7af7959da1f7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2rh8w"
Jul 15 13:27:15.627308 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:15.627102    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9579ecb6-73dc-4cfc-98c6-7af7959da1f7-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-2rh8w\" (UID: \"9579ecb6-73dc-4cfc-98c6-7af7959da1f7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2rh8w"
Jul 15 13:27:15.627308 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:15.627128    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mppqk\" (UniqueName: \"kubernetes.io/projected/9579ecb6-73dc-4cfc-98c6-7af7959da1f7-kube-api-access-mppqk\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-2rh8w\" (UID: \"9579ecb6-73dc-4cfc-98c6-7af7959da1f7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2rh8w"
Jul 15 13:27:15.627308 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:15.627226    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9579ecb6-73dc-4cfc-98c6-7af7959da1f7-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-2rh8w\" (UID: \"9579ecb6-73dc-4cfc-98c6-7af7959da1f7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2rh8w"
Jul 15 13:27:15.728642 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:15.728603    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9579ecb6-73dc-4cfc-98c6-7af7959da1f7-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-2rh8w\" (UID: \"9579ecb6-73dc-4cfc-98c6-7af7959da1f7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2rh8w"
Jul 15 13:27:15.728642 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:15.728644    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9579ecb6-73dc-4cfc-98c6-7af7959da1f7-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-2rh8w\" (UID: \"9579ecb6-73dc-4cfc-98c6-7af7959da1f7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2rh8w"
Jul 15 13:27:15.728899 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:15.728663    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9579ecb6-73dc-4cfc-98c6-7af7959da1f7-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-2rh8w\" (UID: \"9579ecb6-73dc-4cfc-98c6-7af7959da1f7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2rh8w"
Jul 15 13:27:15.728899 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:15.728799    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9579ecb6-73dc-4cfc-98c6-7af7959da1f7-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-2rh8w\" (UID: \"9579ecb6-73dc-4cfc-98c6-7af7959da1f7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2rh8w"
Jul 15 13:27:15.728899 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:15.728847    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mppqk\" (UniqueName: \"kubernetes.io/projected/9579ecb6-73dc-4cfc-98c6-7af7959da1f7-kube-api-access-mppqk\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-2rh8w\" (UID: \"9579ecb6-73dc-4cfc-98c6-7af7959da1f7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2rh8w"
Jul 15 13:27:15.728899 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:15.728891    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9579ecb6-73dc-4cfc-98c6-7af7959da1f7-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-2rh8w\" (UID: \"9579ecb6-73dc-4cfc-98c6-7af7959da1f7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2rh8w"
Jul 15 13:27:15.729130 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:15.729107    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9579ecb6-73dc-4cfc-98c6-7af7959da1f7-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-2rh8w\" (UID: \"9579ecb6-73dc-4cfc-98c6-7af7959da1f7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2rh8w"
Jul 15 13:27:15.729189 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:15.729136    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9579ecb6-73dc-4cfc-98c6-7af7959da1f7-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-2rh8w\" (UID: \"9579ecb6-73dc-4cfc-98c6-7af7959da1f7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2rh8w"
Jul 15 13:27:15.729189 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:15.729174    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9579ecb6-73dc-4cfc-98c6-7af7959da1f7-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-2rh8w\" (UID: \"9579ecb6-73dc-4cfc-98c6-7af7959da1f7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2rh8w"
Jul 15 13:27:15.730970 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:15.730949    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9579ecb6-73dc-4cfc-98c6-7af7959da1f7-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-2rh8w\" (UID: \"9579ecb6-73dc-4cfc-98c6-7af7959da1f7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2rh8w"
Jul 15 13:27:15.731235 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:15.731218    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9579ecb6-73dc-4cfc-98c6-7af7959da1f7-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-2rh8w\" (UID: \"9579ecb6-73dc-4cfc-98c6-7af7959da1f7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2rh8w"
Jul 15 13:27:15.738274 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:15.738253    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mppqk\" (UniqueName: \"kubernetes.io/projected/9579ecb6-73dc-4cfc-98c6-7af7959da1f7-kube-api-access-mppqk\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-2rh8w\" (UID: \"9579ecb6-73dc-4cfc-98c6-7af7959da1f7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2rh8w"
Jul 15 13:27:15.806911 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:15.806844    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2rh8w"
Jul 15 13:27:15.940252 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:15.940228    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2rh8w"]
Jul 15 13:27:15.942827 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:27:15.942802    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9579ecb6_73dc_4cfc_98c6_7af7959da1f7.slice/crio-56fb56d3025c15a0893426b6f437f8aff57cad769c6ade76c4050e6792d4e482 WatchSource:0}: Error finding container 56fb56d3025c15a0893426b6f437f8aff57cad769c6ade76c4050e6792d4e482: Status 404 returned error can't find the container with id 56fb56d3025c15a0893426b6f437f8aff57cad769c6ade76c4050e6792d4e482
Jul 15 13:27:16.392955 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:16.392921    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2rh8w" event={"ID":"9579ecb6-73dc-4cfc-98c6-7af7959da1f7","Type":"ContainerStarted","Data":"cc76b89b0ce03c7bfd4212e360c40ae98f30b2a7002f6d9e996a15ecaf1a84ae"}
Jul 15 13:27:16.392955 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:16.392957    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2rh8w" event={"ID":"9579ecb6-73dc-4cfc-98c6-7af7959da1f7","Type":"ContainerStarted","Data":"56fb56d3025c15a0893426b6f437f8aff57cad769c6ade76c4050e6792d4e482"}
Jul 15 13:27:16.416144 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:16.416100    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2rh8w" podStartSLOduration=1.190031817 podStartE2EDuration="1.416086132s" totalImagesPullingTime="226.054315ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:27:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:27:16.413879339 +0000 UTC m=+956.501666280" watchObservedRunningTime="2026-07-15 13:27:16.416086132 +0000 UTC m=+956.503873128"
Jul 15 13:27:25.807189 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:25.807149    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2rh8w"
Jul 15 13:27:25.807820 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:25.807252    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2rh8w"
Jul 15 13:27:25.819797 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:25.819769    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2rh8w"
Jul 15 13:27:26.454120 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:27:26.454091    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2rh8w"
Jul 15 13:31:20.368143 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:31:20.368115    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-t4bfh_c21b11d6-3242-4dd5-8b75-74dad14868e9/console-operator/1.log"
Jul 15 13:31:20.368731 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:31:20.368152    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-t4bfh_c21b11d6-3242-4dd5-8b75-74dad14868e9/console-operator/1.log"
Jul 15 13:31:20.373170 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:31:20.373144    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt6q4_49ca8630-3cc0-4dbb-8c80-a948ad0de2b4/ovn-acl-logging/0.log"
Jul 15 13:31:20.373475 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:31:20.373433    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt6q4_49ca8630-3cc0-4dbb-8c80-a948ad0de2b4/ovn-acl-logging/0.log"
Jul 15 13:36:20.404477 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:36:20.404447    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-t4bfh_c21b11d6-3242-4dd5-8b75-74dad14868e9/console-operator/1.log"
Jul 15 13:36:20.407048 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:36:20.407024    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-t4bfh_c21b11d6-3242-4dd5-8b75-74dad14868e9/console-operator/1.log"
Jul 15 13:36:20.408985 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:36:20.408959    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt6q4_49ca8630-3cc0-4dbb-8c80-a948ad0de2b4/ovn-acl-logging/0.log"
Jul 15 13:36:20.411494 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:36:20.411467    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt6q4_49ca8630-3cc0-4dbb-8c80-a948ad0de2b4/ovn-acl-logging/0.log"
Jul 15 13:41:20.438272 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:41:20.438246    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-t4bfh_c21b11d6-3242-4dd5-8b75-74dad14868e9/console-operator/1.log"
Jul 15 13:41:20.442710 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:41:20.442679    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-t4bfh_c21b11d6-3242-4dd5-8b75-74dad14868e9/console-operator/1.log"
Jul 15 13:41:20.442859 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:41:20.442780    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt6q4_49ca8630-3cc0-4dbb-8c80-a948ad0de2b4/ovn-acl-logging/0.log"
Jul 15 13:41:20.447363 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:41:20.447340    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt6q4_49ca8630-3cc0-4dbb-8c80-a948ad0de2b4/ovn-acl-logging/0.log"
Jul 15 13:41:49.324936 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:41:49.324903    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e43089af-76c4c944b8-jfm8g"]
Jul 15 13:41:49.328353 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:41:49.328331    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e43089af-76c4c944b8-jfm8g"
Jul 15 13:41:49.331797 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:41:49.331776    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-swdqt\""
Jul 15 13:41:49.332126 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:41:49.332099    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-e43089af-serving-cert\""
Jul 15 13:41:49.340685 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:41:49.340659    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e43089af-76c4c944b8-jfm8g"]
Jul 15 13:41:49.419631 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:41:49.419577    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb5066f5-7f6c-47a4-a18d-0a46c2a54cff-maas-api-tls\") pod \"maas-api-e2e-ait-e43089af-76c4c944b8-jfm8g\" (UID: \"cb5066f5-7f6c-47a4-a18d-0a46c2a54cff\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e43089af-76c4c944b8-jfm8g"
Jul 15 13:41:49.419631 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:41:49.419630    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb5066f5-7f6c-47a4-a18d-0a46c2a54cff-openshift-service-ca\") pod \"maas-api-e2e-ait-e43089af-76c4c944b8-jfm8g\" (UID: \"cb5066f5-7f6c-47a4-a18d-0a46c2a54cff\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e43089af-76c4c944b8-jfm8g"
Jul 15 13:41:49.419902 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:41:49.419694    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66x7z\" (UniqueName: \"kubernetes.io/projected/cb5066f5-7f6c-47a4-a18d-0a46c2a54cff-kube-api-access-66x7z\") pod \"maas-api-e2e-ait-e43089af-76c4c944b8-jfm8g\" (UID: \"cb5066f5-7f6c-47a4-a18d-0a46c2a54cff\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e43089af-76c4c944b8-jfm8g"
Jul 15 13:41:49.520702 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:41:49.520659    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb5066f5-7f6c-47a4-a18d-0a46c2a54cff-maas-api-tls\") pod \"maas-api-e2e-ait-e43089af-76c4c944b8-jfm8g\" (UID: \"cb5066f5-7f6c-47a4-a18d-0a46c2a54cff\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e43089af-76c4c944b8-jfm8g"
Jul 15 13:41:49.520702 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:41:49.520701    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb5066f5-7f6c-47a4-a18d-0a46c2a54cff-openshift-service-ca\") pod \"maas-api-e2e-ait-e43089af-76c4c944b8-jfm8g\" (UID: \"cb5066f5-7f6c-47a4-a18d-0a46c2a54cff\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e43089af-76c4c944b8-jfm8g"
Jul 15 13:41:49.520981 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:41:49.520723    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66x7z\" (UniqueName: \"kubernetes.io/projected/cb5066f5-7f6c-47a4-a18d-0a46c2a54cff-kube-api-access-66x7z\") pod \"maas-api-e2e-ait-e43089af-76c4c944b8-jfm8g\" (UID: \"cb5066f5-7f6c-47a4-a18d-0a46c2a54cff\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e43089af-76c4c944b8-jfm8g"
Jul 15 13:41:49.521365 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:41:49.521336    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb5066f5-7f6c-47a4-a18d-0a46c2a54cff-openshift-service-ca\") pod \"maas-api-e2e-ait-e43089af-76c4c944b8-jfm8g\" (UID: \"cb5066f5-7f6c-47a4-a18d-0a46c2a54cff\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e43089af-76c4c944b8-jfm8g"
Jul 15 13:41:49.523193 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:41:49.523171    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb5066f5-7f6c-47a4-a18d-0a46c2a54cff-maas-api-tls\") pod \"maas-api-e2e-ait-e43089af-76c4c944b8-jfm8g\" (UID: \"cb5066f5-7f6c-47a4-a18d-0a46c2a54cff\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e43089af-76c4c944b8-jfm8g"
Jul 15 13:41:49.533646 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:41:49.533622    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66x7z\" (UniqueName: \"kubernetes.io/projected/cb5066f5-7f6c-47a4-a18d-0a46c2a54cff-kube-api-access-66x7z\") pod \"maas-api-e2e-ait-e43089af-76c4c944b8-jfm8g\" (UID: \"cb5066f5-7f6c-47a4-a18d-0a46c2a54cff\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e43089af-76c4c944b8-jfm8g"
Jul 15 13:41:49.638935 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:41:49.638844    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e43089af-76c4c944b8-jfm8g"
Jul 15 13:41:49.984487 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:41:49.984462    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e43089af-76c4c944b8-jfm8g"]
Jul 15 13:41:49.986664 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:41:49.986637    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb5066f5_7f6c_47a4_a18d_0a46c2a54cff.slice/crio-a68bdd99dfdd60feb6f2808ab3bd24abb81e9afb05b32086d45a91cbb88f696d WatchSource:0}: Error finding container a68bdd99dfdd60feb6f2808ab3bd24abb81e9afb05b32086d45a91cbb88f696d: Status 404 returned error can't find the container with id a68bdd99dfdd60feb6f2808ab3bd24abb81e9afb05b32086d45a91cbb88f696d
Jul 15 13:41:49.988343 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:41:49.988327    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 13:41:50.944892 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:41:50.944803    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e43089af-76c4c944b8-jfm8g" event={"ID":"cb5066f5-7f6c-47a4-a18d-0a46c2a54cff","Type":"ContainerStarted","Data":"3f60d17ff02a2e1681de1beb4f43848500a02d450157fa8d95cb597067b08e21"}
Jul 15 13:41:50.944892 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:41:50.944869    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e43089af-76c4c944b8-jfm8g"
Jul 15 13:41:50.944892 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:41:50.944892    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e43089af-76c4c944b8-jfm8g" event={"ID":"cb5066f5-7f6c-47a4-a18d-0a46c2a54cff","Type":"ContainerStarted","Data":"a68bdd99dfdd60feb6f2808ab3bd24abb81e9afb05b32086d45a91cbb88f696d"}
Jul 15 13:41:50.965566 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:41:50.965521    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e43089af-76c4c944b8-jfm8g" podStartSLOduration=1.442505507 podStartE2EDuration="1.965505574s" totalImagesPullingTime="523.000067ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:41:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:41:50.964276849 +0000 UTC m=+1831.052063792" watchObservedRunningTime="2026-07-15 13:41:50.965505574 +0000 UTC m=+1831.053292563"
Jul 15 13:41:56.956046 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:41:56.956015    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e43089af-76c4c944b8-jfm8g"
Jul 15 13:42:04.986416 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:04.986383    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e43089af-76c4c944b8-jfm8g"]
Jul 15 13:42:04.986814 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:04.986648    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e43089af-76c4c944b8-jfm8g" podUID="cb5066f5-7f6c-47a4-a18d-0a46c2a54cff" containerName="maas-api" containerID="cri-o://3f60d17ff02a2e1681de1beb4f43848500a02d450157fa8d95cb597067b08e21" gracePeriod=30
Jul 15 13:42:05.238391 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:05.238328    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e43089af-76c4c944b8-jfm8g"
Jul 15 13:42:05.363877 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:05.363840    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb5066f5-7f6c-47a4-a18d-0a46c2a54cff-maas-api-tls\") pod \"cb5066f5-7f6c-47a4-a18d-0a46c2a54cff\" (UID: \"cb5066f5-7f6c-47a4-a18d-0a46c2a54cff\") "
Jul 15 13:42:05.363877 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:05.363882    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb5066f5-7f6c-47a4-a18d-0a46c2a54cff-openshift-service-ca\") pod \"cb5066f5-7f6c-47a4-a18d-0a46c2a54cff\" (UID: \"cb5066f5-7f6c-47a4-a18d-0a46c2a54cff\") "
Jul 15 13:42:05.364089 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:05.363981    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-66x7z\" (UniqueName: \"kubernetes.io/projected/cb5066f5-7f6c-47a4-a18d-0a46c2a54cff-kube-api-access-66x7z\") pod \"cb5066f5-7f6c-47a4-a18d-0a46c2a54cff\" (UID: \"cb5066f5-7f6c-47a4-a18d-0a46c2a54cff\") "
Jul 15 13:42:05.364308 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:05.364286    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb5066f5-7f6c-47a4-a18d-0a46c2a54cff-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cb5066f5-7f6c-47a4-a18d-0a46c2a54cff" (UID: "cb5066f5-7f6c-47a4-a18d-0a46c2a54cff"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:42:05.366158 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:05.366133    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb5066f5-7f6c-47a4-a18d-0a46c2a54cff-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cb5066f5-7f6c-47a4-a18d-0a46c2a54cff" (UID: "cb5066f5-7f6c-47a4-a18d-0a46c2a54cff"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:42:05.366321 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:05.366304    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb5066f5-7f6c-47a4-a18d-0a46c2a54cff-kube-api-access-66x7z" (OuterVolumeSpecName: "kube-api-access-66x7z") pod "cb5066f5-7f6c-47a4-a18d-0a46c2a54cff" (UID: "cb5066f5-7f6c-47a4-a18d-0a46c2a54cff"). InnerVolumeSpecName "kube-api-access-66x7z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:42:05.464837 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:05.464802    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb5066f5-7f6c-47a4-a18d-0a46c2a54cff-maas-api-tls\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:42:05.464837 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:05.464831    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb5066f5-7f6c-47a4-a18d-0a46c2a54cff-openshift-service-ca\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:42:05.464837 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:05.464841    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66x7z\" (UniqueName: \"kubernetes.io/projected/cb5066f5-7f6c-47a4-a18d-0a46c2a54cff-kube-api-access-66x7z\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:42:06.023770 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:06.023730    2578 generic.go:356] "Generic (PLEG): container finished" podID="cb5066f5-7f6c-47a4-a18d-0a46c2a54cff" containerID="3f60d17ff02a2e1681de1beb4f43848500a02d450157fa8d95cb597067b08e21" exitCode=0
Jul 15 13:42:06.024194 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:06.023782    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e43089af-76c4c944b8-jfm8g"
Jul 15 13:42:06.024194 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:06.023804    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e43089af-76c4c944b8-jfm8g" event={"ID":"cb5066f5-7f6c-47a4-a18d-0a46c2a54cff","Type":"ContainerDied","Data":"3f60d17ff02a2e1681de1beb4f43848500a02d450157fa8d95cb597067b08e21"}
Jul 15 13:42:06.024194 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:06.023874    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e43089af-76c4c944b8-jfm8g" event={"ID":"cb5066f5-7f6c-47a4-a18d-0a46c2a54cff","Type":"ContainerDied","Data":"a68bdd99dfdd60feb6f2808ab3bd24abb81e9afb05b32086d45a91cbb88f696d"}
Jul 15 13:42:06.024194 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:06.023898    2578 scope.go:117] "RemoveContainer" containerID="3f60d17ff02a2e1681de1beb4f43848500a02d450157fa8d95cb597067b08e21"
Jul 15 13:42:06.033570 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:06.033554    2578 scope.go:117] "RemoveContainer" containerID="3f60d17ff02a2e1681de1beb4f43848500a02d450157fa8d95cb597067b08e21"
Jul 15 13:42:06.033799 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:42:06.033778    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f60d17ff02a2e1681de1beb4f43848500a02d450157fa8d95cb597067b08e21\": container with ID starting with 3f60d17ff02a2e1681de1beb4f43848500a02d450157fa8d95cb597067b08e21 not found: ID does not exist" containerID="3f60d17ff02a2e1681de1beb4f43848500a02d450157fa8d95cb597067b08e21"
Jul 15 13:42:06.033845 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:06.033807    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f60d17ff02a2e1681de1beb4f43848500a02d450157fa8d95cb597067b08e21"} err="failed to get container status \"3f60d17ff02a2e1681de1beb4f43848500a02d450157fa8d95cb597067b08e21\": rpc error: code = NotFound desc = could not find container \"3f60d17ff02a2e1681de1beb4f43848500a02d450157fa8d95cb597067b08e21\": container with ID starting with 3f60d17ff02a2e1681de1beb4f43848500a02d450157fa8d95cb597067b08e21 not found: ID does not exist"
Jul 15 13:42:06.048562 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:06.048534    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e43089af-76c4c944b8-jfm8g"]
Jul 15 13:42:06.050815 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:06.050795    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e43089af-76c4c944b8-jfm8g"]
Jul 15 13:42:06.376708 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:06.376625    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb5066f5-7f6c-47a4-a18d-0a46c2a54cff" path="/var/lib/kubelet/pods/cb5066f5-7f6c-47a4-a18d-0a46c2a54cff/volumes"
Jul 15 13:42:20.165040 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:20.165005    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c"]
Jul 15 13:42:20.165540 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:20.165366    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb5066f5-7f6c-47a4-a18d-0a46c2a54cff" containerName="maas-api"
Jul 15 13:42:20.165540 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:20.165378    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb5066f5-7f6c-47a4-a18d-0a46c2a54cff" containerName="maas-api"
Jul 15 13:42:20.165540 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:20.165444    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb5066f5-7f6c-47a4-a18d-0a46c2a54cff" containerName="maas-api"
Jul 15 13:42:20.169887 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:20.169864    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c"
Jul 15 13:42:20.173039 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:20.172788    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-17469591-gw-openshift-default-dockercfg-q8gdd\""
Jul 15 13:42:20.186603 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:20.186583    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c"]
Jul 15 13:42:20.291896 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:20.291867    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ef9f951-9976-476a-88b6-e204f7592d20-istio-data\") pod \"e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c\" (UID: \"7ef9f951-9976-476a-88b6-e204f7592d20\") " pod="openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c"
Jul 15 13:42:20.292060 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:20.291902    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ef9f951-9976-476a-88b6-e204f7592d20-istio-podinfo\") pod \"e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c\" (UID: \"7ef9f951-9976-476a-88b6-e204f7592d20\") " pod="openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c"
Jul 15 13:42:20.292060 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:20.291941    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ef9f951-9976-476a-88b6-e204f7592d20-istio-token\") pod \"e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c\" (UID: \"7ef9f951-9976-476a-88b6-e204f7592d20\") " pod="openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c"
Jul 15 13:42:20.292060 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:20.291980    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnfg7\" (UniqueName: \"kubernetes.io/projected/7ef9f951-9976-476a-88b6-e204f7592d20-kube-api-access-cnfg7\") pod \"e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c\" (UID: \"7ef9f951-9976-476a-88b6-e204f7592d20\") " pod="openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c"
Jul 15 13:42:20.292060 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:20.292020    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ef9f951-9976-476a-88b6-e204f7592d20-istio-envoy\") pod \"e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c\" (UID: \"7ef9f951-9976-476a-88b6-e204f7592d20\") " pod="openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c"
Jul 15 13:42:20.292060 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:20.292051    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ef9f951-9976-476a-88b6-e204f7592d20-credential-socket\") pod \"e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c\" (UID: \"7ef9f951-9976-476a-88b6-e204f7592d20\") " pod="openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c"
Jul 15 13:42:20.292333 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:20.292075    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ef9f951-9976-476a-88b6-e204f7592d20-workload-certs\") pod \"e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c\" (UID: \"7ef9f951-9976-476a-88b6-e204f7592d20\") " pod="openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c"
Jul 15 13:42:20.292333 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:20.292121    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ef9f951-9976-476a-88b6-e204f7592d20-istiod-ca-cert\") pod \"e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c\" (UID: \"7ef9f951-9976-476a-88b6-e204f7592d20\") " pod="openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c"
Jul 15 13:42:20.292333 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:20.292164    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ef9f951-9976-476a-88b6-e204f7592d20-workload-socket\") pod \"e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c\" (UID: \"7ef9f951-9976-476a-88b6-e204f7592d20\") " pod="openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c"
Jul 15 13:42:20.392769 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:20.392740    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ef9f951-9976-476a-88b6-e204f7592d20-workload-socket\") pod \"e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c\" (UID: \"7ef9f951-9976-476a-88b6-e204f7592d20\") " pod="openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c"
Jul 15 13:42:20.392927 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:20.392813    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ef9f951-9976-476a-88b6-e204f7592d20-istio-data\") pod \"e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c\" (UID: \"7ef9f951-9976-476a-88b6-e204f7592d20\") " pod="openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c"
Jul 15 13:42:20.392927 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:20.392840    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ef9f951-9976-476a-88b6-e204f7592d20-istio-podinfo\") pod \"e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c\" (UID: \"7ef9f951-9976-476a-88b6-e204f7592d20\") " pod="openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c"
Jul 15 13:42:20.392927 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:20.392876    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ef9f951-9976-476a-88b6-e204f7592d20-istio-token\") pod \"e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c\" (UID: \"7ef9f951-9976-476a-88b6-e204f7592d20\") " pod="openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c"
Jul 15 13:42:20.392927 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:20.392924    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnfg7\" (UniqueName: \"kubernetes.io/projected/7ef9f951-9976-476a-88b6-e204f7592d20-kube-api-access-cnfg7\") pod \"e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c\" (UID: \"7ef9f951-9976-476a-88b6-e204f7592d20\") " pod="openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c"
Jul 15 13:42:20.393147 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:20.392954    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ef9f951-9976-476a-88b6-e204f7592d20-istio-envoy\") pod \"e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c\" (UID: \"7ef9f951-9976-476a-88b6-e204f7592d20\") " pod="openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c"
Jul 15 13:42:20.393147 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:20.392994    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ef9f951-9976-476a-88b6-e204f7592d20-credential-socket\") pod \"e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c\" (UID: \"7ef9f951-9976-476a-88b6-e204f7592d20\") " pod="openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c"
Jul 15 13:42:20.393147 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:20.393022    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ef9f951-9976-476a-88b6-e204f7592d20-workload-certs\") pod \"e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c\" (UID: \"7ef9f951-9976-476a-88b6-e204f7592d20\") " pod="openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c"
Jul 15 13:42:20.393147 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:20.393048    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ef9f951-9976-476a-88b6-e204f7592d20-istiod-ca-cert\") pod \"e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c\" (UID: \"7ef9f951-9976-476a-88b6-e204f7592d20\") " pod="openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c"
Jul 15 13:42:20.393377 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:20.393154    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ef9f951-9976-476a-88b6-e204f7592d20-workload-socket\") pod \"e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c\" (UID: \"7ef9f951-9976-476a-88b6-e204f7592d20\") " pod="openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c"
Jul 15 13:42:20.393435 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:20.393376    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ef9f951-9976-476a-88b6-e204f7592d20-credential-socket\") pod \"e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c\" (UID: \"7ef9f951-9976-476a-88b6-e204f7592d20\") " pod="openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c"
Jul 15 13:42:20.393435 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:20.393407    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ef9f951-9976-476a-88b6-e204f7592d20-workload-certs\") pod \"e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c\" (UID: \"7ef9f951-9976-476a-88b6-e204f7592d20\") " pod="openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c"
Jul 15 13:42:20.393546 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:20.393533    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ef9f951-9976-476a-88b6-e204f7592d20-istio-data\") pod \"e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c\" (UID: \"7ef9f951-9976-476a-88b6-e204f7592d20\") " pod="openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c"
Jul 15 13:42:20.393768 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:20.393748    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ef9f951-9976-476a-88b6-e204f7592d20-istiod-ca-cert\") pod \"e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c\" (UID: \"7ef9f951-9976-476a-88b6-e204f7592d20\") " pod="openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c"
Jul 15 13:42:20.395018 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:20.395000    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ef9f951-9976-476a-88b6-e204f7592d20-istio-envoy\") pod \"e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c\" (UID: \"7ef9f951-9976-476a-88b6-e204f7592d20\") " pod="openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c"
Jul 15 13:42:20.395141 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:20.395123    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ef9f951-9976-476a-88b6-e204f7592d20-istio-podinfo\") pod \"e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c\" (UID: \"7ef9f951-9976-476a-88b6-e204f7592d20\") " pod="openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c"
Jul 15 13:42:20.402784 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:20.402760    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ef9f951-9976-476a-88b6-e204f7592d20-istio-token\") pod \"e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c\" (UID: \"7ef9f951-9976-476a-88b6-e204f7592d20\") " pod="openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c"
Jul 15 13:42:20.402894 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:20.402794    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnfg7\" (UniqueName: \"kubernetes.io/projected/7ef9f951-9976-476a-88b6-e204f7592d20-kube-api-access-cnfg7\") pod \"e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c\" (UID: \"7ef9f951-9976-476a-88b6-e204f7592d20\") " pod="openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c"
Jul 15 13:42:20.482995 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:20.482970    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-17469591-gw-openshift-default-dockercfg-q8gdd\""
Jul 15 13:42:20.490278 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:20.490257    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c"
Jul 15 13:42:20.634139 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:20.634109    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c"]
Jul 15 13:42:20.635423 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:42:20.635397    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ef9f951_9976_476a_88b6_e204f7592d20.slice/crio-fd662cfa2566107fb6f1072deb371d70ab4d8ed42d4b814012919bb3c95f44c8 WatchSource:0}: Error finding container fd662cfa2566107fb6f1072deb371d70ab4d8ed42d4b814012919bb3c95f44c8: Status 404 returned error can't find the container with id fd662cfa2566107fb6f1072deb371d70ab4d8ed42d4b814012919bb3c95f44c8
Jul 15 13:42:20.637655 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:20.637620    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 13:42:20.637729 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:20.637691    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 13:42:20.637779 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:20.637735    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 13:42:21.104268 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:21.104234    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c" event={"ID":"7ef9f951-9976-476a-88b6-e204f7592d20","Type":"ContainerStarted","Data":"b5848243adb1fb75f926448ae4436e9c6e5210b673646036fc8f4b9a4d9773ab"}
Jul 15 13:42:21.104727 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:21.104289    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c" event={"ID":"7ef9f951-9976-476a-88b6-e204f7592d20","Type":"ContainerStarted","Data":"fd662cfa2566107fb6f1072deb371d70ab4d8ed42d4b814012919bb3c95f44c8"}
Jul 15 13:42:21.147431 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:21.147379    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c" podStartSLOduration=1.147338911 podStartE2EDuration="1.147338911s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:42:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:42:21.146445575 +0000 UTC m=+1861.234232516" watchObservedRunningTime="2026-07-15 13:42:21.147338911 +0000 UTC m=+1861.235125855"
Jul 15 13:42:21.491211 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:21.491179    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c"
Jul 15 13:42:21.496237 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:21.496199    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c"
Jul 15 13:42:22.109221 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:22.109176    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c"
Jul 15 13:42:22.110323 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:22.110297    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c"
Jul 15 13:42:37.442053 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:37.442017    2578 patch_prober.go:28] interesting pod/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": read tcp 10.132.0.2:41324->10.132.0.47:15021: read: connection reset by peer" start-of-body=
Jul 15 13:42:37.442513 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:37.442111    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c" podUID="7ef9f951-9976-476a-88b6-e204f7592d20" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": read tcp 10.132.0.2:41324->10.132.0.47:15021: read: connection reset by peer"
Jul 15 13:42:38.197275 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:38.197242    2578 generic.go:356] "Generic (PLEG): container finished" podID="7ef9f951-9976-476a-88b6-e204f7592d20" containerID="b5848243adb1fb75f926448ae4436e9c6e5210b673646036fc8f4b9a4d9773ab" exitCode=0
Jul 15 13:42:38.197466 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:38.197317    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c" event={"ID":"7ef9f951-9976-476a-88b6-e204f7592d20","Type":"ContainerDied","Data":"b5848243adb1fb75f926448ae4436e9c6e5210b673646036fc8f4b9a4d9773ab"}
Jul 15 13:42:38.197714 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:38.197699    2578 scope.go:117] "RemoveContainer" containerID="b5848243adb1fb75f926448ae4436e9c6e5210b673646036fc8f4b9a4d9773ab"
Jul 15 13:42:38.198692 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:38.198663    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 13:42:38.198755 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:38.198731    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 13:42:38.198791 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:38.198769    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 13:42:39.204482 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:39.204448    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c" event={"ID":"7ef9f951-9976-476a-88b6-e204f7592d20","Type":"ContainerStarted","Data":"b402519e90b75c37847c9d17cf61951fa61582f2acb2e2311e6ddb79dba3ad8e"}
Jul 15 13:42:39.491215 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:39.491179    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c"
Jul 15 13:42:39.491441 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:39.491419    2578 patch_prober.go:28] interesting pod/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 15 13:42:39.491497 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:39.491469    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c" podUID="7ef9f951-9976-476a-88b6-e204f7592d20" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 15 13:42:40.491290 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:40.491253    2578 patch_prober.go:28] interesting pod/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 15 13:42:40.491669 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:40.491323    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c" podUID="7ef9f951-9976-476a-88b6-e204f7592d20" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 15 13:42:41.491750 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:41.491712    2578 patch_prober.go:28] interesting pod/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 15 13:42:41.492149 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:41.491768    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c" podUID="7ef9f951-9976-476a-88b6-e204f7592d20" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 15 13:42:42.491436 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:42.491348    2578 patch_prober.go:28] interesting pod/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 15 13:42:42.491436 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:42.491405    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c" podUID="7ef9f951-9976-476a-88b6-e204f7592d20" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 15 13:42:43.494163 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:43.494132    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c"
Jul 15 13:42:43.494559 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:43.494472    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c"
Jul 15 13:42:43.495161 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:42:43.495138    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c"
Jul 15 13:43:26.089420 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:26.089383    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c"]
Jul 15 13:43:26.089937 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:26.089611    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c" podUID="7ef9f951-9976-476a-88b6-e204f7592d20" containerName="istio-proxy" containerID="cri-o://b402519e90b75c37847c9d17cf61951fa61582f2acb2e2311e6ddb79dba3ad8e" gracePeriod=30
Jul 15 13:43:28.497360 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:28.497324    2578 patch_prober.go:28] interesting pod/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 13:43:28.497747 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:28.497405    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c" podUID="7ef9f951-9976-476a-88b6-e204f7592d20" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 13:43:31.346951 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:31.346927    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c"
Jul 15 13:43:31.413481 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:31.413450    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ef9f951-9976-476a-88b6-e204f7592d20-istio-data\") pod \"7ef9f951-9976-476a-88b6-e204f7592d20\" (UID: \"7ef9f951-9976-476a-88b6-e204f7592d20\") "
Jul 15 13:43:31.413650 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:31.413489    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ef9f951-9976-476a-88b6-e204f7592d20-workload-certs\") pod \"7ef9f951-9976-476a-88b6-e204f7592d20\" (UID: \"7ef9f951-9976-476a-88b6-e204f7592d20\") "
Jul 15 13:43:31.413650 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:31.413531    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ef9f951-9976-476a-88b6-e204f7592d20-istiod-ca-cert\") pod \"7ef9f951-9976-476a-88b6-e204f7592d20\" (UID: \"7ef9f951-9976-476a-88b6-e204f7592d20\") "
Jul 15 13:43:31.413650 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:31.413556    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ef9f951-9976-476a-88b6-e204f7592d20-istio-podinfo\") pod \"7ef9f951-9976-476a-88b6-e204f7592d20\" (UID: \"7ef9f951-9976-476a-88b6-e204f7592d20\") "
Jul 15 13:43:31.413650 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:31.413578    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cnfg7\" (UniqueName: \"kubernetes.io/projected/7ef9f951-9976-476a-88b6-e204f7592d20-kube-api-access-cnfg7\") pod \"7ef9f951-9976-476a-88b6-e204f7592d20\" (UID: \"7ef9f951-9976-476a-88b6-e204f7592d20\") "
Jul 15 13:43:31.413650 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:31.413606    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ef9f951-9976-476a-88b6-e204f7592d20-istio-envoy\") pod \"7ef9f951-9976-476a-88b6-e204f7592d20\" (UID: \"7ef9f951-9976-476a-88b6-e204f7592d20\") "
Jul 15 13:43:31.413868 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:31.413819    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ef9f951-9976-476a-88b6-e204f7592d20-workload-socket\") pod \"7ef9f951-9976-476a-88b6-e204f7592d20\" (UID: \"7ef9f951-9976-476a-88b6-e204f7592d20\") "
Jul 15 13:43:31.413908 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:31.413895    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ef9f951-9976-476a-88b6-e204f7592d20-istio-token\") pod \"7ef9f951-9976-476a-88b6-e204f7592d20\" (UID: \"7ef9f951-9976-476a-88b6-e204f7592d20\") "
Jul 15 13:43:31.413939 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:31.413921    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ef9f951-9976-476a-88b6-e204f7592d20-credential-socket\") pod \"7ef9f951-9976-476a-88b6-e204f7592d20\" (UID: \"7ef9f951-9976-476a-88b6-e204f7592d20\") "
Jul 15 13:43:31.414676 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:31.414521    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ef9f951-9976-476a-88b6-e204f7592d20-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7ef9f951-9976-476a-88b6-e204f7592d20" (UID: "7ef9f951-9976-476a-88b6-e204f7592d20"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:43:31.414676 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:31.414538    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ef9f951-9976-476a-88b6-e204f7592d20-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7ef9f951-9976-476a-88b6-e204f7592d20" (UID: "7ef9f951-9976-476a-88b6-e204f7592d20"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:43:31.414873 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:31.414642    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ef9f951-9976-476a-88b6-e204f7592d20-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7ef9f951-9976-476a-88b6-e204f7592d20" (UID: "7ef9f951-9976-476a-88b6-e204f7592d20"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:43:31.414873 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:31.414703    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ef9f951-9976-476a-88b6-e204f7592d20-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7ef9f951-9976-476a-88b6-e204f7592d20" (UID: "7ef9f951-9976-476a-88b6-e204f7592d20"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:43:31.414873 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:31.414745    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ef9f951-9976-476a-88b6-e204f7592d20-istio-data" (OuterVolumeSpecName: "istio-data") pod "7ef9f951-9976-476a-88b6-e204f7592d20" (UID: "7ef9f951-9976-476a-88b6-e204f7592d20"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:43:31.416624 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:31.416600    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ef9f951-9976-476a-88b6-e204f7592d20-istio-token" (OuterVolumeSpecName: "istio-token") pod "7ef9f951-9976-476a-88b6-e204f7592d20" (UID: "7ef9f951-9976-476a-88b6-e204f7592d20"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:43:31.416624 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:31.416612    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7ef9f951-9976-476a-88b6-e204f7592d20-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7ef9f951-9976-476a-88b6-e204f7592d20" (UID: "7ef9f951-9976-476a-88b6-e204f7592d20"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 13:43:31.416803 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:31.416785    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ef9f951-9976-476a-88b6-e204f7592d20-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7ef9f951-9976-476a-88b6-e204f7592d20" (UID: "7ef9f951-9976-476a-88b6-e204f7592d20"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:43:31.416887 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:31.416865    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ef9f951-9976-476a-88b6-e204f7592d20-kube-api-access-cnfg7" (OuterVolumeSpecName: "kube-api-access-cnfg7") pod "7ef9f951-9976-476a-88b6-e204f7592d20" (UID: "7ef9f951-9976-476a-88b6-e204f7592d20"). InnerVolumeSpecName "kube-api-access-cnfg7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:43:31.481357 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:31.481319    2578 generic.go:356] "Generic (PLEG): container finished" podID="7ef9f951-9976-476a-88b6-e204f7592d20" containerID="b402519e90b75c37847c9d17cf61951fa61582f2acb2e2311e6ddb79dba3ad8e" exitCode=0
Jul 15 13:43:31.481517 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:31.481361    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c"
Jul 15 13:43:31.481517 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:31.481400    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c" event={"ID":"7ef9f951-9976-476a-88b6-e204f7592d20","Type":"ContainerDied","Data":"b402519e90b75c37847c9d17cf61951fa61582f2acb2e2311e6ddb79dba3ad8e"}
Jul 15 13:43:31.481517 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:31.481456    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c" event={"ID":"7ef9f951-9976-476a-88b6-e204f7592d20","Type":"ContainerDied","Data":"fd662cfa2566107fb6f1072deb371d70ab4d8ed42d4b814012919bb3c95f44c8"}
Jul 15 13:43:31.481517 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:31.481480    2578 scope.go:117] "RemoveContainer" containerID="b402519e90b75c37847c9d17cf61951fa61582f2acb2e2311e6ddb79dba3ad8e"
Jul 15 13:43:31.491571 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:31.491554    2578 scope.go:117] "RemoveContainer" containerID="b5848243adb1fb75f926448ae4436e9c6e5210b673646036fc8f4b9a4d9773ab"
Jul 15 13:43:31.499677 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:31.499655    2578 scope.go:117] "RemoveContainer" containerID="b402519e90b75c37847c9d17cf61951fa61582f2acb2e2311e6ddb79dba3ad8e"
Jul 15 13:43:31.499903 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:43:31.499887    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b402519e90b75c37847c9d17cf61951fa61582f2acb2e2311e6ddb79dba3ad8e\": container with ID starting with b402519e90b75c37847c9d17cf61951fa61582f2acb2e2311e6ddb79dba3ad8e not found: ID does not exist" containerID="b402519e90b75c37847c9d17cf61951fa61582f2acb2e2311e6ddb79dba3ad8e"
Jul 15 13:43:31.499955 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:31.499911    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b402519e90b75c37847c9d17cf61951fa61582f2acb2e2311e6ddb79dba3ad8e"} err="failed to get container status \"b402519e90b75c37847c9d17cf61951fa61582f2acb2e2311e6ddb79dba3ad8e\": rpc error: code = NotFound desc = could not find container \"b402519e90b75c37847c9d17cf61951fa61582f2acb2e2311e6ddb79dba3ad8e\": container with ID starting with b402519e90b75c37847c9d17cf61951fa61582f2acb2e2311e6ddb79dba3ad8e not found: ID does not exist"
Jul 15 13:43:31.499955 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:31.499928    2578 scope.go:117] "RemoveContainer" containerID="b5848243adb1fb75f926448ae4436e9c6e5210b673646036fc8f4b9a4d9773ab"
Jul 15 13:43:31.500150 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:43:31.500133    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5848243adb1fb75f926448ae4436e9c6e5210b673646036fc8f4b9a4d9773ab\": container with ID starting with b5848243adb1fb75f926448ae4436e9c6e5210b673646036fc8f4b9a4d9773ab not found: ID does not exist" containerID="b5848243adb1fb75f926448ae4436e9c6e5210b673646036fc8f4b9a4d9773ab"
Jul 15 13:43:31.500193 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:31.500156    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5848243adb1fb75f926448ae4436e9c6e5210b673646036fc8f4b9a4d9773ab"} err="failed to get container status \"b5848243adb1fb75f926448ae4436e9c6e5210b673646036fc8f4b9a4d9773ab\": rpc error: code = NotFound desc = could not find container \"b5848243adb1fb75f926448ae4436e9c6e5210b673646036fc8f4b9a4d9773ab\": container with ID starting with b5848243adb1fb75f926448ae4436e9c6e5210b673646036fc8f4b9a4d9773ab not found: ID does not exist"
Jul 15 13:43:31.504491 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:31.504469    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c"]
Jul 15 13:43:31.508911 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:31.508890    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-17469591-gw-openshift-default-b6b657df9-pjg8c"]
Jul 15 13:43:31.514661 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:31.514643    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ef9f951-9976-476a-88b6-e204f7592d20-istio-data\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:43:31.514729 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:31.514663    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ef9f951-9976-476a-88b6-e204f7592d20-workload-certs\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:43:31.514729 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:31.514672    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ef9f951-9976-476a-88b6-e204f7592d20-istiod-ca-cert\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:43:31.514729 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:31.514680    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ef9f951-9976-476a-88b6-e204f7592d20-istio-podinfo\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:43:31.514729 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:31.514688    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cnfg7\" (UniqueName: \"kubernetes.io/projected/7ef9f951-9976-476a-88b6-e204f7592d20-kube-api-access-cnfg7\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:43:31.514729 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:31.514698    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ef9f951-9976-476a-88b6-e204f7592d20-istio-envoy\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:43:31.514729 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:31.514707    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ef9f951-9976-476a-88b6-e204f7592d20-workload-socket\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:43:31.514729 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:31.514716    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ef9f951-9976-476a-88b6-e204f7592d20-istio-token\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:43:31.514729 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:31.514726    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ef9f951-9976-476a-88b6-e204f7592d20-credential-socket\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:43:32.376046 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:32.376013    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ef9f951-9976-476a-88b6-e204f7592d20" path="/var/lib/kubelet/pods/7ef9f951-9976-476a-88b6-e204f7592d20/volumes"
Jul 15 13:43:33.934482 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:33.934448    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f2fb3294-64dd47bc94-r8l88"]
Jul 15 13:43:33.935005 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:33.934986    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ef9f951-9976-476a-88b6-e204f7592d20" containerName="istio-proxy"
Jul 15 13:43:33.935053 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:33.935010    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ef9f951-9976-476a-88b6-e204f7592d20" containerName="istio-proxy"
Jul 15 13:43:33.935053 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:33.935025    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ef9f951-9976-476a-88b6-e204f7592d20" containerName="istio-proxy"
Jul 15 13:43:33.935053 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:33.935034    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ef9f951-9976-476a-88b6-e204f7592d20" containerName="istio-proxy"
Jul 15 13:43:33.935145 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:33.935137    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ef9f951-9976-476a-88b6-e204f7592d20" containerName="istio-proxy"
Jul 15 13:43:33.935179 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:33.935149    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ef9f951-9976-476a-88b6-e204f7592d20" containerName="istio-proxy"
Jul 15 13:43:33.940029 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:33.940009    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f2fb3294-64dd47bc94-r8l88"
Jul 15 13:43:33.943023 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:33.942998    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-f2fb3294-serving-cert\""
Jul 15 13:43:33.943258 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:33.943239    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-swdqt\""
Jul 15 13:43:33.947306 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:33.947282    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f2fb3294-64dd47bc94-r8l88"]
Jul 15 13:43:34.037371 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:34.037338    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzvn4\" (UniqueName: \"kubernetes.io/projected/c44afd7e-e4d7-405c-846a-a8dd9e131f75-kube-api-access-lzvn4\") pod \"maas-api-e2e-ait-f2fb3294-64dd47bc94-r8l88\" (UID: \"c44afd7e-e4d7-405c-846a-a8dd9e131f75\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f2fb3294-64dd47bc94-r8l88"
Jul 15 13:43:34.037541 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:34.037404    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c44afd7e-e4d7-405c-846a-a8dd9e131f75-openshift-service-ca\") pod \"maas-api-e2e-ait-f2fb3294-64dd47bc94-r8l88\" (UID: \"c44afd7e-e4d7-405c-846a-a8dd9e131f75\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f2fb3294-64dd47bc94-r8l88"
Jul 15 13:43:34.037541 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:34.037468    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c44afd7e-e4d7-405c-846a-a8dd9e131f75-maas-api-tls\") pod \"maas-api-e2e-ait-f2fb3294-64dd47bc94-r8l88\" (UID: \"c44afd7e-e4d7-405c-846a-a8dd9e131f75\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f2fb3294-64dd47bc94-r8l88"
Jul 15 13:43:34.138798 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:34.138754    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c44afd7e-e4d7-405c-846a-a8dd9e131f75-openshift-service-ca\") pod \"maas-api-e2e-ait-f2fb3294-64dd47bc94-r8l88\" (UID: \"c44afd7e-e4d7-405c-846a-a8dd9e131f75\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f2fb3294-64dd47bc94-r8l88"
Jul 15 13:43:34.139004 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:34.138808    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c44afd7e-e4d7-405c-846a-a8dd9e131f75-maas-api-tls\") pod \"maas-api-e2e-ait-f2fb3294-64dd47bc94-r8l88\" (UID: \"c44afd7e-e4d7-405c-846a-a8dd9e131f75\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f2fb3294-64dd47bc94-r8l88"
Jul 15 13:43:34.139004 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:34.138856    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzvn4\" (UniqueName: \"kubernetes.io/projected/c44afd7e-e4d7-405c-846a-a8dd9e131f75-kube-api-access-lzvn4\") pod \"maas-api-e2e-ait-f2fb3294-64dd47bc94-r8l88\" (UID: \"c44afd7e-e4d7-405c-846a-a8dd9e131f75\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f2fb3294-64dd47bc94-r8l88"
Jul 15 13:43:34.139578 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:34.139545    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c44afd7e-e4d7-405c-846a-a8dd9e131f75-openshift-service-ca\") pod \"maas-api-e2e-ait-f2fb3294-64dd47bc94-r8l88\" (UID: \"c44afd7e-e4d7-405c-846a-a8dd9e131f75\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f2fb3294-64dd47bc94-r8l88"
Jul 15 13:43:34.141291 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:34.141271    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c44afd7e-e4d7-405c-846a-a8dd9e131f75-maas-api-tls\") pod \"maas-api-e2e-ait-f2fb3294-64dd47bc94-r8l88\" (UID: \"c44afd7e-e4d7-405c-846a-a8dd9e131f75\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f2fb3294-64dd47bc94-r8l88"
Jul 15 13:43:34.148245 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:34.148224    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzvn4\" (UniqueName: \"kubernetes.io/projected/c44afd7e-e4d7-405c-846a-a8dd9e131f75-kube-api-access-lzvn4\") pod \"maas-api-e2e-ait-f2fb3294-64dd47bc94-r8l88\" (UID: \"c44afd7e-e4d7-405c-846a-a8dd9e131f75\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f2fb3294-64dd47bc94-r8l88"
Jul 15 13:43:34.252003 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:34.251969    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f2fb3294-64dd47bc94-r8l88"
Jul 15 13:43:34.595437 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:34.595410    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f2fb3294-64dd47bc94-r8l88"]
Jul 15 13:43:34.596876 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:43:34.596846    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc44afd7e_e4d7_405c_846a_a8dd9e131f75.slice/crio-355ffd14ebb494bbf8778b8fc8b645c2994a704cbd9063c9592a4913ffa7a240 WatchSource:0}: Error finding container 355ffd14ebb494bbf8778b8fc8b645c2994a704cbd9063c9592a4913ffa7a240: Status 404 returned error can't find the container with id 355ffd14ebb494bbf8778b8fc8b645c2994a704cbd9063c9592a4913ffa7a240
Jul 15 13:43:35.504958 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:35.504924    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f2fb3294-64dd47bc94-r8l88" event={"ID":"c44afd7e-e4d7-405c-846a-a8dd9e131f75","Type":"ContainerStarted","Data":"e35455a3ebe8fb2c757de1e2b74c766ad33cda7f7689c743ed2f4ec559855bd5"}
Jul 15 13:43:35.505447 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:35.504984    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f2fb3294-64dd47bc94-r8l88"
Jul 15 13:43:35.505447 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:35.505002    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f2fb3294-64dd47bc94-r8l88" event={"ID":"c44afd7e-e4d7-405c-846a-a8dd9e131f75","Type":"ContainerStarted","Data":"355ffd14ebb494bbf8778b8fc8b645c2994a704cbd9063c9592a4913ffa7a240"}
Jul 15 13:43:35.550501 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:35.550440    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f2fb3294-64dd47bc94-r8l88" podStartSLOduration=2.126048651 podStartE2EDuration="2.55042328s" totalImagesPullingTime="424.374629ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:43:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:43:35.549851116 +0000 UTC m=+1935.637638060" watchObservedRunningTime="2026-07-15 13:43:35.55042328 +0000 UTC m=+1935.638210267"
Jul 15 13:43:41.515111 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:41.515081    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f2fb3294-64dd47bc94-r8l88"
Jul 15 13:43:49.471735 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:49.471702    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f2fb3294-64dd47bc94-r8l88"]
Jul 15 13:43:49.472140 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:49.471899    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f2fb3294-64dd47bc94-r8l88" podUID="c44afd7e-e4d7-405c-846a-a8dd9e131f75" containerName="maas-api" containerID="cri-o://e35455a3ebe8fb2c757de1e2b74c766ad33cda7f7689c743ed2f4ec559855bd5" gracePeriod=30
Jul 15 13:43:49.713936 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:49.713910    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f2fb3294-64dd47bc94-r8l88"
Jul 15 13:43:49.781647 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:49.781555    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c44afd7e-e4d7-405c-846a-a8dd9e131f75-openshift-service-ca\") pod \"c44afd7e-e4d7-405c-846a-a8dd9e131f75\" (UID: \"c44afd7e-e4d7-405c-846a-a8dd9e131f75\") "
Jul 15 13:43:49.781647 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:49.781631    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c44afd7e-e4d7-405c-846a-a8dd9e131f75-maas-api-tls\") pod \"c44afd7e-e4d7-405c-846a-a8dd9e131f75\" (UID: \"c44afd7e-e4d7-405c-846a-a8dd9e131f75\") "
Jul 15 13:43:49.781840 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:49.781687    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lzvn4\" (UniqueName: \"kubernetes.io/projected/c44afd7e-e4d7-405c-846a-a8dd9e131f75-kube-api-access-lzvn4\") pod \"c44afd7e-e4d7-405c-846a-a8dd9e131f75\" (UID: \"c44afd7e-e4d7-405c-846a-a8dd9e131f75\") "
Jul 15 13:43:49.782031 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:49.782004    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c44afd7e-e4d7-405c-846a-a8dd9e131f75-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c44afd7e-e4d7-405c-846a-a8dd9e131f75" (UID: "c44afd7e-e4d7-405c-846a-a8dd9e131f75"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:43:49.783821 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:49.783796    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c44afd7e-e4d7-405c-846a-a8dd9e131f75-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c44afd7e-e4d7-405c-846a-a8dd9e131f75" (UID: "c44afd7e-e4d7-405c-846a-a8dd9e131f75"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:43:49.783900 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:49.783814    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c44afd7e-e4d7-405c-846a-a8dd9e131f75-kube-api-access-lzvn4" (OuterVolumeSpecName: "kube-api-access-lzvn4") pod "c44afd7e-e4d7-405c-846a-a8dd9e131f75" (UID: "c44afd7e-e4d7-405c-846a-a8dd9e131f75"). InnerVolumeSpecName "kube-api-access-lzvn4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:43:49.883448 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:49.883404    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzvn4\" (UniqueName: \"kubernetes.io/projected/c44afd7e-e4d7-405c-846a-a8dd9e131f75-kube-api-access-lzvn4\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:43:49.883448 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:49.883441    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c44afd7e-e4d7-405c-846a-a8dd9e131f75-openshift-service-ca\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:43:49.883448 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:49.883452    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c44afd7e-e4d7-405c-846a-a8dd9e131f75-maas-api-tls\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:43:50.588276 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:50.588167    2578 generic.go:356] "Generic (PLEG): container finished" podID="c44afd7e-e4d7-405c-846a-a8dd9e131f75" containerID="e35455a3ebe8fb2c757de1e2b74c766ad33cda7f7689c743ed2f4ec559855bd5" exitCode=0
Jul 15 13:43:50.588276 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:50.588255    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f2fb3294-64dd47bc94-r8l88"
Jul 15 13:43:50.588276 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:50.588252    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f2fb3294-64dd47bc94-r8l88" event={"ID":"c44afd7e-e4d7-405c-846a-a8dd9e131f75","Type":"ContainerDied","Data":"e35455a3ebe8fb2c757de1e2b74c766ad33cda7f7689c743ed2f4ec559855bd5"}
Jul 15 13:43:50.588789 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:50.588314    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f2fb3294-64dd47bc94-r8l88" event={"ID":"c44afd7e-e4d7-405c-846a-a8dd9e131f75","Type":"ContainerDied","Data":"355ffd14ebb494bbf8778b8fc8b645c2994a704cbd9063c9592a4913ffa7a240"}
Jul 15 13:43:50.588789 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:50.588338    2578 scope.go:117] "RemoveContainer" containerID="e35455a3ebe8fb2c757de1e2b74c766ad33cda7f7689c743ed2f4ec559855bd5"
Jul 15 13:43:50.597174 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:50.597155    2578 scope.go:117] "RemoveContainer" containerID="e35455a3ebe8fb2c757de1e2b74c766ad33cda7f7689c743ed2f4ec559855bd5"
Jul 15 13:43:50.597434 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:43:50.597415    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e35455a3ebe8fb2c757de1e2b74c766ad33cda7f7689c743ed2f4ec559855bd5\": container with ID starting with e35455a3ebe8fb2c757de1e2b74c766ad33cda7f7689c743ed2f4ec559855bd5 not found: ID does not exist" containerID="e35455a3ebe8fb2c757de1e2b74c766ad33cda7f7689c743ed2f4ec559855bd5"
Jul 15 13:43:50.597484 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:50.597442    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e35455a3ebe8fb2c757de1e2b74c766ad33cda7f7689c743ed2f4ec559855bd5"} err="failed to get container status \"e35455a3ebe8fb2c757de1e2b74c766ad33cda7f7689c743ed2f4ec559855bd5\": rpc error: code = NotFound desc = could not find container \"e35455a3ebe8fb2c757de1e2b74c766ad33cda7f7689c743ed2f4ec559855bd5\": container with ID starting with e35455a3ebe8fb2c757de1e2b74c766ad33cda7f7689c743ed2f4ec559855bd5 not found: ID does not exist"
Jul 15 13:43:50.606974 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:50.606950    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f2fb3294-64dd47bc94-r8l88"]
Jul 15 13:43:50.612440 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:50.612416    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f2fb3294-64dd47bc94-r8l88"]
Jul 15 13:43:52.375070 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:43:52.375037    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c44afd7e-e4d7-405c-846a-a8dd9e131f75" path="/var/lib/kubelet/pods/c44afd7e-e4d7-405c-846a-a8dd9e131f75/volumes"
Jul 15 13:44:06.816771 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:44:06.816735    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9e5a80bf-898f86f9f-2jq6h"]
Jul 15 13:44:06.817198 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:44:06.817087    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c44afd7e-e4d7-405c-846a-a8dd9e131f75" containerName="maas-api"
Jul 15 13:44:06.817198 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:44:06.817098    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c44afd7e-e4d7-405c-846a-a8dd9e131f75" containerName="maas-api"
Jul 15 13:44:06.817198 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:44:06.817158    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c44afd7e-e4d7-405c-846a-a8dd9e131f75" containerName="maas-api"
Jul 15 13:44:06.820465 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:44:06.820448    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9e5a80bf-898f86f9f-2jq6h"
Jul 15 13:44:06.823625 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:44:06.823603    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-9e5a80bf-serving-cert\""
Jul 15 13:44:06.823989 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:44:06.823972    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-swdqt\""
Jul 15 13:44:06.836704 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:44:06.836678    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9e5a80bf-898f86f9f-2jq6h"]
Jul 15 13:44:06.939589 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:44:06.939551    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2419342b-179b-4b41-8227-9175e0c62322-maas-api-tls\") pod \"maas-api-e2e-derive-9e5a80bf-898f86f9f-2jq6h\" (UID: \"2419342b-179b-4b41-8227-9175e0c62322\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9e5a80bf-898f86f9f-2jq6h"
Jul 15 13:44:06.939757 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:44:06.939604    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2419342b-179b-4b41-8227-9175e0c62322-openshift-service-ca\") pod \"maas-api-e2e-derive-9e5a80bf-898f86f9f-2jq6h\" (UID: \"2419342b-179b-4b41-8227-9175e0c62322\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9e5a80bf-898f86f9f-2jq6h"
Jul 15 13:44:06.939757 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:44:06.939722    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gcg6\" (UniqueName: \"kubernetes.io/projected/2419342b-179b-4b41-8227-9175e0c62322-kube-api-access-4gcg6\") pod \"maas-api-e2e-derive-9e5a80bf-898f86f9f-2jq6h\" (UID: \"2419342b-179b-4b41-8227-9175e0c62322\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9e5a80bf-898f86f9f-2jq6h"
Jul 15 13:44:07.041054 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:44:07.041015    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gcg6\" (UniqueName: \"kubernetes.io/projected/2419342b-179b-4b41-8227-9175e0c62322-kube-api-access-4gcg6\") pod \"maas-api-e2e-derive-9e5a80bf-898f86f9f-2jq6h\" (UID: \"2419342b-179b-4b41-8227-9175e0c62322\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9e5a80bf-898f86f9f-2jq6h"
Jul 15 13:44:07.041298 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:44:07.041076    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2419342b-179b-4b41-8227-9175e0c62322-maas-api-tls\") pod \"maas-api-e2e-derive-9e5a80bf-898f86f9f-2jq6h\" (UID: \"2419342b-179b-4b41-8227-9175e0c62322\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9e5a80bf-898f86f9f-2jq6h"
Jul 15 13:44:07.041298 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:44:07.041121    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2419342b-179b-4b41-8227-9175e0c62322-openshift-service-ca\") pod \"maas-api-e2e-derive-9e5a80bf-898f86f9f-2jq6h\" (UID: \"2419342b-179b-4b41-8227-9175e0c62322\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9e5a80bf-898f86f9f-2jq6h"
Jul 15 13:44:07.041298 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:44:07.041250    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-9e5a80bf-serving-cert: secret "maas-api-e2e-derive-9e5a80bf-serving-cert" not found
Jul 15 13:44:07.041527 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:44:07.041319    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2419342b-179b-4b41-8227-9175e0c62322-maas-api-tls podName:2419342b-179b-4b41-8227-9175e0c62322 nodeName:}" failed. No retries permitted until 2026-07-15 13:44:07.541302679 +0000 UTC m=+1967.629089600 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2419342b-179b-4b41-8227-9175e0c62322-maas-api-tls") pod "maas-api-e2e-derive-9e5a80bf-898f86f9f-2jq6h" (UID: "2419342b-179b-4b41-8227-9175e0c62322") : secret "maas-api-e2e-derive-9e5a80bf-serving-cert" not found
Jul 15 13:44:07.041863 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:44:07.041841    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2419342b-179b-4b41-8227-9175e0c62322-openshift-service-ca\") pod \"maas-api-e2e-derive-9e5a80bf-898f86f9f-2jq6h\" (UID: \"2419342b-179b-4b41-8227-9175e0c62322\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9e5a80bf-898f86f9f-2jq6h"
Jul 15 13:44:07.054636 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:44:07.054614    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gcg6\" (UniqueName: \"kubernetes.io/projected/2419342b-179b-4b41-8227-9175e0c62322-kube-api-access-4gcg6\") pod \"maas-api-e2e-derive-9e5a80bf-898f86f9f-2jq6h\" (UID: \"2419342b-179b-4b41-8227-9175e0c62322\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9e5a80bf-898f86f9f-2jq6h"
Jul 15 13:44:07.546494 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:44:07.546461    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2419342b-179b-4b41-8227-9175e0c62322-maas-api-tls\") pod \"maas-api-e2e-derive-9e5a80bf-898f86f9f-2jq6h\" (UID: \"2419342b-179b-4b41-8227-9175e0c62322\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9e5a80bf-898f86f9f-2jq6h"
Jul 15 13:44:07.548818 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:44:07.548798    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2419342b-179b-4b41-8227-9175e0c62322-maas-api-tls\") pod \"maas-api-e2e-derive-9e5a80bf-898f86f9f-2jq6h\" (UID: \"2419342b-179b-4b41-8227-9175e0c62322\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9e5a80bf-898f86f9f-2jq6h"
Jul 15 13:44:07.731393 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:44:07.731362    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9e5a80bf-898f86f9f-2jq6h"
Jul 15 13:44:07.866153 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:44:07.866125    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9e5a80bf-898f86f9f-2jq6h"]
Jul 15 13:44:07.868378 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:44:07.868341    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2419342b_179b_4b41_8227_9175e0c62322.slice/crio-327496344ccf4fb2ff606e06b7fb7dab1d31cffefb254f15c24f82aedd84ba26 WatchSource:0}: Error finding container 327496344ccf4fb2ff606e06b7fb7dab1d31cffefb254f15c24f82aedd84ba26: Status 404 returned error can't find the container with id 327496344ccf4fb2ff606e06b7fb7dab1d31cffefb254f15c24f82aedd84ba26
Jul 15 13:44:08.692586 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:44:08.692500    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9e5a80bf-898f86f9f-2jq6h" event={"ID":"2419342b-179b-4b41-8227-9175e0c62322","Type":"ContainerStarted","Data":"439c013d47696f7771993a55814320fdbc8ce95089a4866994c51b4ffca223d8"}
Jul 15 13:44:08.692586 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:44:08.692558    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9e5a80bf-898f86f9f-2jq6h" event={"ID":"2419342b-179b-4b41-8227-9175e0c62322","Type":"ContainerStarted","Data":"327496344ccf4fb2ff606e06b7fb7dab1d31cffefb254f15c24f82aedd84ba26"}
Jul 15 13:44:08.692790 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:44:08.692628    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9e5a80bf-898f86f9f-2jq6h"
Jul 15 13:44:08.713195 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:44:08.713151    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9e5a80bf-898f86f9f-2jq6h" podStartSLOduration=2.191164375 podStartE2EDuration="2.713137371s" totalImagesPullingTime="521.972996ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:44:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:44:08.710734089 +0000 UTC m=+1968.798521031" watchObservedRunningTime="2026-07-15 13:44:08.713137371 +0000 UTC m=+1968.800924313"
Jul 15 13:44:14.703559 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:44:14.703474    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9e5a80bf-898f86f9f-2jq6h"
Jul 15 13:45:21.642401 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:45:21.642362    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9e5a80bf-898f86f9f-2jq6h"]
Jul 15 13:45:21.642927 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:45:21.642663    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9e5a80bf-898f86f9f-2jq6h" podUID="2419342b-179b-4b41-8227-9175e0c62322" containerName="maas-api" containerID="cri-o://439c013d47696f7771993a55814320fdbc8ce95089a4866994c51b4ffca223d8" gracePeriod=30
Jul 15 13:45:21.891034 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:45:21.891008    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9e5a80bf-898f86f9f-2jq6h"
Jul 15 13:45:22.015720 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:45:22.015682    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2419342b-179b-4b41-8227-9175e0c62322-maas-api-tls\") pod \"2419342b-179b-4b41-8227-9175e0c62322\" (UID: \"2419342b-179b-4b41-8227-9175e0c62322\") "
Jul 15 13:45:22.015895 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:45:22.015759    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4gcg6\" (UniqueName: \"kubernetes.io/projected/2419342b-179b-4b41-8227-9175e0c62322-kube-api-access-4gcg6\") pod \"2419342b-179b-4b41-8227-9175e0c62322\" (UID: \"2419342b-179b-4b41-8227-9175e0c62322\") "
Jul 15 13:45:22.015895 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:45:22.015828    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2419342b-179b-4b41-8227-9175e0c62322-openshift-service-ca\") pod \"2419342b-179b-4b41-8227-9175e0c62322\" (UID: \"2419342b-179b-4b41-8227-9175e0c62322\") "
Jul 15 13:45:22.016224 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:45:22.016176    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2419342b-179b-4b41-8227-9175e0c62322-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2419342b-179b-4b41-8227-9175e0c62322" (UID: "2419342b-179b-4b41-8227-9175e0c62322"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:45:22.017944 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:45:22.017917    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2419342b-179b-4b41-8227-9175e0c62322-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2419342b-179b-4b41-8227-9175e0c62322" (UID: "2419342b-179b-4b41-8227-9175e0c62322"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:45:22.018035 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:45:22.017925    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2419342b-179b-4b41-8227-9175e0c62322-kube-api-access-4gcg6" (OuterVolumeSpecName: "kube-api-access-4gcg6") pod "2419342b-179b-4b41-8227-9175e0c62322" (UID: "2419342b-179b-4b41-8227-9175e0c62322"). InnerVolumeSpecName "kube-api-access-4gcg6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:45:22.070925 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:45:22.070893    2578 generic.go:356] "Generic (PLEG): container finished" podID="2419342b-179b-4b41-8227-9175e0c62322" containerID="439c013d47696f7771993a55814320fdbc8ce95089a4866994c51b4ffca223d8" exitCode=0
Jul 15 13:45:22.071159 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:45:22.070945    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9e5a80bf-898f86f9f-2jq6h"
Jul 15 13:45:22.071159 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:45:22.070980    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9e5a80bf-898f86f9f-2jq6h" event={"ID":"2419342b-179b-4b41-8227-9175e0c62322","Type":"ContainerDied","Data":"439c013d47696f7771993a55814320fdbc8ce95089a4866994c51b4ffca223d8"}
Jul 15 13:45:22.071159 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:45:22.071034    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9e5a80bf-898f86f9f-2jq6h" event={"ID":"2419342b-179b-4b41-8227-9175e0c62322","Type":"ContainerDied","Data":"327496344ccf4fb2ff606e06b7fb7dab1d31cffefb254f15c24f82aedd84ba26"}
Jul 15 13:45:22.071159 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:45:22.071066    2578 scope.go:117] "RemoveContainer" containerID="439c013d47696f7771993a55814320fdbc8ce95089a4866994c51b4ffca223d8"
Jul 15 13:45:22.080861 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:45:22.080844    2578 scope.go:117] "RemoveContainer" containerID="439c013d47696f7771993a55814320fdbc8ce95089a4866994c51b4ffca223d8"
Jul 15 13:45:22.081141 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:45:22.081124    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"439c013d47696f7771993a55814320fdbc8ce95089a4866994c51b4ffca223d8\": container with ID starting with 439c013d47696f7771993a55814320fdbc8ce95089a4866994c51b4ffca223d8 not found: ID does not exist" containerID="439c013d47696f7771993a55814320fdbc8ce95089a4866994c51b4ffca223d8"
Jul 15 13:45:22.081220 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:45:22.081156    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"439c013d47696f7771993a55814320fdbc8ce95089a4866994c51b4ffca223d8"} err="failed to get container status \"439c013d47696f7771993a55814320fdbc8ce95089a4866994c51b4ffca223d8\": rpc error: code = NotFound desc = could not find container \"439c013d47696f7771993a55814320fdbc8ce95089a4866994c51b4ffca223d8\": container with ID starting with 439c013d47696f7771993a55814320fdbc8ce95089a4866994c51b4ffca223d8 not found: ID does not exist"
Jul 15 13:45:22.094329 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:45:22.094307    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9e5a80bf-898f86f9f-2jq6h"]
Jul 15 13:45:22.098900 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:45:22.098879    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9e5a80bf-898f86f9f-2jq6h"]
Jul 15 13:45:22.116832 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:45:22.116816    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2419342b-179b-4b41-8227-9175e0c62322-maas-api-tls\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:45:22.116887 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:45:22.116836    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4gcg6\" (UniqueName: \"kubernetes.io/projected/2419342b-179b-4b41-8227-9175e0c62322-kube-api-access-4gcg6\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:45:22.116887 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:45:22.116845    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2419342b-179b-4b41-8227-9175e0c62322-openshift-service-ca\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:45:22.375299 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:45:22.375191    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2419342b-179b-4b41-8227-9175e0c62322" path="/var/lib/kubelet/pods/2419342b-179b-4b41-8227-9175e0c62322/volumes"
Jul 15 13:46:20.473019 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:46:20.472993    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-t4bfh_c21b11d6-3242-4dd5-8b75-74dad14868e9/console-operator/1.log"
Jul 15 13:46:20.477456 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:46:20.477424    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt6q4_49ca8630-3cc0-4dbb-8c80-a948ad0de2b4/ovn-acl-logging/0.log"
Jul 15 13:46:20.477876 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:46:20.477855    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-t4bfh_c21b11d6-3242-4dd5-8b75-74dad14868e9/console-operator/1.log"
Jul 15 13:46:20.482503 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:46:20.482481    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt6q4_49ca8630-3cc0-4dbb-8c80-a948ad0de2b4/ovn-acl-logging/0.log"
Jul 15 13:47:17.776583 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:47:17.776499    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a566516a-79dc5ddc4d-rr4tn"]
Jul 15 13:47:17.777157 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:47:17.776840    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2419342b-179b-4b41-8227-9175e0c62322" containerName="maas-api"
Jul 15 13:47:17.777157 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:47:17.776850    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2419342b-179b-4b41-8227-9175e0c62322" containerName="maas-api"
Jul 15 13:47:17.777157 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:47:17.776911    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2419342b-179b-4b41-8227-9175e0c62322" containerName="maas-api"
Jul 15 13:47:17.780048 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:47:17.780025    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a566516a-79dc5ddc4d-rr4tn"
Jul 15 13:47:17.782779 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:47:17.782754    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-a566516a-serving-cert\""
Jul 15 13:47:17.782907 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:47:17.782892    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-swdqt\""
Jul 15 13:47:17.792222 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:47:17.792186    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a566516a-79dc5ddc4d-rr4tn"]
Jul 15 13:47:17.932699 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:47:17.932669    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npc62\" (UniqueName: \"kubernetes.io/projected/03a9ba3d-b37d-433b-ada2-d94602cdb8a4-kube-api-access-npc62\") pod \"maas-api-e2e-mt-a566516a-79dc5ddc4d-rr4tn\" (UID: \"03a9ba3d-b37d-433b-ada2-d94602cdb8a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a566516a-79dc5ddc4d-rr4tn"
Jul 15 13:47:17.932866 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:47:17.932718    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03a9ba3d-b37d-433b-ada2-d94602cdb8a4-maas-api-tls\") pod \"maas-api-e2e-mt-a566516a-79dc5ddc4d-rr4tn\" (UID: \"03a9ba3d-b37d-433b-ada2-d94602cdb8a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a566516a-79dc5ddc4d-rr4tn"
Jul 15 13:47:17.932866 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:47:17.932794    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03a9ba3d-b37d-433b-ada2-d94602cdb8a4-openshift-service-ca\") pod \"maas-api-e2e-mt-a566516a-79dc5ddc4d-rr4tn\" (UID: \"03a9ba3d-b37d-433b-ada2-d94602cdb8a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a566516a-79dc5ddc4d-rr4tn"
Jul 15 13:47:18.033776 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:47:18.033701    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03a9ba3d-b37d-433b-ada2-d94602cdb8a4-openshift-service-ca\") pod \"maas-api-e2e-mt-a566516a-79dc5ddc4d-rr4tn\" (UID: \"03a9ba3d-b37d-433b-ada2-d94602cdb8a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a566516a-79dc5ddc4d-rr4tn"
Jul 15 13:47:18.033776 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:47:18.033754    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npc62\" (UniqueName: \"kubernetes.io/projected/03a9ba3d-b37d-433b-ada2-d94602cdb8a4-kube-api-access-npc62\") pod \"maas-api-e2e-mt-a566516a-79dc5ddc4d-rr4tn\" (UID: \"03a9ba3d-b37d-433b-ada2-d94602cdb8a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a566516a-79dc5ddc4d-rr4tn"
Jul 15 13:47:18.033947 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:47:18.033788    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03a9ba3d-b37d-433b-ada2-d94602cdb8a4-maas-api-tls\") pod \"maas-api-e2e-mt-a566516a-79dc5ddc4d-rr4tn\" (UID: \"03a9ba3d-b37d-433b-ada2-d94602cdb8a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a566516a-79dc5ddc4d-rr4tn"
Jul 15 13:47:18.034422 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:47:18.034388    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03a9ba3d-b37d-433b-ada2-d94602cdb8a4-openshift-service-ca\") pod \"maas-api-e2e-mt-a566516a-79dc5ddc4d-rr4tn\" (UID: \"03a9ba3d-b37d-433b-ada2-d94602cdb8a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a566516a-79dc5ddc4d-rr4tn"
Jul 15 13:47:18.036123 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:47:18.036106    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03a9ba3d-b37d-433b-ada2-d94602cdb8a4-maas-api-tls\") pod \"maas-api-e2e-mt-a566516a-79dc5ddc4d-rr4tn\" (UID: \"03a9ba3d-b37d-433b-ada2-d94602cdb8a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a566516a-79dc5ddc4d-rr4tn"
Jul 15 13:47:18.044521 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:47:18.044492    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npc62\" (UniqueName: \"kubernetes.io/projected/03a9ba3d-b37d-433b-ada2-d94602cdb8a4-kube-api-access-npc62\") pod \"maas-api-e2e-mt-a566516a-79dc5ddc4d-rr4tn\" (UID: \"03a9ba3d-b37d-433b-ada2-d94602cdb8a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a566516a-79dc5ddc4d-rr4tn"
Jul 15 13:47:18.090767 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:47:18.090746    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a566516a-79dc5ddc4d-rr4tn"
Jul 15 13:47:18.222799 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:47:18.222769    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a566516a-79dc5ddc4d-rr4tn"]
Jul 15 13:47:18.223801 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:47:18.223777    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03a9ba3d_b37d_433b_ada2_d94602cdb8a4.slice/crio-92c0261bf7dc1dd7e101a79a6173e7e07260efabdaa64c26118ff3a095b285f5 WatchSource:0}: Error finding container 92c0261bf7dc1dd7e101a79a6173e7e07260efabdaa64c26118ff3a095b285f5: Status 404 returned error can't find the container with id 92c0261bf7dc1dd7e101a79a6173e7e07260efabdaa64c26118ff3a095b285f5
Jul 15 13:47:18.225182 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:47:18.225164    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 13:47:18.683948 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:47:18.683914    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a566516a-79dc5ddc4d-rr4tn" event={"ID":"03a9ba3d-b37d-433b-ada2-d94602cdb8a4","Type":"ContainerStarted","Data":"92c0261bf7dc1dd7e101a79a6173e7e07260efabdaa64c26118ff3a095b285f5"}
Jul 15 13:47:19.691126 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:47:19.691088    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a566516a-79dc5ddc4d-rr4tn" event={"ID":"03a9ba3d-b37d-433b-ada2-d94602cdb8a4","Type":"ContainerStarted","Data":"c80cd1ae908e9bdd35e4fea10797ab436f8e9d9376a7fcf646ec0e4856bccdde"}
Jul 15 13:47:19.691543 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:47:19.691223    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a566516a-79dc5ddc4d-rr4tn"
Jul 15 13:47:19.710654 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:47:19.710607    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a566516a-79dc5ddc4d-rr4tn" podStartSLOduration=2.072055186 podStartE2EDuration="2.710591829s" totalImagesPullingTime="638.536643ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:47:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:47:19.709022352 +0000 UTC m=+2159.796809295" watchObservedRunningTime="2026-07-15 13:47:19.710591829 +0000 UTC m=+2159.798378792"
Jul 15 13:47:25.702000 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:47:25.701964    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a566516a-79dc5ddc4d-rr4tn"
Jul 15 13:47:40.710355 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:47:40.710317    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a566516a-79dc5ddc4d-rr4tn"]
Jul 15 13:47:40.712943 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:47:40.710566    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a566516a-79dc5ddc4d-rr4tn" podUID="03a9ba3d-b37d-433b-ada2-d94602cdb8a4" containerName="maas-api" containerID="cri-o://c80cd1ae908e9bdd35e4fea10797ab436f8e9d9376a7fcf646ec0e4856bccdde" gracePeriod=30
Jul 15 13:47:40.963961 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:47:40.963904    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a566516a-79dc5ddc4d-rr4tn"
Jul 15 13:47:41.035672 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:47:41.035640    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03a9ba3d-b37d-433b-ada2-d94602cdb8a4-openshift-service-ca\") pod \"03a9ba3d-b37d-433b-ada2-d94602cdb8a4\" (UID: \"03a9ba3d-b37d-433b-ada2-d94602cdb8a4\") "
Jul 15 13:47:41.035824 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:47:41.035685    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-npc62\" (UniqueName: \"kubernetes.io/projected/03a9ba3d-b37d-433b-ada2-d94602cdb8a4-kube-api-access-npc62\") pod \"03a9ba3d-b37d-433b-ada2-d94602cdb8a4\" (UID: \"03a9ba3d-b37d-433b-ada2-d94602cdb8a4\") "
Jul 15 13:47:41.035824 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:47:41.035723    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03a9ba3d-b37d-433b-ada2-d94602cdb8a4-maas-api-tls\") pod \"03a9ba3d-b37d-433b-ada2-d94602cdb8a4\" (UID: \"03a9ba3d-b37d-433b-ada2-d94602cdb8a4\") "
Jul 15 13:47:41.036042 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:47:41.036014    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03a9ba3d-b37d-433b-ada2-d94602cdb8a4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "03a9ba3d-b37d-433b-ada2-d94602cdb8a4" (UID: "03a9ba3d-b37d-433b-ada2-d94602cdb8a4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:47:41.037742 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:47:41.037706    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03a9ba3d-b37d-433b-ada2-d94602cdb8a4-kube-api-access-npc62" (OuterVolumeSpecName: "kube-api-access-npc62") pod "03a9ba3d-b37d-433b-ada2-d94602cdb8a4" (UID: "03a9ba3d-b37d-433b-ada2-d94602cdb8a4"). InnerVolumeSpecName "kube-api-access-npc62". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:47:41.037742 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:47:41.037727    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03a9ba3d-b37d-433b-ada2-d94602cdb8a4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "03a9ba3d-b37d-433b-ada2-d94602cdb8a4" (UID: "03a9ba3d-b37d-433b-ada2-d94602cdb8a4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:47:41.137023 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:47:41.136995    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03a9ba3d-b37d-433b-ada2-d94602cdb8a4-openshift-service-ca\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:47:41.137023 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:47:41.137020    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-npc62\" (UniqueName: \"kubernetes.io/projected/03a9ba3d-b37d-433b-ada2-d94602cdb8a4-kube-api-access-npc62\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:47:41.137023 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:47:41.137030    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03a9ba3d-b37d-433b-ada2-d94602cdb8a4-maas-api-tls\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:47:41.803683 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:47:41.803644    2578 generic.go:356] "Generic (PLEG): container finished" podID="03a9ba3d-b37d-433b-ada2-d94602cdb8a4" containerID="c80cd1ae908e9bdd35e4fea10797ab436f8e9d9376a7fcf646ec0e4856bccdde" exitCode=0
Jul 15 13:47:41.804128 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:47:41.803691    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a566516a-79dc5ddc4d-rr4tn"
Jul 15 13:47:41.804128 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:47:41.803703    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a566516a-79dc5ddc4d-rr4tn" event={"ID":"03a9ba3d-b37d-433b-ada2-d94602cdb8a4","Type":"ContainerDied","Data":"c80cd1ae908e9bdd35e4fea10797ab436f8e9d9376a7fcf646ec0e4856bccdde"}
Jul 15 13:47:41.804128 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:47:41.803757    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a566516a-79dc5ddc4d-rr4tn" event={"ID":"03a9ba3d-b37d-433b-ada2-d94602cdb8a4","Type":"ContainerDied","Data":"92c0261bf7dc1dd7e101a79a6173e7e07260efabdaa64c26118ff3a095b285f5"}
Jul 15 13:47:41.804128 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:47:41.803787    2578 scope.go:117] "RemoveContainer" containerID="c80cd1ae908e9bdd35e4fea10797ab436f8e9d9376a7fcf646ec0e4856bccdde"
Jul 15 13:47:41.812987 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:47:41.812971    2578 scope.go:117] "RemoveContainer" containerID="c80cd1ae908e9bdd35e4fea10797ab436f8e9d9376a7fcf646ec0e4856bccdde"
Jul 15 13:47:41.813256 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:47:41.813237    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c80cd1ae908e9bdd35e4fea10797ab436f8e9d9376a7fcf646ec0e4856bccdde\": container with ID starting with c80cd1ae908e9bdd35e4fea10797ab436f8e9d9376a7fcf646ec0e4856bccdde not found: ID does not exist" containerID="c80cd1ae908e9bdd35e4fea10797ab436f8e9d9376a7fcf646ec0e4856bccdde"
Jul 15 13:47:41.813312 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:47:41.813264    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c80cd1ae908e9bdd35e4fea10797ab436f8e9d9376a7fcf646ec0e4856bccdde"} err="failed to get container status \"c80cd1ae908e9bdd35e4fea10797ab436f8e9d9376a7fcf646ec0e4856bccdde\": rpc error: code = NotFound desc = could not find container \"c80cd1ae908e9bdd35e4fea10797ab436f8e9d9376a7fcf646ec0e4856bccdde\": container with ID starting with c80cd1ae908e9bdd35e4fea10797ab436f8e9d9376a7fcf646ec0e4856bccdde not found: ID does not exist"
Jul 15 13:47:41.826593 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:47:41.826568    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a566516a-79dc5ddc4d-rr4tn"]
Jul 15 13:47:41.833215 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:47:41.833185    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a566516a-79dc5ddc4d-rr4tn"]
Jul 15 13:47:42.375666 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:47:42.375634    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03a9ba3d-b37d-433b-ada2-d94602cdb8a4" path="/var/lib/kubelet/pods/03a9ba3d-b37d-433b-ada2-d94602cdb8a4/volumes"
Jul 15 13:48:19.593828 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:48:19.593792    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-954f0f75-66f44b6f6c-zbqvl"]
Jul 15 13:48:19.594363 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:48:19.594268    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03a9ba3d-b37d-433b-ada2-d94602cdb8a4" containerName="maas-api"
Jul 15 13:48:19.594363 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:48:19.594282    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="03a9ba3d-b37d-433b-ada2-d94602cdb8a4" containerName="maas-api"
Jul 15 13:48:19.594363 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:48:19.594360    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="03a9ba3d-b37d-433b-ada2-d94602cdb8a4" containerName="maas-api"
Jul 15 13:48:19.597543 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:48:19.597523    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-954f0f75-66f44b6f6c-zbqvl"
Jul 15 13:48:19.600288 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:48:19.600266    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-954f0f75-serving-cert\""
Jul 15 13:48:19.600402 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:48:19.600290    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-swdqt\""
Jul 15 13:48:19.607680 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:48:19.607641    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-954f0f75-66f44b6f6c-zbqvl"]
Jul 15 13:48:19.662383 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:48:19.662350    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5fxx\" (UniqueName: \"kubernetes.io/projected/0159424a-8d8c-4457-8f05-8105031902e1-kube-api-access-f5fxx\") pod \"maas-api-e2e-mt-954f0f75-66f44b6f6c-zbqvl\" (UID: \"0159424a-8d8c-4457-8f05-8105031902e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-954f0f75-66f44b6f6c-zbqvl"
Jul 15 13:48:19.662513 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:48:19.662428    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0159424a-8d8c-4457-8f05-8105031902e1-openshift-service-ca\") pod \"maas-api-e2e-mt-954f0f75-66f44b6f6c-zbqvl\" (UID: \"0159424a-8d8c-4457-8f05-8105031902e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-954f0f75-66f44b6f6c-zbqvl"
Jul 15 13:48:19.662513 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:48:19.662462    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0159424a-8d8c-4457-8f05-8105031902e1-maas-api-tls\") pod \"maas-api-e2e-mt-954f0f75-66f44b6f6c-zbqvl\" (UID: \"0159424a-8d8c-4457-8f05-8105031902e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-954f0f75-66f44b6f6c-zbqvl"
Jul 15 13:48:19.763880 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:48:19.763845    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0159424a-8d8c-4457-8f05-8105031902e1-openshift-service-ca\") pod \"maas-api-e2e-mt-954f0f75-66f44b6f6c-zbqvl\" (UID: \"0159424a-8d8c-4457-8f05-8105031902e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-954f0f75-66f44b6f6c-zbqvl"
Jul 15 13:48:19.763880 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:48:19.763882    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0159424a-8d8c-4457-8f05-8105031902e1-maas-api-tls\") pod \"maas-api-e2e-mt-954f0f75-66f44b6f6c-zbqvl\" (UID: \"0159424a-8d8c-4457-8f05-8105031902e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-954f0f75-66f44b6f6c-zbqvl"
Jul 15 13:48:19.764052 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:48:19.763916    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5fxx\" (UniqueName: \"kubernetes.io/projected/0159424a-8d8c-4457-8f05-8105031902e1-kube-api-access-f5fxx\") pod \"maas-api-e2e-mt-954f0f75-66f44b6f6c-zbqvl\" (UID: \"0159424a-8d8c-4457-8f05-8105031902e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-954f0f75-66f44b6f6c-zbqvl"
Jul 15 13:48:19.764052 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:48:19.764014    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-954f0f75-serving-cert: secret "maas-api-e2e-mt-954f0f75-serving-cert" not found
Jul 15 13:48:19.764123 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:48:19.764092    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0159424a-8d8c-4457-8f05-8105031902e1-maas-api-tls podName:0159424a-8d8c-4457-8f05-8105031902e1 nodeName:}" failed. No retries permitted until 2026-07-15 13:48:20.264071153 +0000 UTC m=+2220.351858086 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0159424a-8d8c-4457-8f05-8105031902e1-maas-api-tls") pod "maas-api-e2e-mt-954f0f75-66f44b6f6c-zbqvl" (UID: "0159424a-8d8c-4457-8f05-8105031902e1") : secret "maas-api-e2e-mt-954f0f75-serving-cert" not found
Jul 15 13:48:19.764595 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:48:19.764577    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0159424a-8d8c-4457-8f05-8105031902e1-openshift-service-ca\") pod \"maas-api-e2e-mt-954f0f75-66f44b6f6c-zbqvl\" (UID: \"0159424a-8d8c-4457-8f05-8105031902e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-954f0f75-66f44b6f6c-zbqvl"
Jul 15 13:48:19.775419 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:48:19.775398    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5fxx\" (UniqueName: \"kubernetes.io/projected/0159424a-8d8c-4457-8f05-8105031902e1-kube-api-access-f5fxx\") pod \"maas-api-e2e-mt-954f0f75-66f44b6f6c-zbqvl\" (UID: \"0159424a-8d8c-4457-8f05-8105031902e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-954f0f75-66f44b6f6c-zbqvl"
Jul 15 13:48:20.268326 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:48:20.268290    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0159424a-8d8c-4457-8f05-8105031902e1-maas-api-tls\") pod \"maas-api-e2e-mt-954f0f75-66f44b6f6c-zbqvl\" (UID: \"0159424a-8d8c-4457-8f05-8105031902e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-954f0f75-66f44b6f6c-zbqvl"
Jul 15 13:48:20.270775 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:48:20.270752    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0159424a-8d8c-4457-8f05-8105031902e1-maas-api-tls\") pod \"maas-api-e2e-mt-954f0f75-66f44b6f6c-zbqvl\" (UID: \"0159424a-8d8c-4457-8f05-8105031902e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-954f0f75-66f44b6f6c-zbqvl"
Jul 15 13:48:20.512125 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:48:20.512094    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-swdqt\""
Jul 15 13:48:20.520481 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:48:20.520461    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-954f0f75-66f44b6f6c-zbqvl"
Jul 15 13:48:20.653706 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:48:20.653677    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-954f0f75-66f44b6f6c-zbqvl"]
Jul 15 13:48:20.655218 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:48:20.655170    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0159424a_8d8c_4457_8f05_8105031902e1.slice/crio-496ee5d640ca6316f5686441ebc4ccd5418b587b4c1a8ee526816f56eaf02e6c WatchSource:0}: Error finding container 496ee5d640ca6316f5686441ebc4ccd5418b587b4c1a8ee526816f56eaf02e6c: Status 404 returned error can't find the container with id 496ee5d640ca6316f5686441ebc4ccd5418b587b4c1a8ee526816f56eaf02e6c
Jul 15 13:48:21.003062 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:48:21.003026    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-954f0f75-66f44b6f6c-zbqvl" event={"ID":"0159424a-8d8c-4457-8f05-8105031902e1","Type":"ContainerStarted","Data":"496ee5d640ca6316f5686441ebc4ccd5418b587b4c1a8ee526816f56eaf02e6c"}
Jul 15 13:48:22.010156 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:48:22.010115    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-954f0f75-66f44b6f6c-zbqvl" event={"ID":"0159424a-8d8c-4457-8f05-8105031902e1","Type":"ContainerStarted","Data":"6a7b0947a6ece6dbdce2852567dd05ff605cc3a4e8a15b75635a5e1277156ed4"}
Jul 15 13:48:22.010556 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:48:22.010251    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-954f0f75-66f44b6f6c-zbqvl"
Jul 15 13:48:22.028899 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:48:22.028849    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-954f0f75-66f44b6f6c-zbqvl" podStartSLOduration=2.535255608 podStartE2EDuration="3.028834276s" totalImagesPullingTime="493.578668ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:48:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:48:22.027342012 +0000 UTC m=+2222.115128955" watchObservedRunningTime="2026-07-15 13:48:22.028834276 +0000 UTC m=+2222.116621217"
Jul 15 13:48:28.020930 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:48:28.020902    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-954f0f75-66f44b6f6c-zbqvl"
Jul 15 13:49:12.846869 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:49:12.846775    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-954f0f75-66f44b6f6c-zbqvl"]
Jul 15 13:49:12.847494 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:49:12.846997    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-954f0f75-66f44b6f6c-zbqvl" podUID="0159424a-8d8c-4457-8f05-8105031902e1" containerName="maas-api" containerID="cri-o://6a7b0947a6ece6dbdce2852567dd05ff605cc3a4e8a15b75635a5e1277156ed4" gracePeriod=30
Jul 15 13:49:13.092801 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:49:13.092774    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-954f0f75-66f44b6f6c-zbqvl"
Jul 15 13:49:13.108176 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:49:13.108118    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f5fxx\" (UniqueName: \"kubernetes.io/projected/0159424a-8d8c-4457-8f05-8105031902e1-kube-api-access-f5fxx\") pod \"0159424a-8d8c-4457-8f05-8105031902e1\" (UID: \"0159424a-8d8c-4457-8f05-8105031902e1\") "
Jul 15 13:49:13.108176 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:49:13.108147    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0159424a-8d8c-4457-8f05-8105031902e1-maas-api-tls\") pod \"0159424a-8d8c-4457-8f05-8105031902e1\" (UID: \"0159424a-8d8c-4457-8f05-8105031902e1\") "
Jul 15 13:49:13.108375 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:49:13.108283    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0159424a-8d8c-4457-8f05-8105031902e1-openshift-service-ca\") pod \"0159424a-8d8c-4457-8f05-8105031902e1\" (UID: \"0159424a-8d8c-4457-8f05-8105031902e1\") "
Jul 15 13:49:13.108604 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:49:13.108581    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0159424a-8d8c-4457-8f05-8105031902e1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0159424a-8d8c-4457-8f05-8105031902e1" (UID: "0159424a-8d8c-4457-8f05-8105031902e1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:49:13.110142 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:49:13.110122    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0159424a-8d8c-4457-8f05-8105031902e1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0159424a-8d8c-4457-8f05-8105031902e1" (UID: "0159424a-8d8c-4457-8f05-8105031902e1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:49:13.110278 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:49:13.110159    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0159424a-8d8c-4457-8f05-8105031902e1-kube-api-access-f5fxx" (OuterVolumeSpecName: "kube-api-access-f5fxx") pod "0159424a-8d8c-4457-8f05-8105031902e1" (UID: "0159424a-8d8c-4457-8f05-8105031902e1"). InnerVolumeSpecName "kube-api-access-f5fxx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:49:13.209064 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:49:13.209028    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0159424a-8d8c-4457-8f05-8105031902e1-openshift-service-ca\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:49:13.209064 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:49:13.209060    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5fxx\" (UniqueName: \"kubernetes.io/projected/0159424a-8d8c-4457-8f05-8105031902e1-kube-api-access-f5fxx\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:49:13.209064 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:49:13.209072    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0159424a-8d8c-4457-8f05-8105031902e1-maas-api-tls\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:49:13.283631 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:49:13.283599    2578 generic.go:356] "Generic (PLEG): container finished" podID="0159424a-8d8c-4457-8f05-8105031902e1" containerID="6a7b0947a6ece6dbdce2852567dd05ff605cc3a4e8a15b75635a5e1277156ed4" exitCode=0
Jul 15 13:49:13.283795 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:49:13.283651    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-954f0f75-66f44b6f6c-zbqvl"
Jul 15 13:49:13.283795 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:49:13.283686    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-954f0f75-66f44b6f6c-zbqvl" event={"ID":"0159424a-8d8c-4457-8f05-8105031902e1","Type":"ContainerDied","Data":"6a7b0947a6ece6dbdce2852567dd05ff605cc3a4e8a15b75635a5e1277156ed4"}
Jul 15 13:49:13.283795 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:49:13.283741    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-954f0f75-66f44b6f6c-zbqvl" event={"ID":"0159424a-8d8c-4457-8f05-8105031902e1","Type":"ContainerDied","Data":"496ee5d640ca6316f5686441ebc4ccd5418b587b4c1a8ee526816f56eaf02e6c"}
Jul 15 13:49:13.283795 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:49:13.283762    2578 scope.go:117] "RemoveContainer" containerID="6a7b0947a6ece6dbdce2852567dd05ff605cc3a4e8a15b75635a5e1277156ed4"
Jul 15 13:49:13.293852 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:49:13.293838    2578 scope.go:117] "RemoveContainer" containerID="6a7b0947a6ece6dbdce2852567dd05ff605cc3a4e8a15b75635a5e1277156ed4"
Jul 15 13:49:13.294120 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:49:13.294100    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a7b0947a6ece6dbdce2852567dd05ff605cc3a4e8a15b75635a5e1277156ed4\": container with ID starting with 6a7b0947a6ece6dbdce2852567dd05ff605cc3a4e8a15b75635a5e1277156ed4 not found: ID does not exist" containerID="6a7b0947a6ece6dbdce2852567dd05ff605cc3a4e8a15b75635a5e1277156ed4"
Jul 15 13:49:13.294173 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:49:13.294129    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a7b0947a6ece6dbdce2852567dd05ff605cc3a4e8a15b75635a5e1277156ed4"} err="failed to get container status \"6a7b0947a6ece6dbdce2852567dd05ff605cc3a4e8a15b75635a5e1277156ed4\": rpc error: code = NotFound desc = could not find container \"6a7b0947a6ece6dbdce2852567dd05ff605cc3a4e8a15b75635a5e1277156ed4\": container with ID starting with 6a7b0947a6ece6dbdce2852567dd05ff605cc3a4e8a15b75635a5e1277156ed4 not found: ID does not exist"
Jul 15 13:49:13.307625 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:49:13.307603    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-954f0f75-66f44b6f6c-zbqvl"]
Jul 15 13:49:13.311346 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:49:13.311326    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-954f0f75-66f44b6f6c-zbqvl"]
Jul 15 13:49:14.375023 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:49:14.374987    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0159424a-8d8c-4457-8f05-8105031902e1" path="/var/lib/kubelet/pods/0159424a-8d8c-4457-8f05-8105031902e1/volumes"
Jul 15 13:49:16.017264 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:49:16.017217    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-mt-954f0f75-66f44b6f6c-zbqvl" podUID="0159424a-8d8c-4457-8f05-8105031902e1" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.51:8443/health\": context deadline exceeded"
Jul 15 13:51:08.518831 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:51:08.518791    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d22f29-69fb8f4bc6-2bswd"]
Jul 15 13:51:08.519376 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:51:08.519354    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0159424a-8d8c-4457-8f05-8105031902e1" containerName="maas-api"
Jul 15 13:51:08.519432 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:51:08.519380    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0159424a-8d8c-4457-8f05-8105031902e1" containerName="maas-api"
Jul 15 13:51:08.519500 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:51:08.519488    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0159424a-8d8c-4457-8f05-8105031902e1" containerName="maas-api"
Jul 15 13:51:08.522918 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:51:08.522898    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d22f29-69fb8f4bc6-2bswd"
Jul 15 13:51:08.526163 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:51:08.526146    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-d22f29-serving-cert\""
Jul 15 13:51:08.526295 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:51:08.526194    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-swdqt\""
Jul 15 13:51:08.539622 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:51:08.539598    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d22f29-69fb8f4bc6-2bswd"]
Jul 15 13:51:08.605342 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:51:08.605316    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8dceb1b-d3b1-482c-b9ad-960169ba2acc-maas-api-tls\") pod \"maas-api-e2e-inf-a-d22f29-69fb8f4bc6-2bswd\" (UID: \"e8dceb1b-d3b1-482c-b9ad-960169ba2acc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d22f29-69fb8f4bc6-2bswd"
Jul 15 13:51:08.605488 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:51:08.605350    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8dceb1b-d3b1-482c-b9ad-960169ba2acc-openshift-service-ca\") pod \"maas-api-e2e-inf-a-d22f29-69fb8f4bc6-2bswd\" (UID: \"e8dceb1b-d3b1-482c-b9ad-960169ba2acc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d22f29-69fb8f4bc6-2bswd"
Jul 15 13:51:08.605488 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:51:08.605377    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2lpg\" (UniqueName: \"kubernetes.io/projected/e8dceb1b-d3b1-482c-b9ad-960169ba2acc-kube-api-access-m2lpg\") pod \"maas-api-e2e-inf-a-d22f29-69fb8f4bc6-2bswd\" (UID: \"e8dceb1b-d3b1-482c-b9ad-960169ba2acc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d22f29-69fb8f4bc6-2bswd"
Jul 15 13:51:08.706761 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:51:08.706730    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8dceb1b-d3b1-482c-b9ad-960169ba2acc-maas-api-tls\") pod \"maas-api-e2e-inf-a-d22f29-69fb8f4bc6-2bswd\" (UID: \"e8dceb1b-d3b1-482c-b9ad-960169ba2acc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d22f29-69fb8f4bc6-2bswd"
Jul 15 13:51:08.706761 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:51:08.706765    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8dceb1b-d3b1-482c-b9ad-960169ba2acc-openshift-service-ca\") pod \"maas-api-e2e-inf-a-d22f29-69fb8f4bc6-2bswd\" (UID: \"e8dceb1b-d3b1-482c-b9ad-960169ba2acc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d22f29-69fb8f4bc6-2bswd"
Jul 15 13:51:08.706999 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:51:08.706790    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2lpg\" (UniqueName: \"kubernetes.io/projected/e8dceb1b-d3b1-482c-b9ad-960169ba2acc-kube-api-access-m2lpg\") pod \"maas-api-e2e-inf-a-d22f29-69fb8f4bc6-2bswd\" (UID: \"e8dceb1b-d3b1-482c-b9ad-960169ba2acc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d22f29-69fb8f4bc6-2bswd"
Jul 15 13:51:08.706999 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:51:08.706893    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-d22f29-serving-cert: secret "maas-api-e2e-inf-a-d22f29-serving-cert" not found
Jul 15 13:51:08.706999 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:51:08.706980    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8dceb1b-d3b1-482c-b9ad-960169ba2acc-maas-api-tls podName:e8dceb1b-d3b1-482c-b9ad-960169ba2acc nodeName:}" failed. No retries permitted until 2026-07-15 13:51:09.206959729 +0000 UTC m=+2389.294746657 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e8dceb1b-d3b1-482c-b9ad-960169ba2acc-maas-api-tls") pod "maas-api-e2e-inf-a-d22f29-69fb8f4bc6-2bswd" (UID: "e8dceb1b-d3b1-482c-b9ad-960169ba2acc") : secret "maas-api-e2e-inf-a-d22f29-serving-cert" not found
Jul 15 13:51:08.707499 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:51:08.707479    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8dceb1b-d3b1-482c-b9ad-960169ba2acc-openshift-service-ca\") pod \"maas-api-e2e-inf-a-d22f29-69fb8f4bc6-2bswd\" (UID: \"e8dceb1b-d3b1-482c-b9ad-960169ba2acc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d22f29-69fb8f4bc6-2bswd"
Jul 15 13:51:08.719841 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:51:08.719816    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2lpg\" (UniqueName: \"kubernetes.io/projected/e8dceb1b-d3b1-482c-b9ad-960169ba2acc-kube-api-access-m2lpg\") pod \"maas-api-e2e-inf-a-d22f29-69fb8f4bc6-2bswd\" (UID: \"e8dceb1b-d3b1-482c-b9ad-960169ba2acc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d22f29-69fb8f4bc6-2bswd"
Jul 15 13:51:09.210836 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:51:09.210796    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8dceb1b-d3b1-482c-b9ad-960169ba2acc-maas-api-tls\") pod \"maas-api-e2e-inf-a-d22f29-69fb8f4bc6-2bswd\" (UID: \"e8dceb1b-d3b1-482c-b9ad-960169ba2acc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d22f29-69fb8f4bc6-2bswd"
Jul 15 13:51:09.213266 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:51:09.213241    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8dceb1b-d3b1-482c-b9ad-960169ba2acc-maas-api-tls\") pod \"maas-api-e2e-inf-a-d22f29-69fb8f4bc6-2bswd\" (UID: \"e8dceb1b-d3b1-482c-b9ad-960169ba2acc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d22f29-69fb8f4bc6-2bswd"
Jul 15 13:51:09.432406 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:51:09.432371    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d22f29-69fb8f4bc6-2bswd"
Jul 15 13:51:09.576395 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:51:09.576368    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d22f29-69fb8f4bc6-2bswd"]
Jul 15 13:51:09.580612 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:51:09.580583    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8dceb1b_d3b1_482c_b9ad_960169ba2acc.slice/crio-3b2458ace861cf6eb832419b2686ecb5d82a86209a5f06864d9f975cc3f62888 WatchSource:0}: Error finding container 3b2458ace861cf6eb832419b2686ecb5d82a86209a5f06864d9f975cc3f62888: Status 404 returned error can't find the container with id 3b2458ace861cf6eb832419b2686ecb5d82a86209a5f06864d9f975cc3f62888
Jul 15 13:51:09.889631 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:51:09.889553    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d22f29-69fb8f4bc6-2bswd" event={"ID":"e8dceb1b-d3b1-482c-b9ad-960169ba2acc","Type":"ContainerStarted","Data":"3b2458ace861cf6eb832419b2686ecb5d82a86209a5f06864d9f975cc3f62888"}
Jul 15 13:51:10.896468 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:51:10.896425    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d22f29-69fb8f4bc6-2bswd" event={"ID":"e8dceb1b-d3b1-482c-b9ad-960169ba2acc","Type":"ContainerStarted","Data":"b5219f45ac33b400c7e815fe1192cfcd68d8834c308360f23972c11684461256"}
Jul 15 13:51:10.896816 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:51:10.896483    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d22f29-69fb8f4bc6-2bswd"
Jul 15 13:51:10.917087 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:51:10.917042    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d22f29-69fb8f4bc6-2bswd" podStartSLOduration=1.724140988 podStartE2EDuration="2.917028043s" totalImagesPullingTime="1.192887055s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:51:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:51:10.914896939 +0000 UTC m=+2391.002683887" watchObservedRunningTime="2026-07-15 13:51:10.917028043 +0000 UTC m=+2391.004814985"
Jul 15 13:51:16.416663 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:51:16.416626    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-114e4a-cf9c45fd6-5x4cx"]
Jul 15 13:51:16.420468 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:51:16.420445    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-114e4a-cf9c45fd6-5x4cx"
Jul 15 13:51:16.424772 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:51:16.424751    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-114e4a-serving-cert\""
Jul 15 13:51:16.433798 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:51:16.433776    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-114e4a-cf9c45fd6-5x4cx"]
Jul 15 13:51:16.474606 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:51:16.474577    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a3e5f25-274a-44de-8fb3-5d455e2dce66-maas-api-tls\") pod \"maas-api-e2e-inf-b-114e4a-cf9c45fd6-5x4cx\" (UID: \"3a3e5f25-274a-44de-8fb3-5d455e2dce66\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-114e4a-cf9c45fd6-5x4cx"
Jul 15 13:51:16.474738 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:51:16.474718    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a3e5f25-274a-44de-8fb3-5d455e2dce66-openshift-service-ca\") pod \"maas-api-e2e-inf-b-114e4a-cf9c45fd6-5x4cx\" (UID: \"3a3e5f25-274a-44de-8fb3-5d455e2dce66\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-114e4a-cf9c45fd6-5x4cx"
Jul 15 13:51:16.474782 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:51:16.474747    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvrhf\" (UniqueName: \"kubernetes.io/projected/3a3e5f25-274a-44de-8fb3-5d455e2dce66-kube-api-access-pvrhf\") pod \"maas-api-e2e-inf-b-114e4a-cf9c45fd6-5x4cx\" (UID: \"3a3e5f25-274a-44de-8fb3-5d455e2dce66\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-114e4a-cf9c45fd6-5x4cx"
Jul 15 13:51:16.575865 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:51:16.575833    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a3e5f25-274a-44de-8fb3-5d455e2dce66-maas-api-tls\") pod \"maas-api-e2e-inf-b-114e4a-cf9c45fd6-5x4cx\" (UID: \"3a3e5f25-274a-44de-8fb3-5d455e2dce66\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-114e4a-cf9c45fd6-5x4cx"
Jul 15 13:51:16.576023 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:51:16.575914    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a3e5f25-274a-44de-8fb3-5d455e2dce66-openshift-service-ca\") pod \"maas-api-e2e-inf-b-114e4a-cf9c45fd6-5x4cx\" (UID: \"3a3e5f25-274a-44de-8fb3-5d455e2dce66\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-114e4a-cf9c45fd6-5x4cx"
Jul 15 13:51:16.576023 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:51:16.575933    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvrhf\" (UniqueName: \"kubernetes.io/projected/3a3e5f25-274a-44de-8fb3-5d455e2dce66-kube-api-access-pvrhf\") pod \"maas-api-e2e-inf-b-114e4a-cf9c45fd6-5x4cx\" (UID: \"3a3e5f25-274a-44de-8fb3-5d455e2dce66\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-114e4a-cf9c45fd6-5x4cx"
Jul 15 13:51:16.576023 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:51:16.575991    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-114e4a-serving-cert: secret "maas-api-e2e-inf-b-114e4a-serving-cert" not found
Jul 15 13:51:16.576225 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:51:16.576067    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a3e5f25-274a-44de-8fb3-5d455e2dce66-maas-api-tls podName:3a3e5f25-274a-44de-8fb3-5d455e2dce66 nodeName:}" failed. No retries permitted until 2026-07-15 13:51:17.07604614 +0000 UTC m=+2397.163833064 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3a3e5f25-274a-44de-8fb3-5d455e2dce66-maas-api-tls") pod "maas-api-e2e-inf-b-114e4a-cf9c45fd6-5x4cx" (UID: "3a3e5f25-274a-44de-8fb3-5d455e2dce66") : secret "maas-api-e2e-inf-b-114e4a-serving-cert" not found
Jul 15 13:51:16.576562 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:51:16.576542    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a3e5f25-274a-44de-8fb3-5d455e2dce66-openshift-service-ca\") pod \"maas-api-e2e-inf-b-114e4a-cf9c45fd6-5x4cx\" (UID: \"3a3e5f25-274a-44de-8fb3-5d455e2dce66\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-114e4a-cf9c45fd6-5x4cx"
Jul 15 13:51:16.587513 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:51:16.587487    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvrhf\" (UniqueName: \"kubernetes.io/projected/3a3e5f25-274a-44de-8fb3-5d455e2dce66-kube-api-access-pvrhf\") pod \"maas-api-e2e-inf-b-114e4a-cf9c45fd6-5x4cx\" (UID: \"3a3e5f25-274a-44de-8fb3-5d455e2dce66\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-114e4a-cf9c45fd6-5x4cx"
Jul 15 13:51:16.908099 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:51:16.908070    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d22f29-69fb8f4bc6-2bswd"
Jul 15 13:51:17.081140 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:51:17.081108    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a3e5f25-274a-44de-8fb3-5d455e2dce66-maas-api-tls\") pod \"maas-api-e2e-inf-b-114e4a-cf9c45fd6-5x4cx\" (UID: \"3a3e5f25-274a-44de-8fb3-5d455e2dce66\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-114e4a-cf9c45fd6-5x4cx"
Jul 15 13:51:17.083492 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:51:17.083462    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a3e5f25-274a-44de-8fb3-5d455e2dce66-maas-api-tls\") pod \"maas-api-e2e-inf-b-114e4a-cf9c45fd6-5x4cx\" (UID: \"3a3e5f25-274a-44de-8fb3-5d455e2dce66\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-114e4a-cf9c45fd6-5x4cx"
Jul 15 13:51:17.331429 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:51:17.331395    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-114e4a-cf9c45fd6-5x4cx"
Jul 15 13:51:17.466616 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:51:17.466591    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-114e4a-cf9c45fd6-5x4cx"]
Jul 15 13:51:17.468387 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:51:17.468351    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a3e5f25_274a_44de_8fb3_5d455e2dce66.slice/crio-75dd8b880fe9f37d735a940b09a7677f0de75ca8d22af430773e9c7fa7701b62 WatchSource:0}: Error finding container 75dd8b880fe9f37d735a940b09a7677f0de75ca8d22af430773e9c7fa7701b62: Status 404 returned error can't find the container with id 75dd8b880fe9f37d735a940b09a7677f0de75ca8d22af430773e9c7fa7701b62
Jul 15 13:51:17.939601 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:51:17.938718    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-114e4a-cf9c45fd6-5x4cx" event={"ID":"3a3e5f25-274a-44de-8fb3-5d455e2dce66","Type":"ContainerStarted","Data":"75dd8b880fe9f37d735a940b09a7677f0de75ca8d22af430773e9c7fa7701b62"}
Jul 15 13:51:18.945423 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:51:18.945378    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-114e4a-cf9c45fd6-5x4cx" event={"ID":"3a3e5f25-274a-44de-8fb3-5d455e2dce66","Type":"ContainerStarted","Data":"60fc4ceac70efb61f6564509fa63319e0825745508f795b74ed3f101efd6ba88"}
Jul 15 13:51:18.945887 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:51:18.945462    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-114e4a-cf9c45fd6-5x4cx"
Jul 15 13:51:18.964172 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:51:18.964129    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-114e4a-cf9c45fd6-5x4cx" podStartSLOduration=2.548451816 podStartE2EDuration="2.964115169s" totalImagesPullingTime="415.663353ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:51:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:51:18.962754923 +0000 UTC m=+2399.050541865" watchObservedRunningTime="2026-07-15 13:51:18.964115169 +0000 UTC m=+2399.051902111"
Jul 15 13:51:20.507230 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:51:20.507190    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-t4bfh_c21b11d6-3242-4dd5-8b75-74dad14868e9/console-operator/1.log"
Jul 15 13:51:20.511459 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:51:20.511436    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt6q4_49ca8630-3cc0-4dbb-8c80-a948ad0de2b4/ovn-acl-logging/0.log"
Jul 15 13:51:20.513679 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:51:20.513658    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-t4bfh_c21b11d6-3242-4dd5-8b75-74dad14868e9/console-operator/1.log"
Jul 15 13:51:20.517781 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:51:20.517760    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt6q4_49ca8630-3cc0-4dbb-8c80-a948ad0de2b4/ovn-acl-logging/0.log"
Jul 15 13:51:24.956987 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:51:24.956957    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-114e4a-cf9c45fd6-5x4cx"
Jul 15 13:52:02.903024 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:02.902930    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-114e4a/test-model-114e4a-kserve-66659669cc-76xp6"]
Jul 15 13:52:02.907054 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:02.907030    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-114e4a/test-model-114e4a-kserve-66659669cc-76xp6"
Jul 15 13:52:02.910018 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:02.909997    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-114e4a\"/\"kube-root-ca.crt\""
Jul 15 13:52:02.911327 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:02.911303    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-114e4a\"/\"openshift-service-ca.crt\""
Jul 15 13:52:02.911445 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:02.911316    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-114e4a\"/\"test-model-114e4a-kserve-self-signed-certs\""
Jul 15 13:52:02.911512 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:02.911320    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-114e4a\"/\"default-dockercfg-p8z42\""
Jul 15 13:52:02.914642 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:02.914443    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-114e4a/test-model-114e4a-kserve-66659669cc-76xp6"]
Jul 15 13:52:02.977279 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:02.977234    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c-model-cache\") pod \"test-model-114e4a-kserve-66659669cc-76xp6\" (UID: \"6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c\") " pod="ai-tenant-e2e-inf-b-114e4a/test-model-114e4a-kserve-66659669cc-76xp6"
Jul 15 13:52:02.977445 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:02.977298    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c-home\") pod \"test-model-114e4a-kserve-66659669cc-76xp6\" (UID: \"6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c\") " pod="ai-tenant-e2e-inf-b-114e4a/test-model-114e4a-kserve-66659669cc-76xp6"
Jul 15 13:52:02.977445 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:02.977338    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c-tmp-dir\") pod \"test-model-114e4a-kserve-66659669cc-76xp6\" (UID: \"6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c\") " pod="ai-tenant-e2e-inf-b-114e4a/test-model-114e4a-kserve-66659669cc-76xp6"
Jul 15 13:52:02.977445 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:02.977355    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c-dshm\") pod \"test-model-114e4a-kserve-66659669cc-76xp6\" (UID: \"6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c\") " pod="ai-tenant-e2e-inf-b-114e4a/test-model-114e4a-kserve-66659669cc-76xp6"
Jul 15 13:52:02.977445 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:02.977374    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnngh\" (UniqueName: \"kubernetes.io/projected/6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c-kube-api-access-bnngh\") pod \"test-model-114e4a-kserve-66659669cc-76xp6\" (UID: \"6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c\") " pod="ai-tenant-e2e-inf-b-114e4a/test-model-114e4a-kserve-66659669cc-76xp6"
Jul 15 13:52:02.977445 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:02.977428    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c-tls-certs\") pod \"test-model-114e4a-kserve-66659669cc-76xp6\" (UID: \"6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c\") " pod="ai-tenant-e2e-inf-b-114e4a/test-model-114e4a-kserve-66659669cc-76xp6"
Jul 15 13:52:03.078322 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:03.078289    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c-model-cache\") pod \"test-model-114e4a-kserve-66659669cc-76xp6\" (UID: \"6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c\") " pod="ai-tenant-e2e-inf-b-114e4a/test-model-114e4a-kserve-66659669cc-76xp6"
Jul 15 13:52:03.078513 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:03.078331    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c-home\") pod \"test-model-114e4a-kserve-66659669cc-76xp6\" (UID: \"6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c\") " pod="ai-tenant-e2e-inf-b-114e4a/test-model-114e4a-kserve-66659669cc-76xp6"
Jul 15 13:52:03.078513 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:03.078367    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c-tmp-dir\") pod \"test-model-114e4a-kserve-66659669cc-76xp6\" (UID: \"6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c\") " pod="ai-tenant-e2e-inf-b-114e4a/test-model-114e4a-kserve-66659669cc-76xp6"
Jul 15 13:52:03.078513 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:03.078382    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c-dshm\") pod \"test-model-114e4a-kserve-66659669cc-76xp6\" (UID: \"6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c\") " pod="ai-tenant-e2e-inf-b-114e4a/test-model-114e4a-kserve-66659669cc-76xp6"
Jul 15 13:52:03.078513 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:03.078398    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnngh\" (UniqueName: \"kubernetes.io/projected/6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c-kube-api-access-bnngh\") pod \"test-model-114e4a-kserve-66659669cc-76xp6\" (UID: \"6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c\") " pod="ai-tenant-e2e-inf-b-114e4a/test-model-114e4a-kserve-66659669cc-76xp6"
Jul 15 13:52:03.078513 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:03.078444    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c-tls-certs\") pod \"test-model-114e4a-kserve-66659669cc-76xp6\" (UID: \"6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c\") " pod="ai-tenant-e2e-inf-b-114e4a/test-model-114e4a-kserve-66659669cc-76xp6"
Jul 15 13:52:03.078787 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:03.078763    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c-model-cache\") pod \"test-model-114e4a-kserve-66659669cc-76xp6\" (UID: \"6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c\") " pod="ai-tenant-e2e-inf-b-114e4a/test-model-114e4a-kserve-66659669cc-76xp6"
Jul 15 13:52:03.078835 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:03.078776    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c-tmp-dir\") pod \"test-model-114e4a-kserve-66659669cc-76xp6\" (UID: \"6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c\") " pod="ai-tenant-e2e-inf-b-114e4a/test-model-114e4a-kserve-66659669cc-76xp6"
Jul 15 13:52:03.078835 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:03.078820    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c-home\") pod \"test-model-114e4a-kserve-66659669cc-76xp6\" (UID: \"6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c\") " pod="ai-tenant-e2e-inf-b-114e4a/test-model-114e4a-kserve-66659669cc-76xp6"
Jul 15 13:52:03.080776 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:03.080755    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c-dshm\") pod \"test-model-114e4a-kserve-66659669cc-76xp6\" (UID: \"6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c\") " pod="ai-tenant-e2e-inf-b-114e4a/test-model-114e4a-kserve-66659669cc-76xp6"
Jul 15 13:52:03.080917 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:03.080900    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c-tls-certs\") pod \"test-model-114e4a-kserve-66659669cc-76xp6\" (UID: \"6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c\") " pod="ai-tenant-e2e-inf-b-114e4a/test-model-114e4a-kserve-66659669cc-76xp6"
Jul 15 13:52:03.087034 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:03.087007    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnngh\" (UniqueName: \"kubernetes.io/projected/6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c-kube-api-access-bnngh\") pod \"test-model-114e4a-kserve-66659669cc-76xp6\" (UID: \"6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c\") " pod="ai-tenant-e2e-inf-b-114e4a/test-model-114e4a-kserve-66659669cc-76xp6"
Jul 15 13:52:03.217938 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:03.217915    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-114e4a/test-model-114e4a-kserve-66659669cc-76xp6"
Jul 15 13:52:03.355086 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:03.355060    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-114e4a/test-model-114e4a-kserve-66659669cc-76xp6"]
Jul 15 13:52:03.356553 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:52:03.356521    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6d7efca6_aedb_4e23_8b1a_3f7f9d22ed7c.slice/crio-8b468352c3a9ae6293802390378fdc557335e559293cfd4f1f12f5346418ec20 WatchSource:0}: Error finding container 8b468352c3a9ae6293802390378fdc557335e559293cfd4f1f12f5346418ec20: Status 404 returned error can't find the container with id 8b468352c3a9ae6293802390378fdc557335e559293cfd4f1f12f5346418ec20
Jul 15 13:52:04.187782 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:04.187749    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-114e4a/test-model-114e4a-kserve-66659669cc-76xp6" event={"ID":"6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c","Type":"ContainerStarted","Data":"8f882eaa0470b00e1d1ae0e457874691242411fad46eaf033e3c559d09592123"}
Jul 15 13:52:04.188169 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:04.187790    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-114e4a/test-model-114e4a-kserve-66659669cc-76xp6" event={"ID":"6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c","Type":"ContainerStarted","Data":"8b468352c3a9ae6293802390378fdc557335e559293cfd4f1f12f5346418ec20"}
Jul 15 13:52:04.212214 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:04.212154    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-114e4a/test-model-114e4a-kserve-66659669cc-76xp6" podStartSLOduration=2.212140494 podStartE2EDuration="2.212140494s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:52:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:52:04.209482044 +0000 UTC m=+2444.297268987" watchObservedRunningTime="2026-07-15 13:52:04.212140494 +0000 UTC m=+2444.299927435"
Jul 15 13:52:13.219052 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:13.219012    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-114e4a/test-model-114e4a-kserve-66659669cc-76xp6"
Jul 15 13:52:13.219609 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:13.219065    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-114e4a/test-model-114e4a-kserve-66659669cc-76xp6"
Jul 15 13:52:13.231816 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:13.231792    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-114e4a/test-model-114e4a-kserve-66659669cc-76xp6"
Jul 15 13:52:13.251288 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:13.251262    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-114e4a/test-model-114e4a-kserve-66659669cc-76xp6"
Jul 15 13:52:20.331140 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:20.331109    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-114e4a/test-model-114e4a-kserve-66659669cc-76xp6"]
Jul 15 13:52:31.195469 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:31.195435    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d22f29-69fb8f4bc6-2bswd"]
Jul 15 13:52:31.195926 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:31.195730    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d22f29-69fb8f4bc6-2bswd" podUID="e8dceb1b-d3b1-482c-b9ad-960169ba2acc" containerName="maas-api" containerID="cri-o://b5219f45ac33b400c7e815fe1192cfcd68d8834c308360f23972c11684461256" gracePeriod=30
Jul 15 13:52:31.641658 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:31.641624    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d22f29-69fb8f4bc6-2bswd"
Jul 15 13:52:31.733000 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:31.732921    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m2lpg\" (UniqueName: \"kubernetes.io/projected/e8dceb1b-d3b1-482c-b9ad-960169ba2acc-kube-api-access-m2lpg\") pod \"e8dceb1b-d3b1-482c-b9ad-960169ba2acc\" (UID: \"e8dceb1b-d3b1-482c-b9ad-960169ba2acc\") "
Jul 15 13:52:31.733000 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:31.732964    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8dceb1b-d3b1-482c-b9ad-960169ba2acc-openshift-service-ca\") pod \"e8dceb1b-d3b1-482c-b9ad-960169ba2acc\" (UID: \"e8dceb1b-d3b1-482c-b9ad-960169ba2acc\") "
Jul 15 13:52:31.733245 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:31.733050    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8dceb1b-d3b1-482c-b9ad-960169ba2acc-maas-api-tls\") pod \"e8dceb1b-d3b1-482c-b9ad-960169ba2acc\" (UID: \"e8dceb1b-d3b1-482c-b9ad-960169ba2acc\") "
Jul 15 13:52:31.733413 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:31.733386    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8dceb1b-d3b1-482c-b9ad-960169ba2acc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e8dceb1b-d3b1-482c-b9ad-960169ba2acc" (UID: "e8dceb1b-d3b1-482c-b9ad-960169ba2acc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:52:31.735024 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:31.734994    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8dceb1b-d3b1-482c-b9ad-960169ba2acc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e8dceb1b-d3b1-482c-b9ad-960169ba2acc" (UID: "e8dceb1b-d3b1-482c-b9ad-960169ba2acc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:52:31.735133 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:31.735065    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8dceb1b-d3b1-482c-b9ad-960169ba2acc-kube-api-access-m2lpg" (OuterVolumeSpecName: "kube-api-access-m2lpg") pod "e8dceb1b-d3b1-482c-b9ad-960169ba2acc" (UID: "e8dceb1b-d3b1-482c-b9ad-960169ba2acc"). InnerVolumeSpecName "kube-api-access-m2lpg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:52:31.834014 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:31.833984    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8dceb1b-d3b1-482c-b9ad-960169ba2acc-maas-api-tls\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:52:31.834014 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:31.834012    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2lpg\" (UniqueName: \"kubernetes.io/projected/e8dceb1b-d3b1-482c-b9ad-960169ba2acc-kube-api-access-m2lpg\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:52:31.834174 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:31.834022    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8dceb1b-d3b1-482c-b9ad-960169ba2acc-openshift-service-ca\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:52:32.344156 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:32.344122    2578 generic.go:356] "Generic (PLEG): container finished" podID="e8dceb1b-d3b1-482c-b9ad-960169ba2acc" containerID="b5219f45ac33b400c7e815fe1192cfcd68d8834c308360f23972c11684461256" exitCode=0
Jul 15 13:52:32.344624 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:32.344160    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d22f29-69fb8f4bc6-2bswd" event={"ID":"e8dceb1b-d3b1-482c-b9ad-960169ba2acc","Type":"ContainerDied","Data":"b5219f45ac33b400c7e815fe1192cfcd68d8834c308360f23972c11684461256"}
Jul 15 13:52:32.344624 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:32.344177    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d22f29-69fb8f4bc6-2bswd"
Jul 15 13:52:32.344624 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:32.344233    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d22f29-69fb8f4bc6-2bswd" event={"ID":"e8dceb1b-d3b1-482c-b9ad-960169ba2acc","Type":"ContainerDied","Data":"3b2458ace861cf6eb832419b2686ecb5d82a86209a5f06864d9f975cc3f62888"}
Jul 15 13:52:32.344624 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:32.344269    2578 scope.go:117] "RemoveContainer" containerID="b5219f45ac33b400c7e815fe1192cfcd68d8834c308360f23972c11684461256"
Jul 15 13:52:32.354136 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:32.354114    2578 scope.go:117] "RemoveContainer" containerID="b5219f45ac33b400c7e815fe1192cfcd68d8834c308360f23972c11684461256"
Jul 15 13:52:32.354415 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:52:32.354393    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5219f45ac33b400c7e815fe1192cfcd68d8834c308360f23972c11684461256\": container with ID starting with b5219f45ac33b400c7e815fe1192cfcd68d8834c308360f23972c11684461256 not found: ID does not exist" containerID="b5219f45ac33b400c7e815fe1192cfcd68d8834c308360f23972c11684461256"
Jul 15 13:52:32.354483 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:32.354425    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5219f45ac33b400c7e815fe1192cfcd68d8834c308360f23972c11684461256"} err="failed to get container status \"b5219f45ac33b400c7e815fe1192cfcd68d8834c308360f23972c11684461256\": rpc error: code = NotFound desc = could not find container \"b5219f45ac33b400c7e815fe1192cfcd68d8834c308360f23972c11684461256\": container with ID starting with b5219f45ac33b400c7e815fe1192cfcd68d8834c308360f23972c11684461256 not found: ID does not exist"
Jul 15 13:52:32.367143 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:32.367118    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d22f29-69fb8f4bc6-2bswd"]
Jul 15 13:52:32.374859 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:32.374841    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d22f29-69fb8f4bc6-2bswd"]
Jul 15 13:52:34.374813 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:34.374779    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8dceb1b-d3b1-482c-b9ad-960169ba2acc" path="/var/lib/kubelet/pods/e8dceb1b-d3b1-482c-b9ad-960169ba2acc/volumes"
Jul 15 13:52:35.351584 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:35.351544    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-114e4a/test-model-114e4a-kserve-66659669cc-76xp6" podUID="6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c" containerName="main" containerID="cri-o://8f882eaa0470b00e1d1ae0e457874691242411fad46eaf033e3c559d09592123" gracePeriod=45
Jul 15 13:52:35.597083 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:35.597053    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-114e4a/test-model-114e4a-kserve-66659669cc-76xp6"
Jul 15 13:52:35.669148 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:35.669075    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c-home\") pod \"6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c\" (UID: \"6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c\") "
Jul 15 13:52:35.669148 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:35.669117    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c-model-cache\") pod \"6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c\" (UID: \"6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c\") "
Jul 15 13:52:35.669148 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:35.669136    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bnngh\" (UniqueName: \"kubernetes.io/projected/6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c-kube-api-access-bnngh\") pod \"6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c\" (UID: \"6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c\") "
Jul 15 13:52:35.669410 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:35.669167    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c-tls-certs\") pod \"6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c\" (UID: \"6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c\") "
Jul 15 13:52:35.669410 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:35.669196    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c-dshm\") pod \"6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c\" (UID: \"6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c\") "
Jul 15 13:52:35.669410 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:35.669308    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c-tmp-dir\") pod \"6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c\" (UID: \"6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c\") "
Jul 15 13:52:35.669410 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:35.669391    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c-home" (OuterVolumeSpecName: "home") pod "6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c" (UID: "6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:52:35.669627 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:35.669398    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c-model-cache" (OuterVolumeSpecName: "model-cache") pod "6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c" (UID: "6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:52:35.669627 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:35.669587    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c" (UID: "6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:52:35.669714 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:35.669669    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c-home\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:52:35.669714 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:35.669689    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c-model-cache\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:52:35.671486 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:35.671461    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c" (UID: "6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:52:35.671486 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:35.671474    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c-kube-api-access-bnngh" (OuterVolumeSpecName: "kube-api-access-bnngh") pod "6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c" (UID: "6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c"). InnerVolumeSpecName "kube-api-access-bnngh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:52:35.671630 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:35.671543    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c-dshm" (OuterVolumeSpecName: "dshm") pod "6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c" (UID: "6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:52:35.770260 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:35.770222    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c-tls-certs\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:52:35.770260 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:35.770256    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c-dshm\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:52:35.770260 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:35.770265    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c-tmp-dir\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:52:35.770461 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:35.770274    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bnngh\" (UniqueName: \"kubernetes.io/projected/6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c-kube-api-access-bnngh\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:52:36.366663 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:36.366630    2578 generic.go:356] "Generic (PLEG): container finished" podID="6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c" containerID="8f882eaa0470b00e1d1ae0e457874691242411fad46eaf033e3c559d09592123" exitCode=0
Jul 15 13:52:36.366828 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:36.366671    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-114e4a/test-model-114e4a-kserve-66659669cc-76xp6"
Jul 15 13:52:36.366828 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:36.366711    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-114e4a/test-model-114e4a-kserve-66659669cc-76xp6" event={"ID":"6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c","Type":"ContainerDied","Data":"8f882eaa0470b00e1d1ae0e457874691242411fad46eaf033e3c559d09592123"}
Jul 15 13:52:36.366828 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:36.366759    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-114e4a/test-model-114e4a-kserve-66659669cc-76xp6" event={"ID":"6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c","Type":"ContainerDied","Data":"8b468352c3a9ae6293802390378fdc557335e559293cfd4f1f12f5346418ec20"}
Jul 15 13:52:36.366828 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:36.366779    2578 scope.go:117] "RemoveContainer" containerID="8f882eaa0470b00e1d1ae0e457874691242411fad46eaf033e3c559d09592123"
Jul 15 13:52:36.376156 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:36.376131    2578 scope.go:117] "RemoveContainer" containerID="8f882eaa0470b00e1d1ae0e457874691242411fad46eaf033e3c559d09592123"
Jul 15 13:52:36.377081 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:52:36.376901    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f882eaa0470b00e1d1ae0e457874691242411fad46eaf033e3c559d09592123\": container with ID starting with 8f882eaa0470b00e1d1ae0e457874691242411fad46eaf033e3c559d09592123 not found: ID does not exist" containerID="8f882eaa0470b00e1d1ae0e457874691242411fad46eaf033e3c559d09592123"
Jul 15 13:52:36.377254 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:36.377092    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f882eaa0470b00e1d1ae0e457874691242411fad46eaf033e3c559d09592123"} err="failed to get container status \"8f882eaa0470b00e1d1ae0e457874691242411fad46eaf033e3c559d09592123\": rpc error: code = NotFound desc = could not find container \"8f882eaa0470b00e1d1ae0e457874691242411fad46eaf033e3c559d09592123\": container with ID starting with 8f882eaa0470b00e1d1ae0e457874691242411fad46eaf033e3c559d09592123 not found: ID does not exist"
Jul 15 13:52:36.396943 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:36.396917    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-114e4a/test-model-114e4a-kserve-66659669cc-76xp6"]
Jul 15 13:52:36.398975 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:36.398956    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-114e4a/test-model-114e4a-kserve-66659669cc-76xp6"]
Jul 15 13:52:38.375994 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:38.375962    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c" path="/var/lib/kubelet/pods/6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c/volumes"
Jul 15 13:52:57.169786 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:57.169747    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-114e4a-cf9c45fd6-5x4cx"]
Jul 15 13:52:57.172760 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:57.170014    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-114e4a-cf9c45fd6-5x4cx" podUID="3a3e5f25-274a-44de-8fb3-5d455e2dce66" containerName="maas-api" containerID="cri-o://60fc4ceac70efb61f6564509fa63319e0825745508f795b74ed3f101efd6ba88" gracePeriod=30
Jul 15 13:52:57.619411 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:57.619387    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-114e4a-cf9c45fd6-5x4cx"
Jul 15 13:52:57.777581 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:57.777548    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a3e5f25-274a-44de-8fb3-5d455e2dce66-openshift-service-ca\") pod \"3a3e5f25-274a-44de-8fb3-5d455e2dce66\" (UID: \"3a3e5f25-274a-44de-8fb3-5d455e2dce66\") "
Jul 15 13:52:57.777749 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:57.777595    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a3e5f25-274a-44de-8fb3-5d455e2dce66-maas-api-tls\") pod \"3a3e5f25-274a-44de-8fb3-5d455e2dce66\" (UID: \"3a3e5f25-274a-44de-8fb3-5d455e2dce66\") "
Jul 15 13:52:57.777749 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:57.777654    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pvrhf\" (UniqueName: \"kubernetes.io/projected/3a3e5f25-274a-44de-8fb3-5d455e2dce66-kube-api-access-pvrhf\") pod \"3a3e5f25-274a-44de-8fb3-5d455e2dce66\" (UID: \"3a3e5f25-274a-44de-8fb3-5d455e2dce66\") "
Jul 15 13:52:57.778007 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:57.777967    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a3e5f25-274a-44de-8fb3-5d455e2dce66-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3a3e5f25-274a-44de-8fb3-5d455e2dce66" (UID: "3a3e5f25-274a-44de-8fb3-5d455e2dce66"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:52:57.779761 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:57.779736    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a3e5f25-274a-44de-8fb3-5d455e2dce66-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3a3e5f25-274a-44de-8fb3-5d455e2dce66" (UID: "3a3e5f25-274a-44de-8fb3-5d455e2dce66"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:52:57.779878 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:57.779735    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a3e5f25-274a-44de-8fb3-5d455e2dce66-kube-api-access-pvrhf" (OuterVolumeSpecName: "kube-api-access-pvrhf") pod "3a3e5f25-274a-44de-8fb3-5d455e2dce66" (UID: "3a3e5f25-274a-44de-8fb3-5d455e2dce66"). InnerVolumeSpecName "kube-api-access-pvrhf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:52:57.879171 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:57.879131    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a3e5f25-274a-44de-8fb3-5d455e2dce66-openshift-service-ca\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:52:57.879171 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:57.879169    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a3e5f25-274a-44de-8fb3-5d455e2dce66-maas-api-tls\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:52:57.879365 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:57.879179    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pvrhf\" (UniqueName: \"kubernetes.io/projected/3a3e5f25-274a-44de-8fb3-5d455e2dce66-kube-api-access-pvrhf\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:52:58.482787 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:58.482756    2578 generic.go:356] "Generic (PLEG): container finished" podID="3a3e5f25-274a-44de-8fb3-5d455e2dce66" containerID="60fc4ceac70efb61f6564509fa63319e0825745508f795b74ed3f101efd6ba88" exitCode=0
Jul 15 13:52:58.483265 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:58.482811    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-114e4a-cf9c45fd6-5x4cx"
Jul 15 13:52:58.483265 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:58.482843    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-114e4a-cf9c45fd6-5x4cx" event={"ID":"3a3e5f25-274a-44de-8fb3-5d455e2dce66","Type":"ContainerDied","Data":"60fc4ceac70efb61f6564509fa63319e0825745508f795b74ed3f101efd6ba88"}
Jul 15 13:52:58.483265 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:58.482911    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-114e4a-cf9c45fd6-5x4cx" event={"ID":"3a3e5f25-274a-44de-8fb3-5d455e2dce66","Type":"ContainerDied","Data":"75dd8b880fe9f37d735a940b09a7677f0de75ca8d22af430773e9c7fa7701b62"}
Jul 15 13:52:58.483265 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:58.482947    2578 scope.go:117] "RemoveContainer" containerID="60fc4ceac70efb61f6564509fa63319e0825745508f795b74ed3f101efd6ba88"
Jul 15 13:52:58.491668 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:58.491646    2578 scope.go:117] "RemoveContainer" containerID="60fc4ceac70efb61f6564509fa63319e0825745508f795b74ed3f101efd6ba88"
Jul 15 13:52:58.491942 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:52:58.491923    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60fc4ceac70efb61f6564509fa63319e0825745508f795b74ed3f101efd6ba88\": container with ID starting with 60fc4ceac70efb61f6564509fa63319e0825745508f795b74ed3f101efd6ba88 not found: ID does not exist" containerID="60fc4ceac70efb61f6564509fa63319e0825745508f795b74ed3f101efd6ba88"
Jul 15 13:52:58.492011 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:58.491957    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60fc4ceac70efb61f6564509fa63319e0825745508f795b74ed3f101efd6ba88"} err="failed to get container status \"60fc4ceac70efb61f6564509fa63319e0825745508f795b74ed3f101efd6ba88\": rpc error: code = NotFound desc = could not find container \"60fc4ceac70efb61f6564509fa63319e0825745508f795b74ed3f101efd6ba88\": container with ID starting with 60fc4ceac70efb61f6564509fa63319e0825745508f795b74ed3f101efd6ba88 not found: ID does not exist"
Jul 15 13:52:58.504048 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:58.504023    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-114e4a-cf9c45fd6-5x4cx"]
Jul 15 13:52:58.508717 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:52:58.508693    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-114e4a-cf9c45fd6-5x4cx"]
Jul 15 13:53:00.375217 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:00.375169    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a3e5f25-274a-44de-8fb3-5d455e2dce66" path="/var/lib/kubelet/pods/3a3e5f25-274a-44de-8fb3-5d455e2dce66/volumes"
Jul 15 13:53:17.007662 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:17.007587    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3b7ec0-657c896fdd-z74pv"]
Jul 15 13:53:17.008028 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:17.007931    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c" containerName="main"
Jul 15 13:53:17.008028 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:17.007942    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c" containerName="main"
Jul 15 13:53:17.008028 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:17.007965    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a3e5f25-274a-44de-8fb3-5d455e2dce66" containerName="maas-api"
Jul 15 13:53:17.008028 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:17.007970    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a3e5f25-274a-44de-8fb3-5d455e2dce66" containerName="maas-api"
Jul 15 13:53:17.008028 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:17.007977    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8dceb1b-d3b1-482c-b9ad-960169ba2acc" containerName="maas-api"
Jul 15 13:53:17.008028 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:17.007984    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8dceb1b-d3b1-482c-b9ad-960169ba2acc" containerName="maas-api"
Jul 15 13:53:17.008246 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:17.008035    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d7efca6-aedb-4e23-8b1a-3f7f9d22ed7c" containerName="main"
Jul 15 13:53:17.008246 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:17.008044    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8dceb1b-d3b1-482c-b9ad-960169ba2acc" containerName="maas-api"
Jul 15 13:53:17.008246 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:17.008052    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a3e5f25-274a-44de-8fb3-5d455e2dce66" containerName="maas-api"
Jul 15 13:53:17.012456 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:17.012438    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b7ec0-657c896fdd-z74pv"
Jul 15 13:53:17.031404 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:17.031377    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-3b7ec0-serving-cert\""
Jul 15 13:53:17.031537 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:17.031489    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-swdqt\""
Jul 15 13:53:17.042357 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:17.042331    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3b7ec0-657c896fdd-z74pv"]
Jul 15 13:53:17.042780 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:17.042756    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/184c6d88-eb74-4a9c-a1e9-7f2cc2507a68-openshift-service-ca\") pod \"maas-api-e2e-api-a-3b7ec0-657c896fdd-z74pv\" (UID: \"184c6d88-eb74-4a9c-a1e9-7f2cc2507a68\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b7ec0-657c896fdd-z74pv"
Jul 15 13:53:17.042862 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:17.042829    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8wl8\" (UniqueName: \"kubernetes.io/projected/184c6d88-eb74-4a9c-a1e9-7f2cc2507a68-kube-api-access-r8wl8\") pod \"maas-api-e2e-api-a-3b7ec0-657c896fdd-z74pv\" (UID: \"184c6d88-eb74-4a9c-a1e9-7f2cc2507a68\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b7ec0-657c896fdd-z74pv"
Jul 15 13:53:17.042936 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:17.042918    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/184c6d88-eb74-4a9c-a1e9-7f2cc2507a68-maas-api-tls\") pod \"maas-api-e2e-api-a-3b7ec0-657c896fdd-z74pv\" (UID: \"184c6d88-eb74-4a9c-a1e9-7f2cc2507a68\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b7ec0-657c896fdd-z74pv"
Jul 15 13:53:17.143400 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:17.143358    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/184c6d88-eb74-4a9c-a1e9-7f2cc2507a68-maas-api-tls\") pod \"maas-api-e2e-api-a-3b7ec0-657c896fdd-z74pv\" (UID: \"184c6d88-eb74-4a9c-a1e9-7f2cc2507a68\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b7ec0-657c896fdd-z74pv"
Jul 15 13:53:17.143608 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:17.143472    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/184c6d88-eb74-4a9c-a1e9-7f2cc2507a68-openshift-service-ca\") pod \"maas-api-e2e-api-a-3b7ec0-657c896fdd-z74pv\" (UID: \"184c6d88-eb74-4a9c-a1e9-7f2cc2507a68\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b7ec0-657c896fdd-z74pv"
Jul 15 13:53:17.143608 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:53:17.143527    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-3b7ec0-serving-cert: secret "maas-api-e2e-api-a-3b7ec0-serving-cert" not found
Jul 15 13:53:17.143746 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:17.143529    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8wl8\" (UniqueName: \"kubernetes.io/projected/184c6d88-eb74-4a9c-a1e9-7f2cc2507a68-kube-api-access-r8wl8\") pod \"maas-api-e2e-api-a-3b7ec0-657c896fdd-z74pv\" (UID: \"184c6d88-eb74-4a9c-a1e9-7f2cc2507a68\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b7ec0-657c896fdd-z74pv"
Jul 15 13:53:17.143746 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:53:17.143621    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/184c6d88-eb74-4a9c-a1e9-7f2cc2507a68-maas-api-tls podName:184c6d88-eb74-4a9c-a1e9-7f2cc2507a68 nodeName:}" failed. No retries permitted until 2026-07-15 13:53:17.643597735 +0000 UTC m=+2517.731384656 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/184c6d88-eb74-4a9c-a1e9-7f2cc2507a68-maas-api-tls") pod "maas-api-e2e-api-a-3b7ec0-657c896fdd-z74pv" (UID: "184c6d88-eb74-4a9c-a1e9-7f2cc2507a68") : secret "maas-api-e2e-api-a-3b7ec0-serving-cert" not found
Jul 15 13:53:17.144185 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:17.144166    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/184c6d88-eb74-4a9c-a1e9-7f2cc2507a68-openshift-service-ca\") pod \"maas-api-e2e-api-a-3b7ec0-657c896fdd-z74pv\" (UID: \"184c6d88-eb74-4a9c-a1e9-7f2cc2507a68\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b7ec0-657c896fdd-z74pv"
Jul 15 13:53:17.154618 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:17.154592    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8wl8\" (UniqueName: \"kubernetes.io/projected/184c6d88-eb74-4a9c-a1e9-7f2cc2507a68-kube-api-access-r8wl8\") pod \"maas-api-e2e-api-a-3b7ec0-657c896fdd-z74pv\" (UID: \"184c6d88-eb74-4a9c-a1e9-7f2cc2507a68\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b7ec0-657c896fdd-z74pv"
Jul 15 13:53:17.648402 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:17.648365    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/184c6d88-eb74-4a9c-a1e9-7f2cc2507a68-maas-api-tls\") pod \"maas-api-e2e-api-a-3b7ec0-657c896fdd-z74pv\" (UID: \"184c6d88-eb74-4a9c-a1e9-7f2cc2507a68\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b7ec0-657c896fdd-z74pv"
Jul 15 13:53:17.650846 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:17.650822    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/184c6d88-eb74-4a9c-a1e9-7f2cc2507a68-maas-api-tls\") pod \"maas-api-e2e-api-a-3b7ec0-657c896fdd-z74pv\" (UID: \"184c6d88-eb74-4a9c-a1e9-7f2cc2507a68\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b7ec0-657c896fdd-z74pv"
Jul 15 13:53:17.921779 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:17.921687    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b7ec0-657c896fdd-z74pv"
Jul 15 13:53:18.060715 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:18.060687    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3b7ec0-657c896fdd-z74pv"]
Jul 15 13:53:18.061843 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:53:18.061815    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod184c6d88_eb74_4a9c_a1e9_7f2cc2507a68.slice/crio-2ee4328a3b753b623c253a7b9074a1a9d322aa75d3d9d0495bfb8942f62841e0 WatchSource:0}: Error finding container 2ee4328a3b753b623c253a7b9074a1a9d322aa75d3d9d0495bfb8942f62841e0: Status 404 returned error can't find the container with id 2ee4328a3b753b623c253a7b9074a1a9d322aa75d3d9d0495bfb8942f62841e0
Jul 15 13:53:18.063188 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:18.063166    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 13:53:18.590919 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:18.590881    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b7ec0-657c896fdd-z74pv" event={"ID":"184c6d88-eb74-4a9c-a1e9-7f2cc2507a68","Type":"ContainerStarted","Data":"76bed60d40454fed0da7c09c22558d6946301f28b046797da4327c33deb1e862"}
Jul 15 13:53:18.591106 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:18.590942    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b7ec0-657c896fdd-z74pv" event={"ID":"184c6d88-eb74-4a9c-a1e9-7f2cc2507a68","Type":"ContainerStarted","Data":"2ee4328a3b753b623c253a7b9074a1a9d322aa75d3d9d0495bfb8942f62841e0"}
Jul 15 13:53:18.591106 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:18.590971    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b7ec0-657c896fdd-z74pv"
Jul 15 13:53:18.609424 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:18.609377    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b7ec0-657c896fdd-z74pv" podStartSLOduration=2.19657015 podStartE2EDuration="2.609362518s" totalImagesPullingTime="412.792368ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:53:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:53:18.606984073 +0000 UTC m=+2518.694771019" watchObservedRunningTime="2026-07-15 13:53:18.609362518 +0000 UTC m=+2518.697149460"
Jul 15 13:53:24.602283 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:24.602253    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b7ec0-657c896fdd-z74pv"
Jul 15 13:53:25.097993 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:25.097964    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5dfbdf-5687bddf98-fdwt6"]
Jul 15 13:53:25.102877 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:25.102858    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5dfbdf-5687bddf98-fdwt6"
Jul 15 13:53:25.105844 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:25.105820    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-5dfbdf-serving-cert\""
Jul 15 13:53:25.114375 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:25.114353    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5dfbdf-5687bddf98-fdwt6"]
Jul 15 13:53:25.214447 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:25.214415    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f70d47e4-3e20-4df7-a814-ba8b1672b928-openshift-service-ca\") pod \"maas-api-e2e-api-b-5dfbdf-5687bddf98-fdwt6\" (UID: \"f70d47e4-3e20-4df7-a814-ba8b1672b928\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5dfbdf-5687bddf98-fdwt6"
Jul 15 13:53:25.214633 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:25.214461    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f70d47e4-3e20-4df7-a814-ba8b1672b928-maas-api-tls\") pod \"maas-api-e2e-api-b-5dfbdf-5687bddf98-fdwt6\" (UID: \"f70d47e4-3e20-4df7-a814-ba8b1672b928\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5dfbdf-5687bddf98-fdwt6"
Jul 15 13:53:25.214633 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:25.214551    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qz56\" (UniqueName: \"kubernetes.io/projected/f70d47e4-3e20-4df7-a814-ba8b1672b928-kube-api-access-8qz56\") pod \"maas-api-e2e-api-b-5dfbdf-5687bddf98-fdwt6\" (UID: \"f70d47e4-3e20-4df7-a814-ba8b1672b928\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5dfbdf-5687bddf98-fdwt6"
Jul 15 13:53:25.315259 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:25.315196    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f70d47e4-3e20-4df7-a814-ba8b1672b928-openshift-service-ca\") pod \"maas-api-e2e-api-b-5dfbdf-5687bddf98-fdwt6\" (UID: \"f70d47e4-3e20-4df7-a814-ba8b1672b928\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5dfbdf-5687bddf98-fdwt6"
Jul 15 13:53:25.315467 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:25.315282    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f70d47e4-3e20-4df7-a814-ba8b1672b928-maas-api-tls\") pod \"maas-api-e2e-api-b-5dfbdf-5687bddf98-fdwt6\" (UID: \"f70d47e4-3e20-4df7-a814-ba8b1672b928\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5dfbdf-5687bddf98-fdwt6"
Jul 15 13:53:25.315467 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:25.315346    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qz56\" (UniqueName: \"kubernetes.io/projected/f70d47e4-3e20-4df7-a814-ba8b1672b928-kube-api-access-8qz56\") pod \"maas-api-e2e-api-b-5dfbdf-5687bddf98-fdwt6\" (UID: \"f70d47e4-3e20-4df7-a814-ba8b1672b928\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5dfbdf-5687bddf98-fdwt6"
Jul 15 13:53:25.315934 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:25.315912    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f70d47e4-3e20-4df7-a814-ba8b1672b928-openshift-service-ca\") pod \"maas-api-e2e-api-b-5dfbdf-5687bddf98-fdwt6\" (UID: \"f70d47e4-3e20-4df7-a814-ba8b1672b928\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5dfbdf-5687bddf98-fdwt6"
Jul 15 13:53:25.317695 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:25.317676    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f70d47e4-3e20-4df7-a814-ba8b1672b928-maas-api-tls\") pod \"maas-api-e2e-api-b-5dfbdf-5687bddf98-fdwt6\" (UID: \"f70d47e4-3e20-4df7-a814-ba8b1672b928\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5dfbdf-5687bddf98-fdwt6"
Jul 15 13:53:25.325042 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:25.325020    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qz56\" (UniqueName: \"kubernetes.io/projected/f70d47e4-3e20-4df7-a814-ba8b1672b928-kube-api-access-8qz56\") pod \"maas-api-e2e-api-b-5dfbdf-5687bddf98-fdwt6\" (UID: \"f70d47e4-3e20-4df7-a814-ba8b1672b928\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5dfbdf-5687bddf98-fdwt6"
Jul 15 13:53:25.414822 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:25.414737    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5dfbdf-5687bddf98-fdwt6"
Jul 15 13:53:25.556371 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:25.556337    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5dfbdf-5687bddf98-fdwt6"]
Jul 15 13:53:25.557417 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:53:25.557394    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf70d47e4_3e20_4df7_a814_ba8b1672b928.slice/crio-729bf3b871f0c2f85d00ad0909a8363d02b105cba3c1ab57056b0deb43b6763c WatchSource:0}: Error finding container 729bf3b871f0c2f85d00ad0909a8363d02b105cba3c1ab57056b0deb43b6763c: Status 404 returned error can't find the container with id 729bf3b871f0c2f85d00ad0909a8363d02b105cba3c1ab57056b0deb43b6763c
Jul 15 13:53:25.627446 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:25.627410    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5dfbdf-5687bddf98-fdwt6" event={"ID":"f70d47e4-3e20-4df7-a814-ba8b1672b928","Type":"ContainerStarted","Data":"729bf3b871f0c2f85d00ad0909a8363d02b105cba3c1ab57056b0deb43b6763c"}
Jul 15 13:53:26.634155 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:26.634116    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5dfbdf-5687bddf98-fdwt6" event={"ID":"f70d47e4-3e20-4df7-a814-ba8b1672b928","Type":"ContainerStarted","Data":"a2cf6bec0be927e368f0c3696eee3f3a6aa09ee511942276fe6672562406ca28"}
Jul 15 13:53:26.634567 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:26.634220    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5dfbdf-5687bddf98-fdwt6"
Jul 15 13:53:26.673682 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:26.673619    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5dfbdf-5687bddf98-fdwt6" podStartSLOduration=1.241243658 podStartE2EDuration="1.673598338s" totalImagesPullingTime="432.35468ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:53:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:53:26.66939267 +0000 UTC m=+2526.757179612" watchObservedRunningTime="2026-07-15 13:53:26.673598338 +0000 UTC m=+2526.761385285"
Jul 15 13:53:32.646508 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:32.646472    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5dfbdf-5687bddf98-fdwt6"
Jul 15 13:53:48.070552 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:48.070517    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3b7ec0-657c896fdd-z74pv"]
Jul 15 13:53:48.071022 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:48.070724    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b7ec0-657c896fdd-z74pv" podUID="184c6d88-eb74-4a9c-a1e9-7f2cc2507a68" containerName="maas-api" containerID="cri-o://76bed60d40454fed0da7c09c22558d6946301f28b046797da4327c33deb1e862" gracePeriod=30
Jul 15 13:53:48.319446 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:48.319418    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b7ec0-657c896fdd-z74pv"
Jul 15 13:53:48.426169 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:48.426069    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/184c6d88-eb74-4a9c-a1e9-7f2cc2507a68-maas-api-tls\") pod \"184c6d88-eb74-4a9c-a1e9-7f2cc2507a68\" (UID: \"184c6d88-eb74-4a9c-a1e9-7f2cc2507a68\") "
Jul 15 13:53:48.426169 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:48.426138    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r8wl8\" (UniqueName: \"kubernetes.io/projected/184c6d88-eb74-4a9c-a1e9-7f2cc2507a68-kube-api-access-r8wl8\") pod \"184c6d88-eb74-4a9c-a1e9-7f2cc2507a68\" (UID: \"184c6d88-eb74-4a9c-a1e9-7f2cc2507a68\") "
Jul 15 13:53:48.426435 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:48.426198    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/184c6d88-eb74-4a9c-a1e9-7f2cc2507a68-openshift-service-ca\") pod \"184c6d88-eb74-4a9c-a1e9-7f2cc2507a68\" (UID: \"184c6d88-eb74-4a9c-a1e9-7f2cc2507a68\") "
Jul 15 13:53:48.426632 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:48.426600    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/184c6d88-eb74-4a9c-a1e9-7f2cc2507a68-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "184c6d88-eb74-4a9c-a1e9-7f2cc2507a68" (UID: "184c6d88-eb74-4a9c-a1e9-7f2cc2507a68"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:53:48.428426 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:48.428400    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/184c6d88-eb74-4a9c-a1e9-7f2cc2507a68-kube-api-access-r8wl8" (OuterVolumeSpecName: "kube-api-access-r8wl8") pod "184c6d88-eb74-4a9c-a1e9-7f2cc2507a68" (UID: "184c6d88-eb74-4a9c-a1e9-7f2cc2507a68"). InnerVolumeSpecName "kube-api-access-r8wl8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:53:48.428426 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:48.428403    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/184c6d88-eb74-4a9c-a1e9-7f2cc2507a68-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "184c6d88-eb74-4a9c-a1e9-7f2cc2507a68" (UID: "184c6d88-eb74-4a9c-a1e9-7f2cc2507a68"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:53:48.527470 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:48.527436    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/184c6d88-eb74-4a9c-a1e9-7f2cc2507a68-maas-api-tls\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:53:48.527470 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:48.527465    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8wl8\" (UniqueName: \"kubernetes.io/projected/184c6d88-eb74-4a9c-a1e9-7f2cc2507a68-kube-api-access-r8wl8\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:53:48.527470 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:48.527476    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/184c6d88-eb74-4a9c-a1e9-7f2cc2507a68-openshift-service-ca\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:53:48.754929 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:48.754895    2578 generic.go:356] "Generic (PLEG): container finished" podID="184c6d88-eb74-4a9c-a1e9-7f2cc2507a68" containerID="76bed60d40454fed0da7c09c22558d6946301f28b046797da4327c33deb1e862" exitCode=0
Jul 15 13:53:48.755107 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:48.754942    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b7ec0-657c896fdd-z74pv"
Jul 15 13:53:48.755107 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:48.754983    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b7ec0-657c896fdd-z74pv" event={"ID":"184c6d88-eb74-4a9c-a1e9-7f2cc2507a68","Type":"ContainerDied","Data":"76bed60d40454fed0da7c09c22558d6946301f28b046797da4327c33deb1e862"}
Jul 15 13:53:48.755107 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:48.755082    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b7ec0-657c896fdd-z74pv" event={"ID":"184c6d88-eb74-4a9c-a1e9-7f2cc2507a68","Type":"ContainerDied","Data":"2ee4328a3b753b623c253a7b9074a1a9d322aa75d3d9d0495bfb8942f62841e0"}
Jul 15 13:53:48.755338 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:48.755111    2578 scope.go:117] "RemoveContainer" containerID="76bed60d40454fed0da7c09c22558d6946301f28b046797da4327c33deb1e862"
Jul 15 13:53:48.764821 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:48.764805    2578 scope.go:117] "RemoveContainer" containerID="76bed60d40454fed0da7c09c22558d6946301f28b046797da4327c33deb1e862"
Jul 15 13:53:48.765057 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:53:48.765040    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76bed60d40454fed0da7c09c22558d6946301f28b046797da4327c33deb1e862\": container with ID starting with 76bed60d40454fed0da7c09c22558d6946301f28b046797da4327c33deb1e862 not found: ID does not exist" containerID="76bed60d40454fed0da7c09c22558d6946301f28b046797da4327c33deb1e862"
Jul 15 13:53:48.765105 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:48.765065    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76bed60d40454fed0da7c09c22558d6946301f28b046797da4327c33deb1e862"} err="failed to get container status \"76bed60d40454fed0da7c09c22558d6946301f28b046797da4327c33deb1e862\": rpc error: code = NotFound desc = could not find container \"76bed60d40454fed0da7c09c22558d6946301f28b046797da4327c33deb1e862\": container with ID starting with 76bed60d40454fed0da7c09c22558d6946301f28b046797da4327c33deb1e862 not found: ID does not exist"
Jul 15 13:53:48.779795 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:48.779773    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3b7ec0-657c896fdd-z74pv"]
Jul 15 13:53:48.785447 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:48.785427    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3b7ec0-657c896fdd-z74pv"]
Jul 15 13:53:50.376392 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:53:50.376361    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="184c6d88-eb74-4a9c-a1e9-7f2cc2507a68" path="/var/lib/kubelet/pods/184c6d88-eb74-4a9c-a1e9-7f2cc2507a68/volumes"
Jul 15 13:54:14.655324 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:14.655288    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5dfbdf-5687bddf98-fdwt6"]
Jul 15 13:54:14.655814 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:14.655503    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5dfbdf-5687bddf98-fdwt6" podUID="f70d47e4-3e20-4df7-a814-ba8b1672b928" containerName="maas-api" containerID="cri-o://a2cf6bec0be927e368f0c3696eee3f3a6aa09ee511942276fe6672562406ca28" gracePeriod=30
Jul 15 13:54:14.903686 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:14.903647    2578 generic.go:356] "Generic (PLEG): container finished" podID="f70d47e4-3e20-4df7-a814-ba8b1672b928" containerID="a2cf6bec0be927e368f0c3696eee3f3a6aa09ee511942276fe6672562406ca28" exitCode=0
Jul 15 13:54:14.903823 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:14.903723    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5dfbdf-5687bddf98-fdwt6" event={"ID":"f70d47e4-3e20-4df7-a814-ba8b1672b928","Type":"ContainerDied","Data":"a2cf6bec0be927e368f0c3696eee3f3a6aa09ee511942276fe6672562406ca28"}
Jul 15 13:54:14.903884 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:14.903820    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5dfbdf-5687bddf98-fdwt6" event={"ID":"f70d47e4-3e20-4df7-a814-ba8b1672b928","Type":"ContainerDied","Data":"729bf3b871f0c2f85d00ad0909a8363d02b105cba3c1ab57056b0deb43b6763c"}
Jul 15 13:54:14.903884 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:14.903844    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="729bf3b871f0c2f85d00ad0909a8363d02b105cba3c1ab57056b0deb43b6763c"
Jul 15 13:54:14.910371 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:14.910315    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5dfbdf-5687bddf98-fdwt6"
Jul 15 13:54:14.962731 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:14.962699    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f70d47e4-3e20-4df7-a814-ba8b1672b928-maas-api-tls\") pod \"f70d47e4-3e20-4df7-a814-ba8b1672b928\" (UID: \"f70d47e4-3e20-4df7-a814-ba8b1672b928\") "
Jul 15 13:54:14.962893 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:14.962755    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8qz56\" (UniqueName: \"kubernetes.io/projected/f70d47e4-3e20-4df7-a814-ba8b1672b928-kube-api-access-8qz56\") pod \"f70d47e4-3e20-4df7-a814-ba8b1672b928\" (UID: \"f70d47e4-3e20-4df7-a814-ba8b1672b928\") "
Jul 15 13:54:14.962893 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:14.962793    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f70d47e4-3e20-4df7-a814-ba8b1672b928-openshift-service-ca\") pod \"f70d47e4-3e20-4df7-a814-ba8b1672b928\" (UID: \"f70d47e4-3e20-4df7-a814-ba8b1672b928\") "
Jul 15 13:54:14.963308 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:14.963274    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f70d47e4-3e20-4df7-a814-ba8b1672b928-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f70d47e4-3e20-4df7-a814-ba8b1672b928" (UID: "f70d47e4-3e20-4df7-a814-ba8b1672b928"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:54:14.964851 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:14.964823    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f70d47e4-3e20-4df7-a814-ba8b1672b928-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f70d47e4-3e20-4df7-a814-ba8b1672b928" (UID: "f70d47e4-3e20-4df7-a814-ba8b1672b928"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:54:14.964948 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:14.964929    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f70d47e4-3e20-4df7-a814-ba8b1672b928-kube-api-access-8qz56" (OuterVolumeSpecName: "kube-api-access-8qz56") pod "f70d47e4-3e20-4df7-a814-ba8b1672b928" (UID: "f70d47e4-3e20-4df7-a814-ba8b1672b928"). InnerVolumeSpecName "kube-api-access-8qz56". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:54:15.064408 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:15.064367    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f70d47e4-3e20-4df7-a814-ba8b1672b928-maas-api-tls\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:54:15.064408 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:15.064404    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8qz56\" (UniqueName: \"kubernetes.io/projected/f70d47e4-3e20-4df7-a814-ba8b1672b928-kube-api-access-8qz56\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:54:15.064408 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:15.064414    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f70d47e4-3e20-4df7-a814-ba8b1672b928-openshift-service-ca\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:54:15.908503 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:15.908474    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5dfbdf-5687bddf98-fdwt6"
Jul 15 13:54:15.939534 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:15.939506    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5dfbdf-5687bddf98-fdwt6"]
Jul 15 13:54:15.947766 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:15.947745    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5dfbdf-5687bddf98-fdwt6"]
Jul 15 13:54:16.375316 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:16.375278    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f70d47e4-3e20-4df7-a814-ba8b1672b928" path="/var/lib/kubelet/pods/f70d47e4-3e20-4df7-a814-ba8b1672b928/volumes"
Jul 15 13:54:30.856758 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:30.856722    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n"]
Jul 15 13:54:30.857114 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:30.857063    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f70d47e4-3e20-4df7-a814-ba8b1672b928" containerName="maas-api"
Jul 15 13:54:30.857114 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:30.857073    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f70d47e4-3e20-4df7-a814-ba8b1672b928" containerName="maas-api"
Jul 15 13:54:30.857114 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:30.857083    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="184c6d88-eb74-4a9c-a1e9-7f2cc2507a68" containerName="maas-api"
Jul 15 13:54:30.857114 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:30.857089    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="184c6d88-eb74-4a9c-a1e9-7f2cc2507a68" containerName="maas-api"
Jul 15 13:54:30.857260 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:30.857155    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f70d47e4-3e20-4df7-a814-ba8b1672b928" containerName="maas-api"
Jul 15 13:54:30.857260 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:30.857167    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="184c6d88-eb74-4a9c-a1e9-7f2cc2507a68" containerName="maas-api"
Jul 15 13:54:30.860252 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:30.860236    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n"
Jul 15 13:54:30.873126 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:30.873107    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-8c00d1-openshift-default-dockercfg-vtpn9\""
Jul 15 13:54:30.904470 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:30.904443    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n"]
Jul 15 13:54:31.011561 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:31.011529    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33a7b06f-c318-4404-8309-90c6a5b2b4a3-istio-envoy\") pod \"e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n\" (UID: \"33a7b06f-c318-4404-8309-90c6a5b2b4a3\") " pod="openshift-ingress/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n"
Jul 15 13:54:31.011561 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:31.011563    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33a7b06f-c318-4404-8309-90c6a5b2b4a3-istio-podinfo\") pod \"e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n\" (UID: \"33a7b06f-c318-4404-8309-90c6a5b2b4a3\") " pod="openshift-ingress/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n"
Jul 15 13:54:31.011769 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:31.011594    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33a7b06f-c318-4404-8309-90c6a5b2b4a3-istio-token\") pod \"e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n\" (UID: \"33a7b06f-c318-4404-8309-90c6a5b2b4a3\") " pod="openshift-ingress/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n"
Jul 15 13:54:31.011769 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:31.011662    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33a7b06f-c318-4404-8309-90c6a5b2b4a3-credential-socket\") pod \"e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n\" (UID: \"33a7b06f-c318-4404-8309-90c6a5b2b4a3\") " pod="openshift-ingress/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n"
Jul 15 13:54:31.011769 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:31.011707    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33a7b06f-c318-4404-8309-90c6a5b2b4a3-workload-certs\") pod \"e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n\" (UID: \"33a7b06f-c318-4404-8309-90c6a5b2b4a3\") " pod="openshift-ingress/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n"
Jul 15 13:54:31.011769 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:31.011723    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2p7d\" (UniqueName: \"kubernetes.io/projected/33a7b06f-c318-4404-8309-90c6a5b2b4a3-kube-api-access-q2p7d\") pod \"e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n\" (UID: \"33a7b06f-c318-4404-8309-90c6a5b2b4a3\") " pod="openshift-ingress/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n"
Jul 15 13:54:31.011769 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:31.011747    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33a7b06f-c318-4404-8309-90c6a5b2b4a3-workload-socket\") pod \"e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n\" (UID: \"33a7b06f-c318-4404-8309-90c6a5b2b4a3\") " pod="openshift-ingress/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n"
Jul 15 13:54:31.011930 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:31.011795    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33a7b06f-c318-4404-8309-90c6a5b2b4a3-istiod-ca-cert\") pod \"e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n\" (UID: \"33a7b06f-c318-4404-8309-90c6a5b2b4a3\") " pod="openshift-ingress/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n"
Jul 15 13:54:31.011930 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:31.011814    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33a7b06f-c318-4404-8309-90c6a5b2b4a3-istio-data\") pod \"e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n\" (UID: \"33a7b06f-c318-4404-8309-90c6a5b2b4a3\") " pod="openshift-ingress/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n"
Jul 15 13:54:31.112516 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:31.112434    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33a7b06f-c318-4404-8309-90c6a5b2b4a3-istio-envoy\") pod \"e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n\" (UID: \"33a7b06f-c318-4404-8309-90c6a5b2b4a3\") " pod="openshift-ingress/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n"
Jul 15 13:54:31.112516 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:31.112470    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33a7b06f-c318-4404-8309-90c6a5b2b4a3-istio-podinfo\") pod \"e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n\" (UID: \"33a7b06f-c318-4404-8309-90c6a5b2b4a3\") " pod="openshift-ingress/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n"
Jul 15 13:54:31.112516 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:31.112504    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33a7b06f-c318-4404-8309-90c6a5b2b4a3-istio-token\") pod \"e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n\" (UID: \"33a7b06f-c318-4404-8309-90c6a5b2b4a3\") " pod="openshift-ingress/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n"
Jul 15 13:54:31.112783 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:31.112551    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33a7b06f-c318-4404-8309-90c6a5b2b4a3-credential-socket\") pod \"e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n\" (UID: \"33a7b06f-c318-4404-8309-90c6a5b2b4a3\") " pod="openshift-ingress/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n"
Jul 15 13:54:31.112783 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:31.112590    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33a7b06f-c318-4404-8309-90c6a5b2b4a3-workload-certs\") pod \"e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n\" (UID: \"33a7b06f-c318-4404-8309-90c6a5b2b4a3\") " pod="openshift-ingress/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n"
Jul 15 13:54:31.112783 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:31.112613    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2p7d\" (UniqueName: \"kubernetes.io/projected/33a7b06f-c318-4404-8309-90c6a5b2b4a3-kube-api-access-q2p7d\") pod \"e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n\" (UID: \"33a7b06f-c318-4404-8309-90c6a5b2b4a3\") " pod="openshift-ingress/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n"
Jul 15 13:54:31.112783 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:31.112642    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33a7b06f-c318-4404-8309-90c6a5b2b4a3-workload-socket\") pod \"e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n\" (UID: \"33a7b06f-c318-4404-8309-90c6a5b2b4a3\") " pod="openshift-ingress/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n"
Jul 15 13:54:31.112783 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:31.112694    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33a7b06f-c318-4404-8309-90c6a5b2b4a3-istiod-ca-cert\") pod \"e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n\" (UID: \"33a7b06f-c318-4404-8309-90c6a5b2b4a3\") " pod="openshift-ingress/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n"
Jul 15 13:54:31.112783 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:31.112719    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33a7b06f-c318-4404-8309-90c6a5b2b4a3-istio-data\") pod \"e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n\" (UID: \"33a7b06f-c318-4404-8309-90c6a5b2b4a3\") " pod="openshift-ingress/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n"
Jul 15 13:54:31.113089 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:31.113013    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33a7b06f-c318-4404-8309-90c6a5b2b4a3-credential-socket\") pod \"e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n\" (UID: \"33a7b06f-c318-4404-8309-90c6a5b2b4a3\") " pod="openshift-ingress/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n"
Jul 15 13:54:31.113130 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:31.113080    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33a7b06f-c318-4404-8309-90c6a5b2b4a3-workload-certs\") pod \"e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n\" (UID: \"33a7b06f-c318-4404-8309-90c6a5b2b4a3\") " pod="openshift-ingress/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n"
Jul 15 13:54:31.113130 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:31.113113    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33a7b06f-c318-4404-8309-90c6a5b2b4a3-workload-socket\") pod \"e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n\" (UID: \"33a7b06f-c318-4404-8309-90c6a5b2b4a3\") " pod="openshift-ingress/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n"
Jul 15 13:54:31.113236 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:31.113163    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33a7b06f-c318-4404-8309-90c6a5b2b4a3-istio-data\") pod \"e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n\" (UID: \"33a7b06f-c318-4404-8309-90c6a5b2b4a3\") " pod="openshift-ingress/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n"
Jul 15 13:54:31.113590 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:31.113569    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33a7b06f-c318-4404-8309-90c6a5b2b4a3-istiod-ca-cert\") pod \"e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n\" (UID: \"33a7b06f-c318-4404-8309-90c6a5b2b4a3\") " pod="openshift-ingress/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n"
Jul 15 13:54:31.114870 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:31.114851    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33a7b06f-c318-4404-8309-90c6a5b2b4a3-istio-envoy\") pod \"e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n\" (UID: \"33a7b06f-c318-4404-8309-90c6a5b2b4a3\") " pod="openshift-ingress/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n"
Jul 15 13:54:31.115099 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:31.115081    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33a7b06f-c318-4404-8309-90c6a5b2b4a3-istio-podinfo\") pod \"e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n\" (UID: \"33a7b06f-c318-4404-8309-90c6a5b2b4a3\") " pod="openshift-ingress/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n"
Jul 15 13:54:31.121030 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:31.121005    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33a7b06f-c318-4404-8309-90c6a5b2b4a3-istio-token\") pod \"e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n\" (UID: \"33a7b06f-c318-4404-8309-90c6a5b2b4a3\") " pod="openshift-ingress/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n"
Jul 15 13:54:31.121327 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:31.121310    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2p7d\" (UniqueName: \"kubernetes.io/projected/33a7b06f-c318-4404-8309-90c6a5b2b4a3-kube-api-access-q2p7d\") pod \"e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n\" (UID: \"33a7b06f-c318-4404-8309-90c6a5b2b4a3\") " pod="openshift-ingress/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n"
Jul 15 13:54:31.169733 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:31.169700    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n"
Jul 15 13:54:31.315625 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:31.315598    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n"]
Jul 15 13:54:31.317283 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:54:31.317254    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33a7b06f_c318_4404_8309_90c6a5b2b4a3.slice/crio-4313735919d54eddcf7dc4e2fac0b12aa9300fd6c044e8ce13218e0ceac15397 WatchSource:0}: Error finding container 4313735919d54eddcf7dc4e2fac0b12aa9300fd6c044e8ce13218e0ceac15397: Status 404 returned error can't find the container with id 4313735919d54eddcf7dc4e2fac0b12aa9300fd6c044e8ce13218e0ceac15397
Jul 15 13:54:31.319487 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:31.319455    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 13:54:31.319567 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:31.319524    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 13:54:31.319567 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:31.319552    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 13:54:31.992567 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:31.992525    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n" event={"ID":"33a7b06f-c318-4404-8309-90c6a5b2b4a3","Type":"ContainerStarted","Data":"6538ff19a8b72b9e1c17b06c1e91ce021406c24544bf0c654d5816f5f3de57a3"}
Jul 15 13:54:31.992961 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:31.992591    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n" event={"ID":"33a7b06f-c318-4404-8309-90c6a5b2b4a3","Type":"ContainerStarted","Data":"4313735919d54eddcf7dc4e2fac0b12aa9300fd6c044e8ce13218e0ceac15397"}
Jul 15 13:54:32.016784 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:32.016733    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n" podStartSLOduration=2.016718897 podStartE2EDuration="2.016718897s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:54:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:54:32.013693063 +0000 UTC m=+2592.101480018" watchObservedRunningTime="2026-07-15 13:54:32.016718897 +0000 UTC m=+2592.104505830"
Jul 15 13:54:32.170062 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:32.170031    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n"
Jul 15 13:54:32.171647 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:32.171620    2578 patch_prober.go:28] interesting pod/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 15 13:54:32.171785 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:32.171680    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n" podUID="33a7b06f-c318-4404-8309-90c6a5b2b4a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 15 13:54:33.174953 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:33.174920    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n"
Jul 15 13:54:34.003155 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:34.003117    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n"
Jul 15 13:54:34.004047 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:34.004026    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n"
Jul 15 13:54:47.080929 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:47.080890    2578 generic.go:356] "Generic (PLEG): container finished" podID="33a7b06f-c318-4404-8309-90c6a5b2b4a3" containerID="6538ff19a8b72b9e1c17b06c1e91ce021406c24544bf0c654d5816f5f3de57a3" exitCode=0
Jul 15 13:54:47.081384 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:47.080945    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n" event={"ID":"33a7b06f-c318-4404-8309-90c6a5b2b4a3","Type":"ContainerDied","Data":"6538ff19a8b72b9e1c17b06c1e91ce021406c24544bf0c654d5816f5f3de57a3"}
Jul 15 13:54:47.081384 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:47.081323    2578 scope.go:117] "RemoveContainer" containerID="6538ff19a8b72b9e1c17b06c1e91ce021406c24544bf0c654d5816f5f3de57a3"
Jul 15 13:54:47.082357 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:47.082322    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 13:54:47.082484 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:47.082406    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 13:54:47.082484 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:47.082457    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 13:54:48.088217 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:48.088168    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n" event={"ID":"33a7b06f-c318-4404-8309-90c6a5b2b4a3","Type":"ContainerStarted","Data":"c2deade54376f6aec1b4fb7de4d60c13898304554cb5133111b935a94329461d"}
Jul 15 13:54:48.170366 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:48.170328    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n"
Jul 15 13:54:48.171468 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:48.171436    2578 patch_prober.go:28] interesting pod/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 15 13:54:48.171603 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:48.171498    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n" podUID="33a7b06f-c318-4404-8309-90c6a5b2b4a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 15 13:54:49.003053 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:49.003013    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n"
Jul 15 13:54:49.170749 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:49.170714    2578 patch_prober.go:28] interesting pod/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 15 13:54:49.171135 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:49.170770    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n" podUID="33a7b06f-c318-4404-8309-90c6a5b2b4a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 15 13:54:50.171049 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:50.171009    2578 patch_prober.go:28] interesting pod/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 15 13:54:50.171562 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:50.171074    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n" podUID="33a7b06f-c318-4404-8309-90c6a5b2b4a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 15 13:54:51.170632 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:51.170595    2578 patch_prober.go:28] interesting pod/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 15 13:54:51.170855 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:51.170656    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n" podUID="33a7b06f-c318-4404-8309-90c6a5b2b4a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 15 13:54:52.174680 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:52.174649    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n"
Jul 15 13:54:52.175646 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:54:52.175624    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n"
Jul 15 13:55:22.898681 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:55:22.898640    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-7746ae/auth-test-model-7746ae-kserve-5486b55579-hhbhg"]
Jul 15 13:55:22.901346 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:55:22.901323    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7746ae/auth-test-model-7746ae-kserve-5486b55579-hhbhg"
Jul 15 13:55:22.904472 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:55:22.904453    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-7746ae\"/\"openshift-service-ca.crt\""
Jul 15 13:55:22.905960 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:55:22.905939    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-7746ae\"/\"auth-test-model-7746ae-kserve-self-signed-certs\""
Jul 15 13:55:22.906087 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:55:22.905971    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-7746ae\"/\"kube-root-ca.crt\""
Jul 15 13:55:22.906087 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:55:22.905971    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-7746ae\"/\"default-dockercfg-xhc77\""
Jul 15 13:55:22.912464 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:55:22.912442    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-7746ae/auth-test-model-7746ae-kserve-5486b55579-hhbhg"]
Jul 15 13:55:22.978914 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:55:22.978887    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlf8g\" (UniqueName: \"kubernetes.io/projected/24e1a2c7-c39e-4fec-a5c3-e1e84e565d29-kube-api-access-mlf8g\") pod \"auth-test-model-7746ae-kserve-5486b55579-hhbhg\" (UID: \"24e1a2c7-c39e-4fec-a5c3-e1e84e565d29\") " pod="ai-tenant-e2e-shared-b-7746ae/auth-test-model-7746ae-kserve-5486b55579-hhbhg"
Jul 15 13:55:22.979035 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:55:22.978941    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24e1a2c7-c39e-4fec-a5c3-e1e84e565d29-tmp-dir\") pod \"auth-test-model-7746ae-kserve-5486b55579-hhbhg\" (UID: \"24e1a2c7-c39e-4fec-a5c3-e1e84e565d29\") " pod="ai-tenant-e2e-shared-b-7746ae/auth-test-model-7746ae-kserve-5486b55579-hhbhg"
Jul 15 13:55:22.979035 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:55:22.978965    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24e1a2c7-c39e-4fec-a5c3-e1e84e565d29-dshm\") pod \"auth-test-model-7746ae-kserve-5486b55579-hhbhg\" (UID: \"24e1a2c7-c39e-4fec-a5c3-e1e84e565d29\") " pod="ai-tenant-e2e-shared-b-7746ae/auth-test-model-7746ae-kserve-5486b55579-hhbhg"
Jul 15 13:55:22.979035 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:55:22.978982    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24e1a2c7-c39e-4fec-a5c3-e1e84e565d29-model-cache\") pod \"auth-test-model-7746ae-kserve-5486b55579-hhbhg\" (UID: \"24e1a2c7-c39e-4fec-a5c3-e1e84e565d29\") " pod="ai-tenant-e2e-shared-b-7746ae/auth-test-model-7746ae-kserve-5486b55579-hhbhg"
Jul 15 13:55:22.979035 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:55:22.979016    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24e1a2c7-c39e-4fec-a5c3-e1e84e565d29-tls-certs\") pod \"auth-test-model-7746ae-kserve-5486b55579-hhbhg\" (UID: \"24e1a2c7-c39e-4fec-a5c3-e1e84e565d29\") " pod="ai-tenant-e2e-shared-b-7746ae/auth-test-model-7746ae-kserve-5486b55579-hhbhg"
Jul 15 13:55:22.979173 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:55:22.979075    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24e1a2c7-c39e-4fec-a5c3-e1e84e565d29-home\") pod \"auth-test-model-7746ae-kserve-5486b55579-hhbhg\" (UID: \"24e1a2c7-c39e-4fec-a5c3-e1e84e565d29\") " pod="ai-tenant-e2e-shared-b-7746ae/auth-test-model-7746ae-kserve-5486b55579-hhbhg"
Jul 15 13:55:23.079732 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:55:23.079697    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24e1a2c7-c39e-4fec-a5c3-e1e84e565d29-home\") pod \"auth-test-model-7746ae-kserve-5486b55579-hhbhg\" (UID: \"24e1a2c7-c39e-4fec-a5c3-e1e84e565d29\") " pod="ai-tenant-e2e-shared-b-7746ae/auth-test-model-7746ae-kserve-5486b55579-hhbhg"
Jul 15 13:55:23.079902 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:55:23.079738    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlf8g\" (UniqueName: \"kubernetes.io/projected/24e1a2c7-c39e-4fec-a5c3-e1e84e565d29-kube-api-access-mlf8g\") pod \"auth-test-model-7746ae-kserve-5486b55579-hhbhg\" (UID: \"24e1a2c7-c39e-4fec-a5c3-e1e84e565d29\") " pod="ai-tenant-e2e-shared-b-7746ae/auth-test-model-7746ae-kserve-5486b55579-hhbhg"
Jul 15 13:55:23.079902 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:55:23.079789    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24e1a2c7-c39e-4fec-a5c3-e1e84e565d29-tmp-dir\") pod \"auth-test-model-7746ae-kserve-5486b55579-hhbhg\" (UID: \"24e1a2c7-c39e-4fec-a5c3-e1e84e565d29\") " pod="ai-tenant-e2e-shared-b-7746ae/auth-test-model-7746ae-kserve-5486b55579-hhbhg"
Jul 15 13:55:23.079902 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:55:23.079815    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24e1a2c7-c39e-4fec-a5c3-e1e84e565d29-dshm\") pod \"auth-test-model-7746ae-kserve-5486b55579-hhbhg\" (UID: \"24e1a2c7-c39e-4fec-a5c3-e1e84e565d29\") " pod="ai-tenant-e2e-shared-b-7746ae/auth-test-model-7746ae-kserve-5486b55579-hhbhg"
Jul 15 13:55:23.079902 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:55:23.079834    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24e1a2c7-c39e-4fec-a5c3-e1e84e565d29-model-cache\") pod \"auth-test-model-7746ae-kserve-5486b55579-hhbhg\" (UID: \"24e1a2c7-c39e-4fec-a5c3-e1e84e565d29\") " pod="ai-tenant-e2e-shared-b-7746ae/auth-test-model-7746ae-kserve-5486b55579-hhbhg"
Jul 15 13:55:23.079902 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:55:23.079891    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24e1a2c7-c39e-4fec-a5c3-e1e84e565d29-tls-certs\") pod \"auth-test-model-7746ae-kserve-5486b55579-hhbhg\" (UID: \"24e1a2c7-c39e-4fec-a5c3-e1e84e565d29\") " pod="ai-tenant-e2e-shared-b-7746ae/auth-test-model-7746ae-kserve-5486b55579-hhbhg"
Jul 15 13:55:23.080164 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:55:23.080138    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24e1a2c7-c39e-4fec-a5c3-e1e84e565d29-home\") pod \"auth-test-model-7746ae-kserve-5486b55579-hhbhg\" (UID: \"24e1a2c7-c39e-4fec-a5c3-e1e84e565d29\") " pod="ai-tenant-e2e-shared-b-7746ae/auth-test-model-7746ae-kserve-5486b55579-hhbhg"
Jul 15 13:55:23.080257 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:55:23.080172    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24e1a2c7-c39e-4fec-a5c3-e1e84e565d29-tmp-dir\") pod \"auth-test-model-7746ae-kserve-5486b55579-hhbhg\" (UID: \"24e1a2c7-c39e-4fec-a5c3-e1e84e565d29\") " pod="ai-tenant-e2e-shared-b-7746ae/auth-test-model-7746ae-kserve-5486b55579-hhbhg"
Jul 15 13:55:23.080367 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:55:23.080350    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24e1a2c7-c39e-4fec-a5c3-e1e84e565d29-model-cache\") pod \"auth-test-model-7746ae-kserve-5486b55579-hhbhg\" (UID: \"24e1a2c7-c39e-4fec-a5c3-e1e84e565d29\") " pod="ai-tenant-e2e-shared-b-7746ae/auth-test-model-7746ae-kserve-5486b55579-hhbhg"
Jul 15 13:55:23.082149 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:55:23.082124    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24e1a2c7-c39e-4fec-a5c3-e1e84e565d29-dshm\") pod \"auth-test-model-7746ae-kserve-5486b55579-hhbhg\" (UID: \"24e1a2c7-c39e-4fec-a5c3-e1e84e565d29\") " pod="ai-tenant-e2e-shared-b-7746ae/auth-test-model-7746ae-kserve-5486b55579-hhbhg"
Jul 15 13:55:23.082333 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:55:23.082317    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24e1a2c7-c39e-4fec-a5c3-e1e84e565d29-tls-certs\") pod \"auth-test-model-7746ae-kserve-5486b55579-hhbhg\" (UID: \"24e1a2c7-c39e-4fec-a5c3-e1e84e565d29\") " pod="ai-tenant-e2e-shared-b-7746ae/auth-test-model-7746ae-kserve-5486b55579-hhbhg"
Jul 15 13:55:23.090282 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:55:23.090257    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlf8g\" (UniqueName: \"kubernetes.io/projected/24e1a2c7-c39e-4fec-a5c3-e1e84e565d29-kube-api-access-mlf8g\") pod \"auth-test-model-7746ae-kserve-5486b55579-hhbhg\" (UID: \"24e1a2c7-c39e-4fec-a5c3-e1e84e565d29\") " pod="ai-tenant-e2e-shared-b-7746ae/auth-test-model-7746ae-kserve-5486b55579-hhbhg"
Jul 15 13:55:23.211377 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:55:23.211350    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7746ae/auth-test-model-7746ae-kserve-5486b55579-hhbhg"
Jul 15 13:55:23.345424 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:55:23.345393    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-7746ae/auth-test-model-7746ae-kserve-5486b55579-hhbhg"]
Jul 15 13:55:23.346700 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:55:23.346674    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod24e1a2c7_c39e_4fec_a5c3_e1e84e565d29.slice/crio-03af316a720a4004a90707b84c4b7c7a4f1ca283b7d344832bb6bb5854f11586 WatchSource:0}: Error finding container 03af316a720a4004a90707b84c4b7c7a4f1ca283b7d344832bb6bb5854f11586: Status 404 returned error can't find the container with id 03af316a720a4004a90707b84c4b7c7a4f1ca283b7d344832bb6bb5854f11586
Jul 15 13:55:24.286879 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:55:24.286847    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7746ae/auth-test-model-7746ae-kserve-5486b55579-hhbhg" event={"ID":"24e1a2c7-c39e-4fec-a5c3-e1e84e565d29","Type":"ContainerStarted","Data":"7ea606e08a7112427ebca8071dba41b04a0daf054a34ab702dfadf4dc14bf156"}
Jul 15 13:55:24.287293 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:55:24.286887    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7746ae/auth-test-model-7746ae-kserve-5486b55579-hhbhg" event={"ID":"24e1a2c7-c39e-4fec-a5c3-e1e84e565d29","Type":"ContainerStarted","Data":"03af316a720a4004a90707b84c4b7c7a4f1ca283b7d344832bb6bb5854f11586"}
Jul 15 13:55:24.308094 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:55:24.308047    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-7746ae/auth-test-model-7746ae-kserve-5486b55579-hhbhg" podStartSLOduration=2.308030777 podStartE2EDuration="2.308030777s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:55:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:55:24.307197709 +0000 UTC m=+2644.394984651" watchObservedRunningTime="2026-07-15 13:55:24.308030777 +0000 UTC m=+2644.395817718"
Jul 15 13:55:33.211878 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:55:33.211839    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-7746ae/auth-test-model-7746ae-kserve-5486b55579-hhbhg"
Jul 15 13:55:33.211878 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:55:33.211884    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-7746ae/auth-test-model-7746ae-kserve-5486b55579-hhbhg"
Jul 15 13:55:33.224884 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:55:33.224857    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-7746ae/auth-test-model-7746ae-kserve-5486b55579-hhbhg"
Jul 15 13:55:33.346889 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:55:33.346856    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-7746ae/auth-test-model-7746ae-kserve-5486b55579-hhbhg"
Jul 15 13:56:20.544088 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:56:20.544003    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-t4bfh_c21b11d6-3242-4dd5-8b75-74dad14868e9/console-operator/1.log"
Jul 15 13:56:20.548064 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:56:20.548043    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt6q4_49ca8630-3cc0-4dbb-8c80-a948ad0de2b4/ovn-acl-logging/0.log"
Jul 15 13:56:20.550666 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:56:20.550642    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-t4bfh_c21b11d6-3242-4dd5-8b75-74dad14868e9/console-operator/1.log"
Jul 15 13:56:20.554966 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:56:20.554949    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt6q4_49ca8630-3cc0-4dbb-8c80-a948ad0de2b4/ovn-acl-logging/0.log"
Jul 15 13:57:27.514874 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:27.514839    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-7746ae/auth-test-model-7746ae-kserve-5486b55579-hhbhg"]
Jul 15 13:57:42.534973 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:42.534869    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-7746ae/auth-test-model-7746ae-kserve-5486b55579-hhbhg" podUID="24e1a2c7-c39e-4fec-a5c3-e1e84e565d29" containerName="main" containerID="cri-o://7ea606e08a7112427ebca8071dba41b04a0daf054a34ab702dfadf4dc14bf156" gracePeriod=45
Jul 15 13:57:42.788902 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:42.788836    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7746ae/auth-test-model-7746ae-kserve-5486b55579-hhbhg"
Jul 15 13:57:42.846693 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:42.846658    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24e1a2c7-c39e-4fec-a5c3-e1e84e565d29-model-cache\") pod \"24e1a2c7-c39e-4fec-a5c3-e1e84e565d29\" (UID: \"24e1a2c7-c39e-4fec-a5c3-e1e84e565d29\") "
Jul 15 13:57:42.846860 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:42.846727    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mlf8g\" (UniqueName: \"kubernetes.io/projected/24e1a2c7-c39e-4fec-a5c3-e1e84e565d29-kube-api-access-mlf8g\") pod \"24e1a2c7-c39e-4fec-a5c3-e1e84e565d29\" (UID: \"24e1a2c7-c39e-4fec-a5c3-e1e84e565d29\") "
Jul 15 13:57:42.846860 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:42.846759    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24e1a2c7-c39e-4fec-a5c3-e1e84e565d29-home\") pod \"24e1a2c7-c39e-4fec-a5c3-e1e84e565d29\" (UID: \"24e1a2c7-c39e-4fec-a5c3-e1e84e565d29\") "
Jul 15 13:57:42.846860 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:42.846800    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24e1a2c7-c39e-4fec-a5c3-e1e84e565d29-tls-certs\") pod \"24e1a2c7-c39e-4fec-a5c3-e1e84e565d29\" (UID: \"24e1a2c7-c39e-4fec-a5c3-e1e84e565d29\") "
Jul 15 13:57:42.846860 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:42.846829    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24e1a2c7-c39e-4fec-a5c3-e1e84e565d29-tmp-dir\") pod \"24e1a2c7-c39e-4fec-a5c3-e1e84e565d29\" (UID: \"24e1a2c7-c39e-4fec-a5c3-e1e84e565d29\") "
Jul 15 13:57:42.847075 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:42.846877    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24e1a2c7-c39e-4fec-a5c3-e1e84e565d29-dshm\") pod \"24e1a2c7-c39e-4fec-a5c3-e1e84e565d29\" (UID: \"24e1a2c7-c39e-4fec-a5c3-e1e84e565d29\") "
Jul 15 13:57:42.847075 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:42.846973    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24e1a2c7-c39e-4fec-a5c3-e1e84e565d29-model-cache" (OuterVolumeSpecName: "model-cache") pod "24e1a2c7-c39e-4fec-a5c3-e1e84e565d29" (UID: "24e1a2c7-c39e-4fec-a5c3-e1e84e565d29"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:57:42.847184 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:42.847064    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24e1a2c7-c39e-4fec-a5c3-e1e84e565d29-home" (OuterVolumeSpecName: "home") pod "24e1a2c7-c39e-4fec-a5c3-e1e84e565d29" (UID: "24e1a2c7-c39e-4fec-a5c3-e1e84e565d29"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:57:42.847184 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:42.847130    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24e1a2c7-c39e-4fec-a5c3-e1e84e565d29-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "24e1a2c7-c39e-4fec-a5c3-e1e84e565d29" (UID: "24e1a2c7-c39e-4fec-a5c3-e1e84e565d29"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:57:42.847299 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:42.847266    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24e1a2c7-c39e-4fec-a5c3-e1e84e565d29-model-cache\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:57:42.847299 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:42.847284    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24e1a2c7-c39e-4fec-a5c3-e1e84e565d29-home\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:57:42.847299 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:42.847293    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24e1a2c7-c39e-4fec-a5c3-e1e84e565d29-tmp-dir\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:57:42.849128 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:42.849089    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24e1a2c7-c39e-4fec-a5c3-e1e84e565d29-dshm" (OuterVolumeSpecName: "dshm") pod "24e1a2c7-c39e-4fec-a5c3-e1e84e565d29" (UID: "24e1a2c7-c39e-4fec-a5c3-e1e84e565d29"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:57:42.849128 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:42.849117    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24e1a2c7-c39e-4fec-a5c3-e1e84e565d29-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "24e1a2c7-c39e-4fec-a5c3-e1e84e565d29" (UID: "24e1a2c7-c39e-4fec-a5c3-e1e84e565d29"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:57:42.849317 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:42.849170    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24e1a2c7-c39e-4fec-a5c3-e1e84e565d29-kube-api-access-mlf8g" (OuterVolumeSpecName: "kube-api-access-mlf8g") pod "24e1a2c7-c39e-4fec-a5c3-e1e84e565d29" (UID: "24e1a2c7-c39e-4fec-a5c3-e1e84e565d29"). InnerVolumeSpecName "kube-api-access-mlf8g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:57:42.948744 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:42.948709    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mlf8g\" (UniqueName: \"kubernetes.io/projected/24e1a2c7-c39e-4fec-a5c3-e1e84e565d29-kube-api-access-mlf8g\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:57:42.948744 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:42.948737    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24e1a2c7-c39e-4fec-a5c3-e1e84e565d29-tls-certs\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:57:42.948744 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:42.948746    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24e1a2c7-c39e-4fec-a5c3-e1e84e565d29-dshm\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:57:43.040700 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:43.040612    2578 generic.go:356] "Generic (PLEG): container finished" podID="24e1a2c7-c39e-4fec-a5c3-e1e84e565d29" containerID="7ea606e08a7112427ebca8071dba41b04a0daf054a34ab702dfadf4dc14bf156" exitCode=0
Jul 15 13:57:43.040700 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:43.040656    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7746ae/auth-test-model-7746ae-kserve-5486b55579-hhbhg"
Jul 15 13:57:43.040893 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:43.040692    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7746ae/auth-test-model-7746ae-kserve-5486b55579-hhbhg" event={"ID":"24e1a2c7-c39e-4fec-a5c3-e1e84e565d29","Type":"ContainerDied","Data":"7ea606e08a7112427ebca8071dba41b04a0daf054a34ab702dfadf4dc14bf156"}
Jul 15 13:57:43.040893 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:43.040736    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7746ae/auth-test-model-7746ae-kserve-5486b55579-hhbhg" event={"ID":"24e1a2c7-c39e-4fec-a5c3-e1e84e565d29","Type":"ContainerDied","Data":"03af316a720a4004a90707b84c4b7c7a4f1ca283b7d344832bb6bb5854f11586"}
Jul 15 13:57:43.040893 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:43.040755    2578 scope.go:117] "RemoveContainer" containerID="7ea606e08a7112427ebca8071dba41b04a0daf054a34ab702dfadf4dc14bf156"
Jul 15 13:57:43.050352 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:43.050332    2578 scope.go:117] "RemoveContainer" containerID="7ea606e08a7112427ebca8071dba41b04a0daf054a34ab702dfadf4dc14bf156"
Jul 15 13:57:43.050621 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:57:43.050603    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ea606e08a7112427ebca8071dba41b04a0daf054a34ab702dfadf4dc14bf156\": container with ID starting with 7ea606e08a7112427ebca8071dba41b04a0daf054a34ab702dfadf4dc14bf156 not found: ID does not exist" containerID="7ea606e08a7112427ebca8071dba41b04a0daf054a34ab702dfadf4dc14bf156"
Jul 15 13:57:43.050683 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:43.050634    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ea606e08a7112427ebca8071dba41b04a0daf054a34ab702dfadf4dc14bf156"} err="failed to get container status \"7ea606e08a7112427ebca8071dba41b04a0daf054a34ab702dfadf4dc14bf156\": rpc error: code = NotFound desc = could not find container \"7ea606e08a7112427ebca8071dba41b04a0daf054a34ab702dfadf4dc14bf156\": container with ID starting with 7ea606e08a7112427ebca8071dba41b04a0daf054a34ab702dfadf4dc14bf156 not found: ID does not exist"
Jul 15 13:57:43.065044 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:43.065013    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-7746ae/auth-test-model-7746ae-kserve-5486b55579-hhbhg"]
Jul 15 13:57:43.068746 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:43.068724    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-7746ae/auth-test-model-7746ae-kserve-5486b55579-hhbhg"]
Jul 15 13:57:44.375995 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:44.375961    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24e1a2c7-c39e-4fec-a5c3-e1e84e565d29" path="/var/lib/kubelet/pods/24e1a2c7-c39e-4fec-a5c3-e1e84e565d29/volumes"
Jul 15 13:57:47.505840 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:47.505806    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-8c00d1/sub-test-model-8c00d1-kserve-7ccbc4cd4c-29lxs"]
Jul 15 13:57:47.506251 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:47.506183    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24e1a2c7-c39e-4fec-a5c3-e1e84e565d29" containerName="main"
Jul 15 13:57:47.506251 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:47.506194    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="24e1a2c7-c39e-4fec-a5c3-e1e84e565d29" containerName="main"
Jul 15 13:57:47.506339 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:47.506281    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="24e1a2c7-c39e-4fec-a5c3-e1e84e565d29" containerName="main"
Jul 15 13:57:47.510666 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:47.510648    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8c00d1/sub-test-model-8c00d1-kserve-7ccbc4cd4c-29lxs"
Jul 15 13:57:47.515169 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:47.515142    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-8c00d1\"/\"openshift-service-ca.crt\""
Jul 15 13:57:47.515344 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:47.515175    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-8c00d1\"/\"default-dockercfg-vqv2d\""
Jul 15 13:57:47.515344 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:47.515216    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-8c00d1\"/\"sub-test-model-8c00d1-kserve-self-signed-certs\""
Jul 15 13:57:47.515344 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:47.515270    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-8c00d1\"/\"kube-root-ca.crt\""
Jul 15 13:57:47.521734 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:47.521711    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-8c00d1/sub-test-model-8c00d1-kserve-7ccbc4cd4c-29lxs"]
Jul 15 13:57:47.591219 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:47.591130    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a223bbf-6dc4-401a-9d83-61cd6c75d045-home\") pod \"sub-test-model-8c00d1-kserve-7ccbc4cd4c-29lxs\" (UID: \"3a223bbf-6dc4-401a-9d83-61cd6c75d045\") " pod="ai-tenant-e2e-shared-a-8c00d1/sub-test-model-8c00d1-kserve-7ccbc4cd4c-29lxs"
Jul 15 13:57:47.591219 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:47.591216    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a223bbf-6dc4-401a-9d83-61cd6c75d045-model-cache\") pod \"sub-test-model-8c00d1-kserve-7ccbc4cd4c-29lxs\" (UID: \"3a223bbf-6dc4-401a-9d83-61cd6c75d045\") " pod="ai-tenant-e2e-shared-a-8c00d1/sub-test-model-8c00d1-kserve-7ccbc4cd4c-29lxs"
Jul 15 13:57:47.591509 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:47.591246    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a223bbf-6dc4-401a-9d83-61cd6c75d045-tmp-dir\") pod \"sub-test-model-8c00d1-kserve-7ccbc4cd4c-29lxs\" (UID: \"3a223bbf-6dc4-401a-9d83-61cd6c75d045\") " pod="ai-tenant-e2e-shared-a-8c00d1/sub-test-model-8c00d1-kserve-7ccbc4cd4c-29lxs"
Jul 15 13:57:47.591509 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:47.591412    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a223bbf-6dc4-401a-9d83-61cd6c75d045-tls-certs\") pod \"sub-test-model-8c00d1-kserve-7ccbc4cd4c-29lxs\" (UID: \"3a223bbf-6dc4-401a-9d83-61cd6c75d045\") " pod="ai-tenant-e2e-shared-a-8c00d1/sub-test-model-8c00d1-kserve-7ccbc4cd4c-29lxs"
Jul 15 13:57:47.591509 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:47.591478    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a223bbf-6dc4-401a-9d83-61cd6c75d045-dshm\") pod \"sub-test-model-8c00d1-kserve-7ccbc4cd4c-29lxs\" (UID: \"3a223bbf-6dc4-401a-9d83-61cd6c75d045\") " pod="ai-tenant-e2e-shared-a-8c00d1/sub-test-model-8c00d1-kserve-7ccbc4cd4c-29lxs"
Jul 15 13:57:47.591704 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:47.591508    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68r8v\" (UniqueName: \"kubernetes.io/projected/3a223bbf-6dc4-401a-9d83-61cd6c75d045-kube-api-access-68r8v\") pod \"sub-test-model-8c00d1-kserve-7ccbc4cd4c-29lxs\" (UID: \"3a223bbf-6dc4-401a-9d83-61cd6c75d045\") " pod="ai-tenant-e2e-shared-a-8c00d1/sub-test-model-8c00d1-kserve-7ccbc4cd4c-29lxs"
Jul 15 13:57:47.692728 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:47.692696    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a223bbf-6dc4-401a-9d83-61cd6c75d045-home\") pod \"sub-test-model-8c00d1-kserve-7ccbc4cd4c-29lxs\" (UID: \"3a223bbf-6dc4-401a-9d83-61cd6c75d045\") " pod="ai-tenant-e2e-shared-a-8c00d1/sub-test-model-8c00d1-kserve-7ccbc4cd4c-29lxs"
Jul 15 13:57:47.692939 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:47.692742    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a223bbf-6dc4-401a-9d83-61cd6c75d045-model-cache\") pod \"sub-test-model-8c00d1-kserve-7ccbc4cd4c-29lxs\" (UID: \"3a223bbf-6dc4-401a-9d83-61cd6c75d045\") " pod="ai-tenant-e2e-shared-a-8c00d1/sub-test-model-8c00d1-kserve-7ccbc4cd4c-29lxs"
Jul 15 13:57:47.692939 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:47.692760    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a223bbf-6dc4-401a-9d83-61cd6c75d045-tmp-dir\") pod \"sub-test-model-8c00d1-kserve-7ccbc4cd4c-29lxs\" (UID: \"3a223bbf-6dc4-401a-9d83-61cd6c75d045\") " pod="ai-tenant-e2e-shared-a-8c00d1/sub-test-model-8c00d1-kserve-7ccbc4cd4c-29lxs"
Jul 15 13:57:47.692939 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:47.692801    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a223bbf-6dc4-401a-9d83-61cd6c75d045-tls-certs\") pod \"sub-test-model-8c00d1-kserve-7ccbc4cd4c-29lxs\" (UID: \"3a223bbf-6dc4-401a-9d83-61cd6c75d045\") " pod="ai-tenant-e2e-shared-a-8c00d1/sub-test-model-8c00d1-kserve-7ccbc4cd4c-29lxs"
Jul 15 13:57:47.692939 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:47.692836    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a223bbf-6dc4-401a-9d83-61cd6c75d045-dshm\") pod \"sub-test-model-8c00d1-kserve-7ccbc4cd4c-29lxs\" (UID: \"3a223bbf-6dc4-401a-9d83-61cd6c75d045\") " pod="ai-tenant-e2e-shared-a-8c00d1/sub-test-model-8c00d1-kserve-7ccbc4cd4c-29lxs"
Jul 15 13:57:47.692939 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:47.692852    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68r8v\" (UniqueName: \"kubernetes.io/projected/3a223bbf-6dc4-401a-9d83-61cd6c75d045-kube-api-access-68r8v\") pod \"sub-test-model-8c00d1-kserve-7ccbc4cd4c-29lxs\" (UID: \"3a223bbf-6dc4-401a-9d83-61cd6c75d045\") " pod="ai-tenant-e2e-shared-a-8c00d1/sub-test-model-8c00d1-kserve-7ccbc4cd4c-29lxs"
Jul 15 13:57:47.693234 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:47.693159    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a223bbf-6dc4-401a-9d83-61cd6c75d045-model-cache\") pod \"sub-test-model-8c00d1-kserve-7ccbc4cd4c-29lxs\" (UID: \"3a223bbf-6dc4-401a-9d83-61cd6c75d045\") " pod="ai-tenant-e2e-shared-a-8c00d1/sub-test-model-8c00d1-kserve-7ccbc4cd4c-29lxs"
Jul 15 13:57:47.693304 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:47.693246    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a223bbf-6dc4-401a-9d83-61cd6c75d045-home\") pod \"sub-test-model-8c00d1-kserve-7ccbc4cd4c-29lxs\" (UID: \"3a223bbf-6dc4-401a-9d83-61cd6c75d045\") " pod="ai-tenant-e2e-shared-a-8c00d1/sub-test-model-8c00d1-kserve-7ccbc4cd4c-29lxs"
Jul 15 13:57:47.693304 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:47.693282    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a223bbf-6dc4-401a-9d83-61cd6c75d045-tmp-dir\") pod \"sub-test-model-8c00d1-kserve-7ccbc4cd4c-29lxs\" (UID: \"3a223bbf-6dc4-401a-9d83-61cd6c75d045\") " pod="ai-tenant-e2e-shared-a-8c00d1/sub-test-model-8c00d1-kserve-7ccbc4cd4c-29lxs"
Jul 15 13:57:47.695240 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:47.695216    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a223bbf-6dc4-401a-9d83-61cd6c75d045-dshm\") pod \"sub-test-model-8c00d1-kserve-7ccbc4cd4c-29lxs\" (UID: \"3a223bbf-6dc4-401a-9d83-61cd6c75d045\") " pod="ai-tenant-e2e-shared-a-8c00d1/sub-test-model-8c00d1-kserve-7ccbc4cd4c-29lxs"
Jul 15 13:57:47.695338 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:47.695264    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a223bbf-6dc4-401a-9d83-61cd6c75d045-tls-certs\") pod \"sub-test-model-8c00d1-kserve-7ccbc4cd4c-29lxs\" (UID: \"3a223bbf-6dc4-401a-9d83-61cd6c75d045\") " pod="ai-tenant-e2e-shared-a-8c00d1/sub-test-model-8c00d1-kserve-7ccbc4cd4c-29lxs"
Jul 15 13:57:47.703754 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:47.703735    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68r8v\" (UniqueName: \"kubernetes.io/projected/3a223bbf-6dc4-401a-9d83-61cd6c75d045-kube-api-access-68r8v\") pod \"sub-test-model-8c00d1-kserve-7ccbc4cd4c-29lxs\" (UID: \"3a223bbf-6dc4-401a-9d83-61cd6c75d045\") " pod="ai-tenant-e2e-shared-a-8c00d1/sub-test-model-8c00d1-kserve-7ccbc4cd4c-29lxs"
Jul 15 13:57:47.820431 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:47.820349    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8c00d1/sub-test-model-8c00d1-kserve-7ccbc4cd4c-29lxs"
Jul 15 13:57:47.957561 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:47.957526    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-8c00d1/sub-test-model-8c00d1-kserve-7ccbc4cd4c-29lxs"]
Jul 15 13:57:47.959379 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:57:47.959352    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3a223bbf_6dc4_401a_9d83_61cd6c75d045.slice/crio-0d740ab6157d8551b76ba51ac68304952fddbf6a99acd20978ec0820b50e7813 WatchSource:0}: Error finding container 0d740ab6157d8551b76ba51ac68304952fddbf6a99acd20978ec0820b50e7813: Status 404 returned error can't find the container with id 0d740ab6157d8551b76ba51ac68304952fddbf6a99acd20978ec0820b50e7813
Jul 15 13:57:48.069784 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:48.069747    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8c00d1/sub-test-model-8c00d1-kserve-7ccbc4cd4c-29lxs" event={"ID":"3a223bbf-6dc4-401a-9d83-61cd6c75d045","Type":"ContainerStarted","Data":"91b29cc973e2c11704431c4625a78a2cc622aa071bd3642de736cbb74564ae9a"}
Jul 15 13:57:48.069784 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:48.069789    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8c00d1/sub-test-model-8c00d1-kserve-7ccbc4cd4c-29lxs" event={"ID":"3a223bbf-6dc4-401a-9d83-61cd6c75d045","Type":"ContainerStarted","Data":"0d740ab6157d8551b76ba51ac68304952fddbf6a99acd20978ec0820b50e7813"}
Jul 15 13:57:48.090747 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:48.090653    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-8c00d1/sub-test-model-8c00d1-kserve-7ccbc4cd4c-29lxs" podStartSLOduration=1.09063646 podStartE2EDuration="1.09063646s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:57:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:57:48.088732404 +0000 UTC m=+2788.176519348" watchObservedRunningTime="2026-07-15 13:57:48.09063646 +0000 UTC m=+2788.178423466"
Jul 15 13:57:57.820601 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:57.820561    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-8c00d1/sub-test-model-8c00d1-kserve-7ccbc4cd4c-29lxs"
Jul 15 13:57:57.821030 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:57.820621    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-8c00d1/sub-test-model-8c00d1-kserve-7ccbc4cd4c-29lxs"
Jul 15 13:57:57.833260 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:57.833237    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-8c00d1/sub-test-model-8c00d1-kserve-7ccbc4cd4c-29lxs"
Jul 15 13:57:58.135469 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:57:58.135390    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-8c00d1/sub-test-model-8c00d1-kserve-7ccbc4cd4c-29lxs"
Jul 15 13:59:04.082225 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:04.082167    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-8c00d1/sub-test-model-8c00d1-kserve-7ccbc4cd4c-29lxs"]
Jul 15 13:59:18.312263 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:18.312164    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-8c00d1/rate-test-model-8c00d1-kserve-5867598c5-fcvxt"]
Jul 15 13:59:18.315601 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:18.315585    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8c00d1/rate-test-model-8c00d1-kserve-5867598c5-fcvxt"
Jul 15 13:59:18.318635 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:18.318611    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-8c00d1\"/\"rate-test-model-8c00d1-kserve-self-signed-certs\""
Jul 15 13:59:18.337747 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:18.337726    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-8c00d1/rate-test-model-8c00d1-kserve-5867598c5-fcvxt"]
Jul 15 13:59:18.396726 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:18.396697    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa8a1693-b52b-4cd8-a7b1-2d2692ead306-model-cache\") pod \"rate-test-model-8c00d1-kserve-5867598c5-fcvxt\" (UID: \"aa8a1693-b52b-4cd8-a7b1-2d2692ead306\") " pod="ai-tenant-e2e-shared-a-8c00d1/rate-test-model-8c00d1-kserve-5867598c5-fcvxt"
Jul 15 13:59:18.396857 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:18.396745    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa8a1693-b52b-4cd8-a7b1-2d2692ead306-tmp-dir\") pod \"rate-test-model-8c00d1-kserve-5867598c5-fcvxt\" (UID: \"aa8a1693-b52b-4cd8-a7b1-2d2692ead306\") " pod="ai-tenant-e2e-shared-a-8c00d1/rate-test-model-8c00d1-kserve-5867598c5-fcvxt"
Jul 15 13:59:18.396857 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:18.396785    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hslx\" (UniqueName: \"kubernetes.io/projected/aa8a1693-b52b-4cd8-a7b1-2d2692ead306-kube-api-access-4hslx\") pod \"rate-test-model-8c00d1-kserve-5867598c5-fcvxt\" (UID: \"aa8a1693-b52b-4cd8-a7b1-2d2692ead306\") " pod="ai-tenant-e2e-shared-a-8c00d1/rate-test-model-8c00d1-kserve-5867598c5-fcvxt"
Jul 15 13:59:18.396857 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:18.396808    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa8a1693-b52b-4cd8-a7b1-2d2692ead306-dshm\") pod \"rate-test-model-8c00d1-kserve-5867598c5-fcvxt\" (UID: \"aa8a1693-b52b-4cd8-a7b1-2d2692ead306\") " pod="ai-tenant-e2e-shared-a-8c00d1/rate-test-model-8c00d1-kserve-5867598c5-fcvxt"
Jul 15 13:59:18.396857 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:18.396844    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa8a1693-b52b-4cd8-a7b1-2d2692ead306-home\") pod \"rate-test-model-8c00d1-kserve-5867598c5-fcvxt\" (UID: \"aa8a1693-b52b-4cd8-a7b1-2d2692ead306\") " pod="ai-tenant-e2e-shared-a-8c00d1/rate-test-model-8c00d1-kserve-5867598c5-fcvxt"
Jul 15 13:59:18.397175 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:18.396868    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa8a1693-b52b-4cd8-a7b1-2d2692ead306-tls-certs\") pod \"rate-test-model-8c00d1-kserve-5867598c5-fcvxt\" (UID: \"aa8a1693-b52b-4cd8-a7b1-2d2692ead306\") " pod="ai-tenant-e2e-shared-a-8c00d1/rate-test-model-8c00d1-kserve-5867598c5-fcvxt"
Jul 15 13:59:18.498254 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:18.498190    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa8a1693-b52b-4cd8-a7b1-2d2692ead306-model-cache\") pod \"rate-test-model-8c00d1-kserve-5867598c5-fcvxt\" (UID: \"aa8a1693-b52b-4cd8-a7b1-2d2692ead306\") " pod="ai-tenant-e2e-shared-a-8c00d1/rate-test-model-8c00d1-kserve-5867598c5-fcvxt"
Jul 15 13:59:18.498439 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:18.498266    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa8a1693-b52b-4cd8-a7b1-2d2692ead306-tmp-dir\") pod \"rate-test-model-8c00d1-kserve-5867598c5-fcvxt\" (UID: \"aa8a1693-b52b-4cd8-a7b1-2d2692ead306\") " pod="ai-tenant-e2e-shared-a-8c00d1/rate-test-model-8c00d1-kserve-5867598c5-fcvxt"
Jul 15 13:59:18.498439 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:18.498303    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hslx\" (UniqueName: \"kubernetes.io/projected/aa8a1693-b52b-4cd8-a7b1-2d2692ead306-kube-api-access-4hslx\") pod \"rate-test-model-8c00d1-kserve-5867598c5-fcvxt\" (UID: \"aa8a1693-b52b-4cd8-a7b1-2d2692ead306\") " pod="ai-tenant-e2e-shared-a-8c00d1/rate-test-model-8c00d1-kserve-5867598c5-fcvxt"
Jul 15 13:59:18.498439 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:18.498335    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa8a1693-b52b-4cd8-a7b1-2d2692ead306-dshm\") pod \"rate-test-model-8c00d1-kserve-5867598c5-fcvxt\" (UID: \"aa8a1693-b52b-4cd8-a7b1-2d2692ead306\") " pod="ai-tenant-e2e-shared-a-8c00d1/rate-test-model-8c00d1-kserve-5867598c5-fcvxt"
Jul 15 13:59:18.498439 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:18.498378    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa8a1693-b52b-4cd8-a7b1-2d2692ead306-home\") pod \"rate-test-model-8c00d1-kserve-5867598c5-fcvxt\" (UID: \"aa8a1693-b52b-4cd8-a7b1-2d2692ead306\") " pod="ai-tenant-e2e-shared-a-8c00d1/rate-test-model-8c00d1-kserve-5867598c5-fcvxt"
Jul 15 13:59:18.498439 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:18.498410    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa8a1693-b52b-4cd8-a7b1-2d2692ead306-tls-certs\") pod \"rate-test-model-8c00d1-kserve-5867598c5-fcvxt\" (UID: \"aa8a1693-b52b-4cd8-a7b1-2d2692ead306\") " pod="ai-tenant-e2e-shared-a-8c00d1/rate-test-model-8c00d1-kserve-5867598c5-fcvxt"
Jul 15 13:59:18.498712 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:18.498572    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa8a1693-b52b-4cd8-a7b1-2d2692ead306-model-cache\") pod \"rate-test-model-8c00d1-kserve-5867598c5-fcvxt\" (UID: \"aa8a1693-b52b-4cd8-a7b1-2d2692ead306\") " pod="ai-tenant-e2e-shared-a-8c00d1/rate-test-model-8c00d1-kserve-5867598c5-fcvxt"
Jul 15 13:59:18.498712 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:18.498639    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa8a1693-b52b-4cd8-a7b1-2d2692ead306-tmp-dir\") pod \"rate-test-model-8c00d1-kserve-5867598c5-fcvxt\" (UID: \"aa8a1693-b52b-4cd8-a7b1-2d2692ead306\") " pod="ai-tenant-e2e-shared-a-8c00d1/rate-test-model-8c00d1-kserve-5867598c5-fcvxt"
Jul 15 13:59:18.498780 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:18.498715    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa8a1693-b52b-4cd8-a7b1-2d2692ead306-home\") pod \"rate-test-model-8c00d1-kserve-5867598c5-fcvxt\" (UID: \"aa8a1693-b52b-4cd8-a7b1-2d2692ead306\") " pod="ai-tenant-e2e-shared-a-8c00d1/rate-test-model-8c00d1-kserve-5867598c5-fcvxt"
Jul 15 13:59:18.500459 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:18.500440    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa8a1693-b52b-4cd8-a7b1-2d2692ead306-dshm\") pod \"rate-test-model-8c00d1-kserve-5867598c5-fcvxt\" (UID: \"aa8a1693-b52b-4cd8-a7b1-2d2692ead306\") " pod="ai-tenant-e2e-shared-a-8c00d1/rate-test-model-8c00d1-kserve-5867598c5-fcvxt"
Jul 15 13:59:18.500737 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:18.500721    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa8a1693-b52b-4cd8-a7b1-2d2692ead306-tls-certs\") pod \"rate-test-model-8c00d1-kserve-5867598c5-fcvxt\" (UID: \"aa8a1693-b52b-4cd8-a7b1-2d2692ead306\") " pod="ai-tenant-e2e-shared-a-8c00d1/rate-test-model-8c00d1-kserve-5867598c5-fcvxt"
Jul 15 13:59:18.508031 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:18.508009    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hslx\" (UniqueName: \"kubernetes.io/projected/aa8a1693-b52b-4cd8-a7b1-2d2692ead306-kube-api-access-4hslx\") pod \"rate-test-model-8c00d1-kserve-5867598c5-fcvxt\" (UID: \"aa8a1693-b52b-4cd8-a7b1-2d2692ead306\") " pod="ai-tenant-e2e-shared-a-8c00d1/rate-test-model-8c00d1-kserve-5867598c5-fcvxt"
Jul 15 13:59:18.625351 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:18.625264    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8c00d1/rate-test-model-8c00d1-kserve-5867598c5-fcvxt"
Jul 15 13:59:18.763029 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:18.763006    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-8c00d1/rate-test-model-8c00d1-kserve-5867598c5-fcvxt"]
Jul 15 13:59:18.764763 ip-10-0-128-159 kubenswrapper[2578]: W0715 13:59:18.764728    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaa8a1693_b52b_4cd8_a7b1_2d2692ead306.slice/crio-db27a0a29e0bdaaeb910c2020d070fb2b8d44ed0e58fb34ff13f76257aab4d81 WatchSource:0}: Error finding container db27a0a29e0bdaaeb910c2020d070fb2b8d44ed0e58fb34ff13f76257aab4d81: Status 404 returned error can't find the container with id db27a0a29e0bdaaeb910c2020d070fb2b8d44ed0e58fb34ff13f76257aab4d81
Jul 15 13:59:19.102513 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:19.102458    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-8c00d1/sub-test-model-8c00d1-kserve-7ccbc4cd4c-29lxs" podUID="3a223bbf-6dc4-401a-9d83-61cd6c75d045" containerName="main" containerID="cri-o://91b29cc973e2c11704431c4625a78a2cc622aa071bd3642de736cbb74564ae9a" gracePeriod=45
Jul 15 13:59:19.346932 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:19.346907    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8c00d1/sub-test-model-8c00d1-kserve-7ccbc4cd4c-29lxs"
Jul 15 13:59:19.405329 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:19.405259    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a223bbf-6dc4-401a-9d83-61cd6c75d045-tmp-dir\") pod \"3a223bbf-6dc4-401a-9d83-61cd6c75d045\" (UID: \"3a223bbf-6dc4-401a-9d83-61cd6c75d045\") "
Jul 15 13:59:19.405329 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:19.405296    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-68r8v\" (UniqueName: \"kubernetes.io/projected/3a223bbf-6dc4-401a-9d83-61cd6c75d045-kube-api-access-68r8v\") pod \"3a223bbf-6dc4-401a-9d83-61cd6c75d045\" (UID: \"3a223bbf-6dc4-401a-9d83-61cd6c75d045\") "
Jul 15 13:59:19.405539 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:19.405340    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a223bbf-6dc4-401a-9d83-61cd6c75d045-home\") pod \"3a223bbf-6dc4-401a-9d83-61cd6c75d045\" (UID: \"3a223bbf-6dc4-401a-9d83-61cd6c75d045\") "
Jul 15 13:59:19.405539 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:19.405359    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a223bbf-6dc4-401a-9d83-61cd6c75d045-model-cache\") pod \"3a223bbf-6dc4-401a-9d83-61cd6c75d045\" (UID: \"3a223bbf-6dc4-401a-9d83-61cd6c75d045\") "
Jul 15 13:59:19.405539 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:19.405374    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a223bbf-6dc4-401a-9d83-61cd6c75d045-tls-certs\") pod \"3a223bbf-6dc4-401a-9d83-61cd6c75d045\" (UID: \"3a223bbf-6dc4-401a-9d83-61cd6c75d045\") "
Jul 15 13:59:19.405539 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:19.405393    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a223bbf-6dc4-401a-9d83-61cd6c75d045-dshm\") pod \"3a223bbf-6dc4-401a-9d83-61cd6c75d045\" (UID: \"3a223bbf-6dc4-401a-9d83-61cd6c75d045\") "
Jul 15 13:59:19.405757 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:19.405531    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a223bbf-6dc4-401a-9d83-61cd6c75d045-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3a223bbf-6dc4-401a-9d83-61cd6c75d045" (UID: "3a223bbf-6dc4-401a-9d83-61cd6c75d045"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:59:19.405757 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:19.405634    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a223bbf-6dc4-401a-9d83-61cd6c75d045-home" (OuterVolumeSpecName: "home") pod "3a223bbf-6dc4-401a-9d83-61cd6c75d045" (UID: "3a223bbf-6dc4-401a-9d83-61cd6c75d045"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:59:19.405757 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:19.405646    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a223bbf-6dc4-401a-9d83-61cd6c75d045-model-cache" (OuterVolumeSpecName: "model-cache") pod "3a223bbf-6dc4-401a-9d83-61cd6c75d045" (UID: "3a223bbf-6dc4-401a-9d83-61cd6c75d045"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:59:19.405882 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:19.405786    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a223bbf-6dc4-401a-9d83-61cd6c75d045-tmp-dir\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:59:19.405882 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:19.405799    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a223bbf-6dc4-401a-9d83-61cd6c75d045-home\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:59:19.405882 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:19.405808    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a223bbf-6dc4-401a-9d83-61cd6c75d045-model-cache\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:59:19.407612 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:19.407588    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a223bbf-6dc4-401a-9d83-61cd6c75d045-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3a223bbf-6dc4-401a-9d83-61cd6c75d045" (UID: "3a223bbf-6dc4-401a-9d83-61cd6c75d045"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:59:19.407715 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:19.407615    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a223bbf-6dc4-401a-9d83-61cd6c75d045-dshm" (OuterVolumeSpecName: "dshm") pod "3a223bbf-6dc4-401a-9d83-61cd6c75d045" (UID: "3a223bbf-6dc4-401a-9d83-61cd6c75d045"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:59:19.407715 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:19.407663    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a223bbf-6dc4-401a-9d83-61cd6c75d045-kube-api-access-68r8v" (OuterVolumeSpecName: "kube-api-access-68r8v") pod "3a223bbf-6dc4-401a-9d83-61cd6c75d045" (UID: "3a223bbf-6dc4-401a-9d83-61cd6c75d045"). InnerVolumeSpecName "kube-api-access-68r8v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:59:19.506696 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:19.506659    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a223bbf-6dc4-401a-9d83-61cd6c75d045-tls-certs\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:59:19.506696 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:19.506695    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a223bbf-6dc4-401a-9d83-61cd6c75d045-dshm\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:59:19.506869 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:19.506709    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-68r8v\" (UniqueName: \"kubernetes.io/projected/3a223bbf-6dc4-401a-9d83-61cd6c75d045-kube-api-access-68r8v\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 13:59:19.566473 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:19.566430    2578 generic.go:356] "Generic (PLEG): container finished" podID="3a223bbf-6dc4-401a-9d83-61cd6c75d045" containerID="91b29cc973e2c11704431c4625a78a2cc622aa071bd3642de736cbb74564ae9a" exitCode=0
Jul 15 13:59:19.566473 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:19.566477    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8c00d1/sub-test-model-8c00d1-kserve-7ccbc4cd4c-29lxs"
Jul 15 13:59:19.566727 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:19.566518    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8c00d1/sub-test-model-8c00d1-kserve-7ccbc4cd4c-29lxs" event={"ID":"3a223bbf-6dc4-401a-9d83-61cd6c75d045","Type":"ContainerDied","Data":"91b29cc973e2c11704431c4625a78a2cc622aa071bd3642de736cbb74564ae9a"}
Jul 15 13:59:19.566727 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:19.566572    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8c00d1/sub-test-model-8c00d1-kserve-7ccbc4cd4c-29lxs" event={"ID":"3a223bbf-6dc4-401a-9d83-61cd6c75d045","Type":"ContainerDied","Data":"0d740ab6157d8551b76ba51ac68304952fddbf6a99acd20978ec0820b50e7813"}
Jul 15 13:59:19.566727 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:19.566594    2578 scope.go:117] "RemoveContainer" containerID="91b29cc973e2c11704431c4625a78a2cc622aa071bd3642de736cbb74564ae9a"
Jul 15 13:59:19.568270 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:19.568179    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8c00d1/rate-test-model-8c00d1-kserve-5867598c5-fcvxt" event={"ID":"aa8a1693-b52b-4cd8-a7b1-2d2692ead306","Type":"ContainerStarted","Data":"a3162995122e40bb6670535b219b0c897eeed82324369bc2acbf24f6a4a2a476"}
Jul 15 13:59:19.568270 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:19.568250    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8c00d1/rate-test-model-8c00d1-kserve-5867598c5-fcvxt" event={"ID":"aa8a1693-b52b-4cd8-a7b1-2d2692ead306","Type":"ContainerStarted","Data":"db27a0a29e0bdaaeb910c2020d070fb2b8d44ed0e58fb34ff13f76257aab4d81"}
Jul 15 13:59:19.575848 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:19.575829    2578 scope.go:117] "RemoveContainer" containerID="91b29cc973e2c11704431c4625a78a2cc622aa071bd3642de736cbb74564ae9a"
Jul 15 13:59:19.576085 ip-10-0-128-159 kubenswrapper[2578]: E0715 13:59:19.576067    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91b29cc973e2c11704431c4625a78a2cc622aa071bd3642de736cbb74564ae9a\": container with ID starting with 91b29cc973e2c11704431c4625a78a2cc622aa071bd3642de736cbb74564ae9a not found: ID does not exist" containerID="91b29cc973e2c11704431c4625a78a2cc622aa071bd3642de736cbb74564ae9a"
Jul 15 13:59:19.576146 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:19.576093    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91b29cc973e2c11704431c4625a78a2cc622aa071bd3642de736cbb74564ae9a"} err="failed to get container status \"91b29cc973e2c11704431c4625a78a2cc622aa071bd3642de736cbb74564ae9a\": rpc error: code = NotFound desc = could not find container \"91b29cc973e2c11704431c4625a78a2cc622aa071bd3642de736cbb74564ae9a\": container with ID starting with 91b29cc973e2c11704431c4625a78a2cc622aa071bd3642de736cbb74564ae9a not found: ID does not exist"
Jul 15 13:59:19.592246 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:19.592184    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-8c00d1/rate-test-model-8c00d1-kserve-5867598c5-fcvxt" podStartSLOduration=1.592173352 podStartE2EDuration="1.592173352s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:59:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:59:19.589508272 +0000 UTC m=+2879.677295214" watchObservedRunningTime="2026-07-15 13:59:19.592173352 +0000 UTC m=+2879.679960295"
Jul 15 13:59:19.603542 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:19.603519    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-8c00d1/sub-test-model-8c00d1-kserve-7ccbc4cd4c-29lxs"]
Jul 15 13:59:19.608142 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:19.608114    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-8c00d1/sub-test-model-8c00d1-kserve-7ccbc4cd4c-29lxs"]
Jul 15 13:59:20.375920 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:20.375888    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a223bbf-6dc4-401a-9d83-61cd6c75d045" path="/var/lib/kubelet/pods/3a223bbf-6dc4-401a-9d83-61cd6c75d045/volumes"
Jul 15 13:59:28.626162 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:28.626131    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-8c00d1/rate-test-model-8c00d1-kserve-5867598c5-fcvxt"
Jul 15 13:59:28.626620 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:28.626289    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-8c00d1/rate-test-model-8c00d1-kserve-5867598c5-fcvxt"
Jul 15 13:59:28.638938 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:28.638912    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-8c00d1/rate-test-model-8c00d1-kserve-5867598c5-fcvxt"
Jul 15 13:59:29.635047 ip-10-0-128-159 kubenswrapper[2578]: I0715 13:59:29.635008    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-8c00d1/rate-test-model-8c00d1-kserve-5867598c5-fcvxt"
Jul 15 14:00:20.649840 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:00:20.649806    2578 scope.go:117] "RemoveContainer" containerID="a2cf6bec0be927e368f0c3696eee3f3a6aa09ee511942276fe6672562406ca28"
Jul 15 14:00:55.074507 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:00:55.074426    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-8c00d1/rate-test-model-8c00d1-kserve-5867598c5-fcvxt"]
Jul 15 14:01:00.700585 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:00.700551    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7757-140715318460592"]
Jul 15 14:01:00.701035 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:00.700918    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a223bbf-6dc4-401a-9d83-61cd6c75d045" containerName="main"
Jul 15 14:01:00.701035 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:00.700930    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a223bbf-6dc4-401a-9d83-61cd6c75d045" containerName="main"
Jul 15 14:01:00.701035 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:00.700989    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a223bbf-6dc4-401a-9d83-61cd6c75d045" containerName="main"
Jul 15 14:01:00.703890 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:00.703871    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7757-140715318460592"
Jul 15 14:01:00.707668 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:00.707636    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-6nqw9\""
Jul 15 14:01:00.711786 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:00.711764    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7757-140715318460592"]
Jul 15 14:01:00.716770 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:00.716744    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74lwt\" (UniqueName: \"kubernetes.io/projected/8ae6ddc5-a13b-4128-a28b-a8738c2982cc-kube-api-access-74lwt\") pod \"test-curl-7757-140715318460592\" (UID: \"8ae6ddc5-a13b-4128-a28b-a8738c2982cc\") " pod="opendatahub/test-curl-7757-140715318460592"
Jul 15 14:01:00.817846 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:00.817813    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74lwt\" (UniqueName: \"kubernetes.io/projected/8ae6ddc5-a13b-4128-a28b-a8738c2982cc-kube-api-access-74lwt\") pod \"test-curl-7757-140715318460592\" (UID: \"8ae6ddc5-a13b-4128-a28b-a8738c2982cc\") " pod="opendatahub/test-curl-7757-140715318460592"
Jul 15 14:01:00.827815 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:00.827783    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74lwt\" (UniqueName: \"kubernetes.io/projected/8ae6ddc5-a13b-4128-a28b-a8738c2982cc-kube-api-access-74lwt\") pod \"test-curl-7757-140715318460592\" (UID: \"8ae6ddc5-a13b-4128-a28b-a8738c2982cc\") " pod="opendatahub/test-curl-7757-140715318460592"
Jul 15 14:01:01.013759 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:01.013718    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7757-140715318460592"
Jul 15 14:01:01.157869 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:01.157840    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7757-140715318460592"]
Jul 15 14:01:01.159606 ip-10-0-128-159 kubenswrapper[2578]: W0715 14:01:01.159576    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ae6ddc5_a13b_4128_a28b_a8738c2982cc.slice/crio-ebb2fdcf17c199c95360c772ed4861628ccf4fa306c246a83e7fe46eef5231ac WatchSource:0}: Error finding container ebb2fdcf17c199c95360c772ed4861628ccf4fa306c246a83e7fe46eef5231ac: Status 404 returned error can't find the container with id ebb2fdcf17c199c95360c772ed4861628ccf4fa306c246a83e7fe46eef5231ac
Jul 15 14:01:01.160812 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:01.160793    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 14:01:02.120333 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:02.120290    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7757-140715318460592" event={"ID":"8ae6ddc5-a13b-4128-a28b-a8738c2982cc","Type":"ContainerStarted","Data":"ebb2fdcf17c199c95360c772ed4861628ccf4fa306c246a83e7fe46eef5231ac"}
Jul 15 14:01:03.127408 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:03.127372    2578 generic.go:356] "Generic (PLEG): container finished" podID="8ae6ddc5-a13b-4128-a28b-a8738c2982cc" containerID="e31d1faad397e4d6e215e0accdfd610b4e40b6e451b19850cc2334d3074376c9" exitCode=0
Jul 15 14:01:03.127787 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:03.127455    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7757-140715318460592" event={"ID":"8ae6ddc5-a13b-4128-a28b-a8738c2982cc","Type":"ContainerDied","Data":"e31d1faad397e4d6e215e0accdfd610b4e40b6e451b19850cc2334d3074376c9"}
Jul 15 14:01:04.265357 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:04.265331    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7757-140715318460592"
Jul 15 14:01:04.302147 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:04.302119    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7757-140715318460592_8ae6ddc5-a13b-4128-a28b-a8738c2982cc/test-curl-7757-140715318460592/0.log"
Jul 15 14:01:04.326703 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:04.326673    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7757-140715318460592"]
Jul 15 14:01:04.330478 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:04.330455    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7757-140715318460592"]
Jul 15 14:01:04.356507 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:04.356485    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-74lwt\" (UniqueName: \"kubernetes.io/projected/8ae6ddc5-a13b-4128-a28b-a8738c2982cc-kube-api-access-74lwt\") pod \"8ae6ddc5-a13b-4128-a28b-a8738c2982cc\" (UID: \"8ae6ddc5-a13b-4128-a28b-a8738c2982cc\") "
Jul 15 14:01:04.358513 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:04.358484    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ae6ddc5-a13b-4128-a28b-a8738c2982cc-kube-api-access-74lwt" (OuterVolumeSpecName: "kube-api-access-74lwt") pod "8ae6ddc5-a13b-4128-a28b-a8738c2982cc" (UID: "8ae6ddc5-a13b-4128-a28b-a8738c2982cc"). InnerVolumeSpecName "kube-api-access-74lwt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 14:01:04.375860 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:04.375835    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ae6ddc5-a13b-4128-a28b-a8738c2982cc" path="/var/lib/kubelet/pods/8ae6ddc5-a13b-4128-a28b-a8738c2982cc/volumes"
Jul 15 14:01:04.457923 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:04.457893    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-74lwt\" (UniqueName: \"kubernetes.io/projected/8ae6ddc5-a13b-4128-a28b-a8738c2982cc-kube-api-access-74lwt\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 14:01:04.500105 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:04.500069    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7757-140715318531824"]
Jul 15 14:01:04.500472 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:04.500457    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ae6ddc5-a13b-4128-a28b-a8738c2982cc" containerName="test-curl-7757-140715318460592"
Jul 15 14:01:04.500472 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:04.500473    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ae6ddc5-a13b-4128-a28b-a8738c2982cc" containerName="test-curl-7757-140715318460592"
Jul 15 14:01:04.500572 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:04.500562    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ae6ddc5-a13b-4128-a28b-a8738c2982cc" containerName="test-curl-7757-140715318460592"
Jul 15 14:01:04.503686 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:04.503667    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7757-140715318531824"
Jul 15 14:01:04.510068 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:04.510042    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7757-140715318531824"]
Jul 15 14:01:04.558958 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:04.558926    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flg97\" (UniqueName: \"kubernetes.io/projected/09134659-e74e-458d-b302-507cbbf398d0-kube-api-access-flg97\") pod \"test-curl-7757-140715318531824\" (UID: \"09134659-e74e-458d-b302-507cbbf398d0\") " pod="opendatahub/test-curl-7757-140715318531824"
Jul 15 14:01:04.660550 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:04.660514    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flg97\" (UniqueName: \"kubernetes.io/projected/09134659-e74e-458d-b302-507cbbf398d0-kube-api-access-flg97\") pod \"test-curl-7757-140715318531824\" (UID: \"09134659-e74e-458d-b302-507cbbf398d0\") " pod="opendatahub/test-curl-7757-140715318531824"
Jul 15 14:01:04.670356 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:04.670331    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flg97\" (UniqueName: \"kubernetes.io/projected/09134659-e74e-458d-b302-507cbbf398d0-kube-api-access-flg97\") pod \"test-curl-7757-140715318531824\" (UID: \"09134659-e74e-458d-b302-507cbbf398d0\") " pod="opendatahub/test-curl-7757-140715318531824"
Jul 15 14:01:04.815189 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:04.815096    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7757-140715318531824"
Jul 15 14:01:04.957432 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:04.957411    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7757-140715318531824"]
Jul 15 14:01:04.958713 ip-10-0-128-159 kubenswrapper[2578]: W0715 14:01:04.958684    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod09134659_e74e_458d_b302_507cbbf398d0.slice/crio-ac18df94a1374e5814aaa4866def23065bac58e71c769de268d995fcd533106c WatchSource:0}: Error finding container ac18df94a1374e5814aaa4866def23065bac58e71c769de268d995fcd533106c: Status 404 returned error can't find the container with id ac18df94a1374e5814aaa4866def23065bac58e71c769de268d995fcd533106c
Jul 15 14:01:05.140427 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:05.140336    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7757-140715318460592"
Jul 15 14:01:05.140427 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:05.140407    2578 scope.go:117] "RemoveContainer" containerID="e31d1faad397e4d6e215e0accdfd610b4e40b6e451b19850cc2334d3074376c9"
Jul 15 14:01:05.141746 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:05.141717    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7757-140715318531824" event={"ID":"09134659-e74e-458d-b302-507cbbf398d0","Type":"ContainerStarted","Data":"ac18df94a1374e5814aaa4866def23065bac58e71c769de268d995fcd533106c"}
Jul 15 14:01:06.148703 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:06.148665    2578 generic.go:356] "Generic (PLEG): container finished" podID="09134659-e74e-458d-b302-507cbbf398d0" containerID="d18296b828019588a1c5524ff4aff6d762865290e08e357c87f78e5f1813edf5" exitCode=0
Jul 15 14:01:06.149218 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:06.148743    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7757-140715318531824" event={"ID":"09134659-e74e-458d-b302-507cbbf398d0","Type":"ContainerDied","Data":"d18296b828019588a1c5524ff4aff6d762865290e08e357c87f78e5f1813edf5"}
Jul 15 14:01:07.287292 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:07.287267    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7757-140715318531824"
Jul 15 14:01:07.312037 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:07.312005    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7757-140715318531824_09134659-e74e-458d-b302-507cbbf398d0/test-curl-7757-140715318531824/0.log"
Jul 15 14:01:07.340799 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:07.340730    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7757-140715318531824"]
Jul 15 14:01:07.344123 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:07.344094    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7757-140715318531824"]
Jul 15 14:01:07.385222 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:07.385178    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-flg97\" (UniqueName: \"kubernetes.io/projected/09134659-e74e-458d-b302-507cbbf398d0-kube-api-access-flg97\") pod \"09134659-e74e-458d-b302-507cbbf398d0\" (UID: \"09134659-e74e-458d-b302-507cbbf398d0\") "
Jul 15 14:01:07.387313 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:07.387278    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09134659-e74e-458d-b302-507cbbf398d0-kube-api-access-flg97" (OuterVolumeSpecName: "kube-api-access-flg97") pod "09134659-e74e-458d-b302-507cbbf398d0" (UID: "09134659-e74e-458d-b302-507cbbf398d0"). InnerVolumeSpecName "kube-api-access-flg97". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 14:01:07.487006 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:07.486966    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-flg97\" (UniqueName: \"kubernetes.io/projected/09134659-e74e-458d-b302-507cbbf398d0-kube-api-access-flg97\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 14:01:08.161729 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:08.161697    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ac18df94a1374e5814aaa4866def23065bac58e71c769de268d995fcd533106c"
Jul 15 14:01:08.161729 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:08.161699    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7757-140715318531824"
Jul 15 14:01:08.172496 ip-10-0-128-159 kubenswrapper[2578]: E0715 14:01:08.172467    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7757-140715318531824\" is forbidden: User \"system:node:ip-10-0-128-159.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-159.ec2.internal' and this object" podUID="09134659-e74e-458d-b302-507cbbf398d0" pod="opendatahub/test-curl-7757-140715318531824"
Jul 15 14:01:08.375442 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:08.375407    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09134659-e74e-458d-b302-507cbbf398d0" path="/var/lib/kubelet/pods/09134659-e74e-458d-b302-507cbbf398d0/volumes"
Jul 15 14:01:10.094924 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:10.094877    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-8c00d1/rate-test-model-8c00d1-kserve-5867598c5-fcvxt" podUID="aa8a1693-b52b-4cd8-a7b1-2d2692ead306" containerName="main" containerID="cri-o://a3162995122e40bb6670535b219b0c897eeed82324369bc2acbf24f6a4a2a476" gracePeriod=45
Jul 15 14:01:10.353005 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:10.352940    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8c00d1/rate-test-model-8c00d1-kserve-5867598c5-fcvxt"
Jul 15 14:01:10.412571 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:10.412544    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa8a1693-b52b-4cd8-a7b1-2d2692ead306-tmp-dir\") pod \"aa8a1693-b52b-4cd8-a7b1-2d2692ead306\" (UID: \"aa8a1693-b52b-4cd8-a7b1-2d2692ead306\") "
Jul 15 14:01:10.412739 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:10.412629    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4hslx\" (UniqueName: \"kubernetes.io/projected/aa8a1693-b52b-4cd8-a7b1-2d2692ead306-kube-api-access-4hslx\") pod \"aa8a1693-b52b-4cd8-a7b1-2d2692ead306\" (UID: \"aa8a1693-b52b-4cd8-a7b1-2d2692ead306\") "
Jul 15 14:01:10.412739 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:10.412664    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa8a1693-b52b-4cd8-a7b1-2d2692ead306-dshm\") pod \"aa8a1693-b52b-4cd8-a7b1-2d2692ead306\" (UID: \"aa8a1693-b52b-4cd8-a7b1-2d2692ead306\") "
Jul 15 14:01:10.412739 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:10.412682    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa8a1693-b52b-4cd8-a7b1-2d2692ead306-home\") pod \"aa8a1693-b52b-4cd8-a7b1-2d2692ead306\" (UID: \"aa8a1693-b52b-4cd8-a7b1-2d2692ead306\") "
Jul 15 14:01:10.412739 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:10.412730    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa8a1693-b52b-4cd8-a7b1-2d2692ead306-tls-certs\") pod \"aa8a1693-b52b-4cd8-a7b1-2d2692ead306\" (UID: \"aa8a1693-b52b-4cd8-a7b1-2d2692ead306\") "
Jul 15 14:01:10.412967 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:10.412751    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa8a1693-b52b-4cd8-a7b1-2d2692ead306-model-cache\") pod \"aa8a1693-b52b-4cd8-a7b1-2d2692ead306\" (UID: \"aa8a1693-b52b-4cd8-a7b1-2d2692ead306\") "
Jul 15 14:01:10.412967 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:10.412790    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa8a1693-b52b-4cd8-a7b1-2d2692ead306-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "aa8a1693-b52b-4cd8-a7b1-2d2692ead306" (UID: "aa8a1693-b52b-4cd8-a7b1-2d2692ead306"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 14:01:10.413076 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:10.413018    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa8a1693-b52b-4cd8-a7b1-2d2692ead306-model-cache" (OuterVolumeSpecName: "model-cache") pod "aa8a1693-b52b-4cd8-a7b1-2d2692ead306" (UID: "aa8a1693-b52b-4cd8-a7b1-2d2692ead306"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 14:01:10.413076 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:10.413034    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa8a1693-b52b-4cd8-a7b1-2d2692ead306-home" (OuterVolumeSpecName: "home") pod "aa8a1693-b52b-4cd8-a7b1-2d2692ead306" (UID: "aa8a1693-b52b-4cd8-a7b1-2d2692ead306"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 14:01:10.413076 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:10.413045    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa8a1693-b52b-4cd8-a7b1-2d2692ead306-tmp-dir\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 14:01:10.414907 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:10.414877    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa8a1693-b52b-4cd8-a7b1-2d2692ead306-dshm" (OuterVolumeSpecName: "dshm") pod "aa8a1693-b52b-4cd8-a7b1-2d2692ead306" (UID: "aa8a1693-b52b-4cd8-a7b1-2d2692ead306"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 14:01:10.414907 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:10.414893    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa8a1693-b52b-4cd8-a7b1-2d2692ead306-kube-api-access-4hslx" (OuterVolumeSpecName: "kube-api-access-4hslx") pod "aa8a1693-b52b-4cd8-a7b1-2d2692ead306" (UID: "aa8a1693-b52b-4cd8-a7b1-2d2692ead306"). InnerVolumeSpecName "kube-api-access-4hslx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 14:01:10.414907 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:10.414901    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa8a1693-b52b-4cd8-a7b1-2d2692ead306-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "aa8a1693-b52b-4cd8-a7b1-2d2692ead306" (UID: "aa8a1693-b52b-4cd8-a7b1-2d2692ead306"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 14:01:10.514506 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:10.514470    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa8a1693-b52b-4cd8-a7b1-2d2692ead306-tls-certs\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 14:01:10.514506 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:10.514502    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa8a1693-b52b-4cd8-a7b1-2d2692ead306-model-cache\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 14:01:10.514506 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:10.514512    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4hslx\" (UniqueName: \"kubernetes.io/projected/aa8a1693-b52b-4cd8-a7b1-2d2692ead306-kube-api-access-4hslx\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 14:01:10.514761 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:10.514522    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa8a1693-b52b-4cd8-a7b1-2d2692ead306-dshm\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 14:01:10.514761 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:10.514531    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa8a1693-b52b-4cd8-a7b1-2d2692ead306-home\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 14:01:11.179519 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:11.179479    2578 generic.go:356] "Generic (PLEG): container finished" podID="aa8a1693-b52b-4cd8-a7b1-2d2692ead306" containerID="a3162995122e40bb6670535b219b0c897eeed82324369bc2acbf24f6a4a2a476" exitCode=0
Jul 15 14:01:11.179948 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:11.179539    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8c00d1/rate-test-model-8c00d1-kserve-5867598c5-fcvxt"
Jul 15 14:01:11.179948 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:11.179572    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8c00d1/rate-test-model-8c00d1-kserve-5867598c5-fcvxt" event={"ID":"aa8a1693-b52b-4cd8-a7b1-2d2692ead306","Type":"ContainerDied","Data":"a3162995122e40bb6670535b219b0c897eeed82324369bc2acbf24f6a4a2a476"}
Jul 15 14:01:11.179948 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:11.179620    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8c00d1/rate-test-model-8c00d1-kserve-5867598c5-fcvxt" event={"ID":"aa8a1693-b52b-4cd8-a7b1-2d2692ead306","Type":"ContainerDied","Data":"db27a0a29e0bdaaeb910c2020d070fb2b8d44ed0e58fb34ff13f76257aab4d81"}
Jul 15 14:01:11.179948 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:11.179641    2578 scope.go:117] "RemoveContainer" containerID="a3162995122e40bb6670535b219b0c897eeed82324369bc2acbf24f6a4a2a476"
Jul 15 14:01:11.188866 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:11.188847    2578 scope.go:117] "RemoveContainer" containerID="a3162995122e40bb6670535b219b0c897eeed82324369bc2acbf24f6a4a2a476"
Jul 15 14:01:11.189085 ip-10-0-128-159 kubenswrapper[2578]: E0715 14:01:11.189067    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3162995122e40bb6670535b219b0c897eeed82324369bc2acbf24f6a4a2a476\": container with ID starting with a3162995122e40bb6670535b219b0c897eeed82324369bc2acbf24f6a4a2a476 not found: ID does not exist" containerID="a3162995122e40bb6670535b219b0c897eeed82324369bc2acbf24f6a4a2a476"
Jul 15 14:01:11.189129 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:11.189093    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3162995122e40bb6670535b219b0c897eeed82324369bc2acbf24f6a4a2a476"} err="failed to get container status \"a3162995122e40bb6670535b219b0c897eeed82324369bc2acbf24f6a4a2a476\": rpc error: code = NotFound desc = could not find container \"a3162995122e40bb6670535b219b0c897eeed82324369bc2acbf24f6a4a2a476\": container with ID starting with a3162995122e40bb6670535b219b0c897eeed82324369bc2acbf24f6a4a2a476 not found: ID does not exist"
Jul 15 14:01:11.203482 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:11.203458    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-8c00d1/rate-test-model-8c00d1-kserve-5867598c5-fcvxt"]
Jul 15 14:01:11.207043 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:11.207021    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-8c00d1/rate-test-model-8c00d1-kserve-5867598c5-fcvxt"]
Jul 15 14:01:12.375785 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:12.375748    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa8a1693-b52b-4cd8-a7b1-2d2692ead306" path="/var/lib/kubelet/pods/aa8a1693-b52b-4cd8-a7b1-2d2692ead306/volumes"
Jul 15 14:01:20.582919 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:20.582893    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-t4bfh_c21b11d6-3242-4dd5-8b75-74dad14868e9/console-operator/1.log"
Jul 15 14:01:20.594432 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:20.594398    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt6q4_49ca8630-3cc0-4dbb-8c80-a948ad0de2b4/ovn-acl-logging/0.log"
Jul 15 14:01:20.597466 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:20.597442    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-t4bfh_c21b11d6-3242-4dd5-8b75-74dad14868e9/console-operator/1.log"
Jul 15 14:01:20.601552 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:20.601533    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt6q4_49ca8630-3cc0-4dbb-8c80-a948ad0de2b4/ovn-acl-logging/0.log"
Jul 15 14:01:41.901683 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:41.901651    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n"]
Jul 15 14:01:41.902589 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:41.901869    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n" podUID="33a7b06f-c318-4404-8309-90c6a5b2b4a3" containerName="istio-proxy" containerID="cri-o://c2deade54376f6aec1b4fb7de4d60c13898304554cb5133111b935a94329461d" gracePeriod=30
Jul 15 14:01:47.157729 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:47.157704    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n"
Jul 15 14:01:47.242670 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:47.242644    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33a7b06f-c318-4404-8309-90c6a5b2b4a3-istio-envoy\") pod \"33a7b06f-c318-4404-8309-90c6a5b2b4a3\" (UID: \"33a7b06f-c318-4404-8309-90c6a5b2b4a3\") "
Jul 15 14:01:47.242861 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:47.242678    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33a7b06f-c318-4404-8309-90c6a5b2b4a3-istio-data\") pod \"33a7b06f-c318-4404-8309-90c6a5b2b4a3\" (UID: \"33a7b06f-c318-4404-8309-90c6a5b2b4a3\") "
Jul 15 14:01:47.242861 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:47.242710    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33a7b06f-c318-4404-8309-90c6a5b2b4a3-istio-token\") pod \"33a7b06f-c318-4404-8309-90c6a5b2b4a3\" (UID: \"33a7b06f-c318-4404-8309-90c6a5b2b4a3\") "
Jul 15 14:01:47.242861 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:47.242747    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33a7b06f-c318-4404-8309-90c6a5b2b4a3-workload-socket\") pod \"33a7b06f-c318-4404-8309-90c6a5b2b4a3\" (UID: \"33a7b06f-c318-4404-8309-90c6a5b2b4a3\") "
Jul 15 14:01:47.242861 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:47.242802    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33a7b06f-c318-4404-8309-90c6a5b2b4a3-istio-podinfo\") pod \"33a7b06f-c318-4404-8309-90c6a5b2b4a3\" (UID: \"33a7b06f-c318-4404-8309-90c6a5b2b4a3\") "
Jul 15 14:01:47.243098 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:47.242962    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33a7b06f-c318-4404-8309-90c6a5b2b4a3-credential-socket\") pod \"33a7b06f-c318-4404-8309-90c6a5b2b4a3\" (UID: \"33a7b06f-c318-4404-8309-90c6a5b2b4a3\") "
Jul 15 14:01:47.243098 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:47.243009    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33a7b06f-c318-4404-8309-90c6a5b2b4a3-workload-certs\") pod \"33a7b06f-c318-4404-8309-90c6a5b2b4a3\" (UID: \"33a7b06f-c318-4404-8309-90c6a5b2b4a3\") "
Jul 15 14:01:47.243098 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:47.243079    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q2p7d\" (UniqueName: \"kubernetes.io/projected/33a7b06f-c318-4404-8309-90c6a5b2b4a3-kube-api-access-q2p7d\") pod \"33a7b06f-c318-4404-8309-90c6a5b2b4a3\" (UID: \"33a7b06f-c318-4404-8309-90c6a5b2b4a3\") "
Jul 15 14:01:47.243365 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:47.243105    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33a7b06f-c318-4404-8309-90c6a5b2b4a3-istiod-ca-cert\") pod \"33a7b06f-c318-4404-8309-90c6a5b2b4a3\" (UID: \"33a7b06f-c318-4404-8309-90c6a5b2b4a3\") "
Jul 15 14:01:47.243365 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:47.243104    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33a7b06f-c318-4404-8309-90c6a5b2b4a3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "33a7b06f-c318-4404-8309-90c6a5b2b4a3" (UID: "33a7b06f-c318-4404-8309-90c6a5b2b4a3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 14:01:47.243365 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:47.243220    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33a7b06f-c318-4404-8309-90c6a5b2b4a3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "33a7b06f-c318-4404-8309-90c6a5b2b4a3" (UID: "33a7b06f-c318-4404-8309-90c6a5b2b4a3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 14:01:47.243529 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:47.243399    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33a7b06f-c318-4404-8309-90c6a5b2b4a3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "33a7b06f-c318-4404-8309-90c6a5b2b4a3" (UID: "33a7b06f-c318-4404-8309-90c6a5b2b4a3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 14:01:47.243529 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:47.243477    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33a7b06f-c318-4404-8309-90c6a5b2b4a3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "33a7b06f-c318-4404-8309-90c6a5b2b4a3" (UID: "33a7b06f-c318-4404-8309-90c6a5b2b4a3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 14:01:47.243640 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:47.243539    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33a7b06f-c318-4404-8309-90c6a5b2b4a3-workload-socket\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 14:01:47.243640 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:47.243556    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33a7b06f-c318-4404-8309-90c6a5b2b4a3-credential-socket\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 14:01:47.243640 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:47.243571    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33a7b06f-c318-4404-8309-90c6a5b2b4a3-workload-certs\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 14:01:47.243640 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:47.243635    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33a7b06f-c318-4404-8309-90c6a5b2b4a3-istio-data" (OuterVolumeSpecName: "istio-data") pod "33a7b06f-c318-4404-8309-90c6a5b2b4a3" (UID: "33a7b06f-c318-4404-8309-90c6a5b2b4a3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 14:01:47.244919 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:47.244885    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33a7b06f-c318-4404-8309-90c6a5b2b4a3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "33a7b06f-c318-4404-8309-90c6a5b2b4a3" (UID: "33a7b06f-c318-4404-8309-90c6a5b2b4a3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 14:01:47.245019 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:47.244959    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/33a7b06f-c318-4404-8309-90c6a5b2b4a3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "33a7b06f-c318-4404-8309-90c6a5b2b4a3" (UID: "33a7b06f-c318-4404-8309-90c6a5b2b4a3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 14:01:47.245061 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:47.245042    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33a7b06f-c318-4404-8309-90c6a5b2b4a3-istio-token" (OuterVolumeSpecName: "istio-token") pod "33a7b06f-c318-4404-8309-90c6a5b2b4a3" (UID: "33a7b06f-c318-4404-8309-90c6a5b2b4a3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 14:01:47.245233 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:47.245195    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33a7b06f-c318-4404-8309-90c6a5b2b4a3-kube-api-access-q2p7d" (OuterVolumeSpecName: "kube-api-access-q2p7d") pod "33a7b06f-c318-4404-8309-90c6a5b2b4a3" (UID: "33a7b06f-c318-4404-8309-90c6a5b2b4a3"). InnerVolumeSpecName "kube-api-access-q2p7d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 14:01:47.344579 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:47.344550    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33a7b06f-c318-4404-8309-90c6a5b2b4a3-istio-envoy\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 14:01:47.344579 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:47.344577    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33a7b06f-c318-4404-8309-90c6a5b2b4a3-istio-data\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 14:01:47.344579 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:47.344585    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33a7b06f-c318-4404-8309-90c6a5b2b4a3-istio-token\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 14:01:47.344790 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:47.344593    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33a7b06f-c318-4404-8309-90c6a5b2b4a3-istio-podinfo\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 14:01:47.344790 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:47.344601    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2p7d\" (UniqueName: \"kubernetes.io/projected/33a7b06f-c318-4404-8309-90c6a5b2b4a3-kube-api-access-q2p7d\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 14:01:47.344790 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:47.344611    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33a7b06f-c318-4404-8309-90c6a5b2b4a3-istiod-ca-cert\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\""
Jul 15 14:01:47.379577 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:47.379544    2578 generic.go:356] "Generic (PLEG): container finished" podID="33a7b06f-c318-4404-8309-90c6a5b2b4a3" containerID="c2deade54376f6aec1b4fb7de4d60c13898304554cb5133111b935a94329461d" exitCode=0
Jul 15 14:01:47.379705 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:47.379582    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n"
Jul 15 14:01:47.379705 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:47.379582    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n" event={"ID":"33a7b06f-c318-4404-8309-90c6a5b2b4a3","Type":"ContainerDied","Data":"c2deade54376f6aec1b4fb7de4d60c13898304554cb5133111b935a94329461d"}
Jul 15 14:01:47.379789 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:47.379715    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n" event={"ID":"33a7b06f-c318-4404-8309-90c6a5b2b4a3","Type":"ContainerDied","Data":"4313735919d54eddcf7dc4e2fac0b12aa9300fd6c044e8ce13218e0ceac15397"}
Jul 15 14:01:47.379789 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:47.379742    2578 scope.go:117] "RemoveContainer" containerID="c2deade54376f6aec1b4fb7de4d60c13898304554cb5133111b935a94329461d"
Jul 15 14:01:47.389288 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:47.389270    2578 scope.go:117] "RemoveContainer" containerID="6538ff19a8b72b9e1c17b06c1e91ce021406c24544bf0c654d5816f5f3de57a3"
Jul 15 14:01:47.397760 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:47.397744    2578 scope.go:117] "RemoveContainer" containerID="c2deade54376f6aec1b4fb7de4d60c13898304554cb5133111b935a94329461d"
Jul 15 14:01:47.397993 ip-10-0-128-159 kubenswrapper[2578]: E0715 14:01:47.397974    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2deade54376f6aec1b4fb7de4d60c13898304554cb5133111b935a94329461d\": container with ID starting with c2deade54376f6aec1b4fb7de4d60c13898304554cb5133111b935a94329461d not found: ID does not exist" containerID="c2deade54376f6aec1b4fb7de4d60c13898304554cb5133111b935a94329461d"
Jul 15 14:01:47.398069 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:47.398005    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2deade54376f6aec1b4fb7de4d60c13898304554cb5133111b935a94329461d"} err="failed to get container status \"c2deade54376f6aec1b4fb7de4d60c13898304554cb5133111b935a94329461d\": rpc error: code = NotFound desc = could not find container \"c2deade54376f6aec1b4fb7de4d60c13898304554cb5133111b935a94329461d\": container with ID starting with c2deade54376f6aec1b4fb7de4d60c13898304554cb5133111b935a94329461d not found: ID does not exist"
Jul 15 14:01:47.398069 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:47.398031    2578 scope.go:117] "RemoveContainer" containerID="6538ff19a8b72b9e1c17b06c1e91ce021406c24544bf0c654d5816f5f3de57a3"
Jul 15 14:01:47.398277 ip-10-0-128-159 kubenswrapper[2578]: E0715 14:01:47.398256    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6538ff19a8b72b9e1c17b06c1e91ce021406c24544bf0c654d5816f5f3de57a3\": container with ID starting with 6538ff19a8b72b9e1c17b06c1e91ce021406c24544bf0c654d5816f5f3de57a3 not found: ID does not exist" containerID="6538ff19a8b72b9e1c17b06c1e91ce021406c24544bf0c654d5816f5f3de57a3"
Jul 15 14:01:47.398328 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:47.398288    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6538ff19a8b72b9e1c17b06c1e91ce021406c24544bf0c654d5816f5f3de57a3"} err="failed to get container status \"6538ff19a8b72b9e1c17b06c1e91ce021406c24544bf0c654d5816f5f3de57a3\": rpc error: code = NotFound desc = could not find container \"6538ff19a8b72b9e1c17b06c1e91ce021406c24544bf0c654d5816f5f3de57a3\": container with ID starting with 6538ff19a8b72b9e1c17b06c1e91ce021406c24544bf0c654d5816f5f3de57a3 not found: ID does not exist"
Jul 15 14:01:47.407456 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:47.407424    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n"]
Jul 15 14:01:47.413117 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:47.413099    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-8c00d1-openshift-default-694dccc59f-q4v4n"]
Jul 15 14:01:48.375456 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:01:48.375413    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33a7b06f-c318-4404-8309-90c6a5b2b4a3" path="/var/lib/kubelet/pods/33a7b06f-c318-4404-8309-90c6a5b2b4a3/volumes"
Jul 15 14:02:14.753569 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:14.753495    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f7f774c7f-kd8s4_bade1880-aa01-4b14-af8c-fd371573ae59/copy-manifests/0.log"
Jul 15 14:02:14.772396 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:14.772365    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f7f774c7f-kd8s4_bade1880-aa01-4b14-af8c-fd371573ae59/manager/0.log"
Jul 15 14:02:15.279302 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:15.279257    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-65bf6b495c-d8225_71bc0d31-17e3-46bc-b44c-4301ae1d7b72/maas-api/0.log"
Jul 15 14:02:17.915620 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:17.915591    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759trpkn_41b88d50-8e20-41ab-b16f-e2afb8ca9815/util/0.log"
Jul 15 14:02:17.922436 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:17.922411    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759trpkn_41b88d50-8e20-41ab-b16f-e2afb8ca9815/pull/0.log"
Jul 15 14:02:17.927653 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:17.927626    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759trpkn_41b88d50-8e20-41ab-b16f-e2afb8ca9815/extract/0.log"
Jul 15 14:02:18.041472 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:18.041441    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05r9cs_6b8bc7ef-7a64-43ee-863c-7bfe22851f03/util/0.log"
Jul 15 14:02:18.047991 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:18.047970    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05r9cs_6b8bc7ef-7a64-43ee-863c-7bfe22851f03/pull/0.log"
Jul 15 14:02:18.053992 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:18.053974    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05r9cs_6b8bc7ef-7a64-43ee-863c-7bfe22851f03/extract/0.log"
Jul 15 14:02:18.166993 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:18.166917    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736glz6_9a56bdd9-ada6-43be-bfa4-cce886e45c67/util/0.log"
Jul 15 14:02:18.172822 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:18.172797    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736glz6_9a56bdd9-ada6-43be-bfa4-cce886e45c67/pull/0.log"
Jul 15 14:02:18.178292 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:18.178273    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736glz6_9a56bdd9-ada6-43be-bfa4-cce886e45c67/extract/0.log"
Jul 15 14:02:18.286988 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:18.286950    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12j2kz_bd219c47-32b2-47bc-b1c8-3a0c87d641bc/util/0.log"
Jul 15 14:02:18.293308 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:18.293288    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12j2kz_bd219c47-32b2-47bc-b1c8-3a0c87d641bc/pull/0.log"
Jul 15 14:02:18.298629 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:18.298607    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12j2kz_bd219c47-32b2-47bc-b1c8-3a0c87d641bc/extract/0.log"
Jul 15 14:02:19.671914 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:19.671878    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678986s8_a9ba2ba5-446b-40cf-9af9-7e5012f717df/istio-proxy/0.log"
Jul 15 14:02:20.020591 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:20.020554    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-78dd6b4fb5-pzxw7_0d58d809-78e5-42cd-958a-2ea9d273a160/kube-auth-proxy/0.log"
Jul 15 14:02:20.276891 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:20.276810    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-xm5qw_dbe59ffc-3cf4-474d-885f-1834195492ed/payload-pre-processing/0.log"
Jul 15 14:02:20.519768 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:20.519739    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-8db99c4db-qzshk_0f8a6a75-cdcf-4264-8e27-6a0af529b5b2/router/0.log"
Jul 15 14:02:21.122258 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:21.122224    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-kfkgd_98010981-e654-42c0-974b-5543f0976fff/main/0.log"
Jul 15 14:02:21.372144 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:21.372119    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-n7rvz_c5c411c1-1945-4ad5-a956-a181c353a54f/main/0.log"
Jul 15 14:02:21.497921 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:21.497891    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-2rh8w_9579ecb6-73dc-4cfc-98c6-7af7959da1f7/main/0.log"
Jul 15 14:02:29.237292 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:29.237256    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-c8fxj_1415012e-b242-427c-a9b8-6950353b06a4/global-pull-secret-syncer/0.log"
Jul 15 14:02:29.375152 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:29.375114    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xpsbk_8b3c491a-f49d-405c-adf0-a1c12886786e/konnectivity-agent/0.log"
Jul 15 14:02:29.490743 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:29.490659    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-159.ec2.internal_176fec2e1fa731a8b2c054cee79a9e44/haproxy/0.log"
Jul 15 14:02:33.993541 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:33.993506    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759trpkn_41b88d50-8e20-41ab-b16f-e2afb8ca9815/extract/0.log"
Jul 15 14:02:34.072611 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:34.072583    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759trpkn_41b88d50-8e20-41ab-b16f-e2afb8ca9815/util/0.log"
Jul 15 14:02:34.112412 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:34.112373    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759trpkn_41b88d50-8e20-41ab-b16f-e2afb8ca9815/pull/0.log"
Jul 15 14:02:34.171819 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:34.171793    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05r9cs_6b8bc7ef-7a64-43ee-863c-7bfe22851f03/extract/0.log"
Jul 15 14:02:34.228364 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:34.228335    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05r9cs_6b8bc7ef-7a64-43ee-863c-7bfe22851f03/util/0.log"
Jul 15 14:02:34.281344 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:34.281257    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05r9cs_6b8bc7ef-7a64-43ee-863c-7bfe22851f03/pull/0.log"
Jul 15 14:02:34.317444 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:34.317411    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736glz6_9a56bdd9-ada6-43be-bfa4-cce886e45c67/extract/0.log"
Jul 15 14:02:34.349853 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:34.349827    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736glz6_9a56bdd9-ada6-43be-bfa4-cce886e45c67/util/0.log"
Jul 15 14:02:34.379982 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:34.379953    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736glz6_9a56bdd9-ada6-43be-bfa4-cce886e45c67/pull/0.log"
Jul 15 14:02:34.409256 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:34.409222    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12j2kz_bd219c47-32b2-47bc-b1c8-3a0c87d641bc/extract/0.log"
Jul 15 14:02:34.433446 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:34.433419    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12j2kz_bd219c47-32b2-47bc-b1c8-3a0c87d641bc/util/0.log"
Jul 15 14:02:34.462505 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:34.462482    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12j2kz_bd219c47-32b2-47bc-b1c8-3a0c87d641bc/pull/0.log"
Jul 15 14:02:37.333955 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:37.333921    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-cjgpm_56a94de7-8c93-43ae-a4b2-929d78711ac8/cluster-monitoring-operator/0.log"
Jul 15 14:02:37.467213 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:37.467168    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7f5749f9c8-kdckd_94c7361e-367a-4ff2-a93d-0dd75ae177ea/metrics-server/0.log"
Jul 15 14:02:37.505143 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:37.505112    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-t2tnc_deaf0540-4a33-44b6-9fe7-adc58510c7b8/monitoring-plugin/0.log"
Jul 15 14:02:37.641630 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:37.641550    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4s85b_692752da-6638-487b-80ea-588592654ef1/node-exporter/0.log"
Jul 15 14:02:37.668149 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:37.668125    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4s85b_692752da-6638-487b-80ea-588592654ef1/kube-rbac-proxy/0.log"
Jul 15 14:02:37.694963 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:37.694932    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4s85b_692752da-6638-487b-80ea-588592654ef1/init-textfile/0.log"
Jul 15 14:02:38.153584 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:38.153551    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-m85z7_c95927ef-80cb-468c-bac6-ebfd22f92bdf/prometheus-operator/0.log"
Jul 15 14:02:38.173980 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:38.173947    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-m85z7_c95927ef-80cb-468c-bac6-ebfd22f92bdf/kube-rbac-proxy/0.log"
Jul 15 14:02:39.543509 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:39.543475    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mvswn/perf-node-gather-daemonset-sxbkg"]
Jul 15 14:02:39.543921 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:39.543839    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33a7b06f-c318-4404-8309-90c6a5b2b4a3" containerName="istio-proxy"
Jul 15 14:02:39.543921 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:39.543853    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="33a7b06f-c318-4404-8309-90c6a5b2b4a3" containerName="istio-proxy"
Jul 15 14:02:39.543921 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:39.543867    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33a7b06f-c318-4404-8309-90c6a5b2b4a3" containerName="istio-proxy"
Jul 15 14:02:39.543921 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:39.543873    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="33a7b06f-c318-4404-8309-90c6a5b2b4a3" containerName="istio-proxy"
Jul 15 14:02:39.543921 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:39.543880    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09134659-e74e-458d-b302-507cbbf398d0" containerName="test-curl-7757-140715318531824"
Jul 15 14:02:39.543921 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:39.543886    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="09134659-e74e-458d-b302-507cbbf398d0" containerName="test-curl-7757-140715318531824"
Jul 15 14:02:39.543921 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:39.543900    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa8a1693-b52b-4cd8-a7b1-2d2692ead306" containerName="main"
Jul 15 14:02:39.543921 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:39.543907    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa8a1693-b52b-4cd8-a7b1-2d2692ead306" containerName="main"
Jul 15 14:02:39.544283 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:39.543962    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="09134659-e74e-458d-b302-507cbbf398d0" containerName="test-curl-7757-140715318531824"
Jul 15 14:02:39.544283 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:39.543971    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="33a7b06f-c318-4404-8309-90c6a5b2b4a3" containerName="istio-proxy"
Jul 15 14:02:39.544283 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:39.543978    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa8a1693-b52b-4cd8-a7b1-2d2692ead306" containerName="main"
Jul 15 14:02:39.547142 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:39.547124    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-sxbkg"
Jul 15 14:02:39.549751 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:39.549730    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mvswn\"/\"kube-root-ca.crt\""
Jul 15 14:02:39.549892 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:39.549871    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mvswn\"/\"openshift-service-ca.crt\""
Jul 15 14:02:39.551134 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:39.551113    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mvswn\"/\"default-dockercfg-9z4gh\""
Jul 15 14:02:39.559988 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:39.559965    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mvswn/perf-node-gather-daemonset-sxbkg"]
Jul 15 14:02:39.588559 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:39.588526    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/88f632b6-7f19-49f2-b8d3-91202cb011b0-sys\") pod \"perf-node-gather-daemonset-sxbkg\" (UID: \"88f632b6-7f19-49f2-b8d3-91202cb011b0\") " pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-sxbkg"
Jul 15 14:02:39.588771 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:39.588610    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/88f632b6-7f19-49f2-b8d3-91202cb011b0-proc\") pod \"perf-node-gather-daemonset-sxbkg\" (UID: \"88f632b6-7f19-49f2-b8d3-91202cb011b0\") " pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-sxbkg"
Jul 15 14:02:39.588771 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:39.588661    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pfdb\" (UniqueName: \"kubernetes.io/projected/88f632b6-7f19-49f2-b8d3-91202cb011b0-kube-api-access-9pfdb\") pod \"perf-node-gather-daemonset-sxbkg\" (UID: \"88f632b6-7f19-49f2-b8d3-91202cb011b0\") " pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-sxbkg"
Jul 15 14:02:39.588771 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:39.588697    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/88f632b6-7f19-49f2-b8d3-91202cb011b0-lib-modules\") pod \"perf-node-gather-daemonset-sxbkg\" (UID: \"88f632b6-7f19-49f2-b8d3-91202cb011b0\") " pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-sxbkg"
Jul 15 14:02:39.588771 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:39.588718    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/88f632b6-7f19-49f2-b8d3-91202cb011b0-podres\") pod \"perf-node-gather-daemonset-sxbkg\" (UID: \"88f632b6-7f19-49f2-b8d3-91202cb011b0\") " pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-sxbkg"
Jul 15 14:02:39.689294 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:39.689258    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/88f632b6-7f19-49f2-b8d3-91202cb011b0-podres\") pod \"perf-node-gather-daemonset-sxbkg\" (UID: \"88f632b6-7f19-49f2-b8d3-91202cb011b0\") " pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-sxbkg"
Jul 15 14:02:39.689474 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:39.689318    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/88f632b6-7f19-49f2-b8d3-91202cb011b0-sys\") pod \"perf-node-gather-daemonset-sxbkg\" (UID: \"88f632b6-7f19-49f2-b8d3-91202cb011b0\") " pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-sxbkg"
Jul 15 14:02:39.689474 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:39.689365    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/88f632b6-7f19-49f2-b8d3-91202cb011b0-proc\") pod \"perf-node-gather-daemonset-sxbkg\" (UID: \"88f632b6-7f19-49f2-b8d3-91202cb011b0\") " pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-sxbkg"
Jul 15 14:02:39.689474 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:39.689391    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/88f632b6-7f19-49f2-b8d3-91202cb011b0-sys\") pod \"perf-node-gather-daemonset-sxbkg\" (UID: \"88f632b6-7f19-49f2-b8d3-91202cb011b0\") " pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-sxbkg"
Jul 15 14:02:39.689474 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:39.689396    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pfdb\" (UniqueName: \"kubernetes.io/projected/88f632b6-7f19-49f2-b8d3-91202cb011b0-kube-api-access-9pfdb\") pod \"perf-node-gather-daemonset-sxbkg\" (UID: \"88f632b6-7f19-49f2-b8d3-91202cb011b0\") " pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-sxbkg"
Jul 15 14:02:39.689474 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:39.689425    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/88f632b6-7f19-49f2-b8d3-91202cb011b0-podres\") pod \"perf-node-gather-daemonset-sxbkg\" (UID: \"88f632b6-7f19-49f2-b8d3-91202cb011b0\") " pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-sxbkg"
Jul 15 14:02:39.689665 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:39.689474    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/88f632b6-7f19-49f2-b8d3-91202cb011b0-proc\") pod \"perf-node-gather-daemonset-sxbkg\" (UID: \"88f632b6-7f19-49f2-b8d3-91202cb011b0\") " pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-sxbkg"
Jul 15 14:02:39.689665 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:39.689478    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/88f632b6-7f19-49f2-b8d3-91202cb011b0-lib-modules\") pod \"perf-node-gather-daemonset-sxbkg\" (UID: \"88f632b6-7f19-49f2-b8d3-91202cb011b0\") " pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-sxbkg"
Jul 15 14:02:39.689665 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:39.689546    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/88f632b6-7f19-49f2-b8d3-91202cb011b0-lib-modules\") pod \"perf-node-gather-daemonset-sxbkg\" (UID: \"88f632b6-7f19-49f2-b8d3-91202cb011b0\") " pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-sxbkg"
Jul 15 14:02:39.698233 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:39.698190    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pfdb\" (UniqueName: \"kubernetes.io/projected/88f632b6-7f19-49f2-b8d3-91202cb011b0-kube-api-access-9pfdb\") pod \"perf-node-gather-daemonset-sxbkg\" (UID: \"88f632b6-7f19-49f2-b8d3-91202cb011b0\") " pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-sxbkg"
Jul 15 14:02:39.766028 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:39.765991    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-cpc58_9f41e77d-33d2-4d77-a15e-9d8e59a98d6b/networking-console-plugin/0.log"
Jul 15 14:02:39.856943 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:39.856853    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-sxbkg"
Jul 15 14:02:39.997358 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:39.997330    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mvswn/perf-node-gather-daemonset-sxbkg"]
Jul 15 14:02:39.999225 ip-10-0-128-159 kubenswrapper[2578]: W0715 14:02:39.999174    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod88f632b6_7f19_49f2_b8d3_91202cb011b0.slice/crio-88eb5b5264214c7fa0da0f2fca59ca6d861d87e201861dbd24999c9e342c3e8e WatchSource:0}: Error finding container 88eb5b5264214c7fa0da0f2fca59ca6d861d87e201861dbd24999c9e342c3e8e: Status 404 returned error can't find the container with id 88eb5b5264214c7fa0da0f2fca59ca6d861d87e201861dbd24999c9e342c3e8e
Jul 15 14:02:40.400875 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:40.400794    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-t4bfh_c21b11d6-3242-4dd5-8b75-74dad14868e9/console-operator/1.log"
Jul 15 14:02:40.408537 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:40.408506    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-t4bfh_c21b11d6-3242-4dd5-8b75-74dad14868e9/console-operator/2.log"
Jul 15 14:02:40.666408 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:40.666312    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-sxbkg" event={"ID":"88f632b6-7f19-49f2-b8d3-91202cb011b0","Type":"ContainerStarted","Data":"90d841065c57385972c4a2fb240419f1e86d52895bc0f0096b71505024cba712"}
Jul 15 14:02:40.666806 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:40.666469    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-sxbkg"
Jul 15 14:02:40.666806 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:40.666516    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-sxbkg" event={"ID":"88f632b6-7f19-49f2-b8d3-91202cb011b0","Type":"ContainerStarted","Data":"88eb5b5264214c7fa0da0f2fca59ca6d861d87e201861dbd24999c9e342c3e8e"}
Jul 15 14:02:40.686864 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:40.686816    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-sxbkg" podStartSLOduration=1.686800812 podStartE2EDuration="1.686800812s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 14:02:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:02:40.684869846 +0000 UTC m=+3080.772656798" watchObservedRunningTime="2026-07-15 14:02:40.686800812 +0000 UTC m=+3080.774587755"
Jul 15 14:02:41.743797 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:41.743735    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-xj7ht_ddd87030-16d4-4f45-ab5e-e1ddd7d01983/volume-data-source-validator/0.log"
Jul 15 14:02:43.121822 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:43.121793    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wqxcc_6b061bb5-718d-4fed-9076-9668e21d4b13/dns/0.log"
Jul 15 14:02:43.146332 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:43.146304    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wqxcc_6b061bb5-718d-4fed-9076-9668e21d4b13/kube-rbac-proxy/0.log"
Jul 15 14:02:43.245418 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:43.245393    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wdgw4_56d93a5b-2111-4969-9ef3-9e58f7e2cb82/dns-node-resolver/0.log"
Jul 15 14:02:43.856647 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:43.856611    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9lrlb_740cd63d-7aa0-464d-be90-87aea6674efa/node-ca/0.log"
Jul 15 14:02:44.935346 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:44.935314    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678986s8_a9ba2ba5-446b-40cf-9af9-7e5012f717df/istio-proxy/0.log"
Jul 15 14:02:45.210563 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:45.210530    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-78dd6b4fb5-pzxw7_0d58d809-78e5-42cd-958a-2ea9d273a160/kube-auth-proxy/0.log"
Jul 15 14:02:45.351700 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:45.351670    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-xm5qw_dbe59ffc-3cf4-474d-885f-1834195492ed/payload-pre-processing/0.log"
Jul 15 14:02:45.426414 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:45.426389    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-8db99c4db-qzshk_0f8a6a75-cdcf-4264-8e27-6a0af529b5b2/router/0.log"
Jul 15 14:02:46.190966 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:46.190936    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fp5hs_5920a816-5d9e-4020-a084-a84faf51ca5d/serve-healthcheck-canary/0.log"
Jul 15 14:02:46.682458 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:46.682428    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-sxbkg"
Jul 15 14:02:46.864552 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:46.864517    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-5vp9j_46f6ef45-16e7-486e-a44f-6284f36e2add/insights-operator/0.log"
Jul 15 14:02:46.864928 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:46.864903    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-5vp9j_46f6ef45-16e7-486e-a44f-6284f36e2add/insights-operator/1.log"
Jul 15 14:02:46.929999 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:46.929969    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7q4kb_e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810/kube-rbac-proxy/0.log"
Jul 15 14:02:47.007423 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:47.007392    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7q4kb_e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810/exporter/0.log"
Jul 15 14:02:47.103325 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:47.103297    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7q4kb_e0ec29bb-51e2-4e7d-99ad-a5fc19f9c810/extractor/0.log"
Jul 15 14:02:50.474919 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:50.474888    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678986s8_a9ba2ba5-446b-40cf-9af9-7e5012f717df/istio-proxy/0.log"
Jul 15 14:02:50.732653 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:50.732580    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-78dd6b4fb5-pzxw7_0d58d809-78e5-42cd-958a-2ea9d273a160/kube-auth-proxy/0.log"
Jul 15 14:02:50.761464 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:50.761435    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f7f774c7f-kd8s4_bade1880-aa01-4b14-af8c-fd371573ae59/manager/0.log"
Jul 15 14:02:50.794464 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:50.794441    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f7f774c7f-kd8s4_bade1880-aa01-4b14-af8c-fd371573ae59/copy-manifests/0.log"
Jul 15 14:02:50.851580 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:50.851551    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-xm5qw_dbe59ffc-3cf4-474d-885f-1834195492ed/payload-pre-processing/0.log"
Jul 15 14:02:50.903038 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:50.903011    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-8db99c4db-qzshk_0f8a6a75-cdcf-4264-8e27-6a0af529b5b2/router/0.log"
Jul 15 14:02:52.202323 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:52.202283    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7557b79948-t48hq_23a225cb-5a6d-4cf6-8770-def8ec6794af/manager/0.log"
Jul 15 14:02:52.260043 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:52.260010    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-9wqrl_09de1eb0-0f47-4e76-91bd-9256aa4b2e8b/openshift-lws-operator/0.log"
Jul 15 14:02:52.335764 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:52.335720    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678986s8_a9ba2ba5-446b-40cf-9af9-7e5012f717df/istio-proxy/0.log"
Jul 15 14:02:52.570173 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:52.570148    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-78dd6b4fb5-pzxw7_0d58d809-78e5-42cd-958a-2ea9d273a160/kube-auth-proxy/0.log"
Jul 15 14:02:52.680491 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:52.680462    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-xm5qw_dbe59ffc-3cf4-474d-885f-1834195492ed/payload-pre-processing/0.log"
Jul 15 14:02:52.740568 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:52.740541    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-8db99c4db-qzshk_0f8a6a75-cdcf-4264-8e27-6a0af529b5b2/router/0.log"
Jul 15 14:02:57.238058 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:57.238024    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-6p996_e83f8574-d32c-43ff-bd55-3178f6df8031/migrator/0.log"
Jul 15 14:02:57.268969 ip-10-0-128-159 kubenswrapper[2578]: I0715 14:02:57.268938    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-6p996_e83f8574-d32c-43ff-bd55-3178f6df8031/graceful-termination/0.log"