Jul 06 14:23:14.897963 ip-10-0-138-90 systemd[1]: Starting Kubernetes Kubelet...
Jul 06 14:23:17.727452 ip-10-0-138-90 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 14:23:17.727452 ip-10-0-138-90 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 06 14:23:17.727452 ip-10-0-138-90 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 14:23:17.727452 ip-10-0-138-90 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 06 14:23:17.727452 ip-10-0-138-90 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 14:23:17.728059 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.727463    2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 06 14:23:17.731973 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.731958    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 14:23:17.731973 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.731973    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 14:23:17.732040 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.731977    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 14:23:17.732040 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.731980    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 14:23:17.732040 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.731984    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 14:23:17.732040 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.731987    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 14:23:17.732040 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.731990    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 14:23:17.732040 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.731992    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 14:23:17.732040 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.731995    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 14:23:17.732040 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.731998    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 14:23:17.732040 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732000    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 14:23:17.732040 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732003    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 14:23:17.732040 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732006    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 14:23:17.732040 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732009    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 14:23:17.732040 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732011    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 14:23:17.732040 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732014    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 14:23:17.732040 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732017    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 14:23:17.732040 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732019    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 14:23:17.732040 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732022    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 14:23:17.732040 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732034    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 14:23:17.732040 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732037    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 14:23:17.732498 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732040    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 14:23:17.732498 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732043    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 14:23:17.732498 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732045    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 14:23:17.732498 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732048    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 14:23:17.732498 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732051    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 14:23:17.732498 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732054    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 14:23:17.732498 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732057    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 14:23:17.732498 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732060    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 14:23:17.732498 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732063    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 14:23:17.732498 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732066    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 14:23:17.732498 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732068    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 14:23:17.732498 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732071    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 14:23:17.732498 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732075    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 14:23:17.732498 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732079    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 14:23:17.732498 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732082    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 14:23:17.732498 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732085    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 14:23:17.732498 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732088    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 14:23:17.732498 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732090    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 14:23:17.732498 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732093    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 14:23:17.732498 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732095    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 14:23:17.732960 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732098    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 14:23:17.732960 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732101    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 14:23:17.732960 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732103    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 14:23:17.732960 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732106    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 14:23:17.732960 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732109    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 14:23:17.732960 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732112    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 14:23:17.732960 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732114    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 14:23:17.732960 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732117    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 14:23:17.732960 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732119    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 14:23:17.732960 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732122    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 14:23:17.732960 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732124    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 14:23:17.732960 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732128    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 14:23:17.732960 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732130    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 14:23:17.732960 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732134    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 14:23:17.732960 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732137    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 14:23:17.732960 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732140    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 14:23:17.732960 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732143    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 14:23:17.732960 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732145    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 14:23:17.732960 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732147    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 14:23:17.732960 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732150    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 14:23:17.733472 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732153    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 14:23:17.733472 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732156    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 14:23:17.733472 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732158    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 14:23:17.733472 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732161    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 14:23:17.733472 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732163    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 14:23:17.733472 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732165    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 14:23:17.733472 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732169    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 14:23:17.733472 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732173    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 14:23:17.733472 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732176    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 14:23:17.733472 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732179    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 14:23:17.733472 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732182    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 14:23:17.733472 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732184    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 14:23:17.733472 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732187    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 14:23:17.733472 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732189    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 14:23:17.733472 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732192    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 14:23:17.733472 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732194    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 14:23:17.733472 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732197    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 14:23:17.733472 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732199    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 14:23:17.733472 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732202    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 14:23:17.733909 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732204    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 14:23:17.733909 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732207    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 14:23:17.733909 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732209    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 14:23:17.733909 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732212    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 14:23:17.733909 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732215    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 14:23:17.733909 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732219    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 14:23:17.733909 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732222    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 14:23:17.733909 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732227    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 14:23:17.733909 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732230    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 14:23:17.733909 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732233    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 14:23:17.733909 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732236    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 14:23:17.733909 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732238    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 14:23:17.733909 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732241    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 14:23:17.733909 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732244    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 14:23:17.733909 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732246    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 14:23:17.733909 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732249    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 14:23:17.733909 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732251    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 14:23:17.733909 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732254    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 14:23:17.733909 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.732256    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 14:23:17.734586 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734574    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 14:23:17.734586 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734587    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 14:23:17.734640 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734591    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 14:23:17.734640 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734595    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 14:23:17.734640 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734598    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 14:23:17.734640 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734601    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 14:23:17.734640 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734604    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 14:23:17.734640 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734607    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 14:23:17.734640 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734610    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 14:23:17.734640 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734613    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 14:23:17.734640 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734616    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 14:23:17.734640 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734619    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 14:23:17.734640 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734622    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 14:23:17.734640 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734625    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 14:23:17.734640 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734627    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 14:23:17.734640 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734630    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 14:23:17.734640 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734633    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 14:23:17.734640 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734635    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 14:23:17.734640 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734638    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 14:23:17.734640 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734641    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 14:23:17.734640 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734644    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 14:23:17.734640 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734647    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 14:23:17.735115 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734650    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 14:23:17.735115 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734652    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 14:23:17.735115 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734655    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 14:23:17.735115 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734658    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 14:23:17.735115 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734660    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 14:23:17.735115 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734663    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 14:23:17.735115 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734665    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 14:23:17.735115 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734667    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 14:23:17.735115 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734670    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 14:23:17.735115 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734672    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 14:23:17.735115 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734674    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 14:23:17.735115 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734677    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 14:23:17.735115 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734679    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 14:23:17.735115 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734682    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 14:23:17.735115 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734684    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 14:23:17.735115 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734686    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 14:23:17.735115 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734689    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 14:23:17.735115 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734691    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 14:23:17.735115 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734693    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 14:23:17.735115 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734696    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 14:23:17.735643 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734700    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 14:23:17.735643 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734703    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 14:23:17.735643 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734706    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 14:23:17.735643 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734709    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 14:23:17.735643 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734711    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 14:23:17.735643 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734714    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 14:23:17.735643 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734716    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 14:23:17.735643 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734719    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 14:23:17.735643 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734721    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 14:23:17.735643 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734723    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 14:23:17.735643 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734726    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 14:23:17.735643 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734729    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 14:23:17.735643 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734732    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 14:23:17.735643 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734735    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 14:23:17.735643 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734737    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 14:23:17.735643 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734740    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 14:23:17.735643 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734743    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 14:23:17.735643 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734745    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 14:23:17.735643 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734748    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 14:23:17.735643 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734750    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 14:23:17.736127 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734753    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 14:23:17.736127 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734755    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 14:23:17.736127 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734758    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 14:23:17.736127 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734760    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 14:23:17.736127 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734762    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 14:23:17.736127 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734765    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 14:23:17.736127 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734767    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 14:23:17.736127 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734770    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 14:23:17.736127 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734772    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 14:23:17.736127 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734774    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 14:23:17.736127 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734777    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 14:23:17.736127 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734779    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 14:23:17.736127 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734782    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 14:23:17.736127 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734784    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 14:23:17.736127 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734787    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 14:23:17.736127 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734789    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 14:23:17.736127 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734792    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 14:23:17.736127 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734794    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 14:23:17.736127 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734797    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 14:23:17.736127 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734800    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 14:23:17.736624 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734802    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 14:23:17.736624 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734807    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 14:23:17.736624 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734810    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 14:23:17.736624 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734813    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 14:23:17.736624 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734816    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 14:23:17.736624 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734820    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 14:23:17.736624 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734823    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 14:23:17.736624 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734825    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 14:23:17.736624 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734828    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 14:23:17.736624 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734830    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 14:23:17.736624 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734833    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 14:23:17.736624 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734835    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 14:23:17.736624 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734838    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 14:23:17.736624 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734840    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 14:23:17.736624 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734842    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 14:23:17.736624 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734845    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 14:23:17.736624 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.734847    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 14:23:17.736624 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735759    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 14:23:17.736624 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735767    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 14:23:17.737094 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735770    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 14:23:17.737094 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735774    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 14:23:17.737094 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735777    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 14:23:17.737094 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735780    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 14:23:17.737094 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735783    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 14:23:17.737094 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735786    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 14:23:17.737094 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735788    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 14:23:17.737094 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735791    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 14:23:17.737094 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735793    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 14:23:17.737094 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735796    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 14:23:17.737094 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735799    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 14:23:17.737094 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735801    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 14:23:17.737094 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735804    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 14:23:17.737094 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735807    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 14:23:17.737094 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735810    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 14:23:17.737094 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735812    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 14:23:17.737094 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735817    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 14:23:17.737094 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735820    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 14:23:17.737094 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735823    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 14:23:17.737094 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735826    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 14:23:17.737865 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735829    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 14:23:17.737865 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735832    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 14:23:17.737865 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735834    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 14:23:17.737865 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735836    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 14:23:17.737865 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735839    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 14:23:17.737865 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735841    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 14:23:17.737865 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735844    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 14:23:17.737865 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735846    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 14:23:17.737865 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735849    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 14:23:17.737865 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735852    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 14:23:17.737865 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735855    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 14:23:17.737865 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735857    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 14:23:17.737865 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735860    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 14:23:17.737865 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735863    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 14:23:17.737865 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735865    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 14:23:17.737865 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735868    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 14:23:17.737865 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735871    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 14:23:17.737865 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735873    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 14:23:17.737865 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735875    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 14:23:17.737865 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735878    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 14:23:17.738537 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735880    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 14:23:17.738537 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735883    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 14:23:17.738537 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735885    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 14:23:17.738537 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735888    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 14:23:17.738537 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735890    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 14:23:17.738537 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735893    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 14:23:17.738537 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735895    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 14:23:17.738537 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735897    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 14:23:17.738537 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735900    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 14:23:17.738537 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735903    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 14:23:17.738537 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735905    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 14:23:17.738537 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735908    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 14:23:17.738537 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735911    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 14:23:17.738537 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735920    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 14:23:17.738537 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735922    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 14:23:17.738537 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735925    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 14:23:17.738537 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735928    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 14:23:17.738537 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735930    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 14:23:17.738537 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735934    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 14:23:17.738537 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735938    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 14:23:17.739021 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735941    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 14:23:17.739021 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735945    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 14:23:17.739021 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735948    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 14:23:17.739021 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735951    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 14:23:17.739021 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735954    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 14:23:17.739021 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735958    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 14:23:17.739021 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735962    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 14:23:17.739021 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735966    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 14:23:17.739021 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735968    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 14:23:17.739021 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735971    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 14:23:17.739021 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735973    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 14:23:17.739021 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735976    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 14:23:17.739021 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735978    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 14:23:17.739021 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735981    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 14:23:17.739021 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735984    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 14:23:17.739021 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735986    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 14:23:17.739021 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735989    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 14:23:17.739021 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735993    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 14:23:17.739021 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735995    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 14:23:17.739490 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.735998    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 14:23:17.739490 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736000    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 14:23:17.739490 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736003    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 14:23:17.739490 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736006    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 14:23:17.739490 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736008    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 14:23:17.739490 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736011    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 14:23:17.739490 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736013    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 14:23:17.739490 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736016    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 14:23:17.739490 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736018    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 14:23:17.739490 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736021    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 14:23:17.739490 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736023    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 14:23:17.739490 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736025    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 14:23:17.739490 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736028    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 14:23:17.739490 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736030    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 14:23:17.739490 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736033    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 14:23:17.739490 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736036    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 14:23:17.739490 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736038    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 14:23:17.739490 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736041    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 14:23:17.739490 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736100    2565 flags.go:64] FLAG: --address="0.0.0.0"
Jul 06 14:23:17.739490 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736113    2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 06 14:23:17.739490 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736122    2565 flags.go:64] FLAG: --anonymous-auth="true"
Jul 06 14:23:17.739984 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736128    2565 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 06 14:23:17.739984 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736134    2565 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 06 14:23:17.739984 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736139    2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 06 14:23:17.739984 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736145    2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 06 14:23:17.739984 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736150    2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 06 14:23:17.739984 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736153    2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 06 14:23:17.739984 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736156    2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 06 14:23:17.739984 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736160    2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 06 14:23:17.739984 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736163    2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 06 14:23:17.739984 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736166    2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 06 14:23:17.739984 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736169    2565 flags.go:64] FLAG: --cgroup-root=""
Jul 06 14:23:17.739984 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736172    2565 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 06 14:23:17.739984 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736177    2565 flags.go:64] FLAG: --client-ca-file=""
Jul 06 14:23:17.739984 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736180    2565 flags.go:64] FLAG: --cloud-provider="external"
Jul 06 14:23:17.739984 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736183    2565 flags.go:64] FLAG: --cluster-dns="[]"
Jul 06 14:23:17.739984 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736188    2565 flags.go:64] FLAG: --cluster-domain=""
Jul 06 14:23:17.739984 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736191    2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 06 14:23:17.739984 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736194    2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 06 14:23:17.739984 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736197    2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 06 14:23:17.739984 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736200    2565 flags.go:64] FLAG: --container-log-max-files="5"
Jul 06 14:23:17.739984 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736204    2565 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 06 14:23:17.739984 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736207    2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 06 14:23:17.739984 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736210    2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 06 14:23:17.740541 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736213    2565 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 06 14:23:17.740541 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736216    2565 flags.go:64] FLAG: --contention-profiling="false"
Jul 06 14:23:17.740541 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736219    2565 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 06 14:23:17.740541 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736222    2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 06 14:23:17.740541 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736225    2565 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 06 14:23:17.740541 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736228    2565 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 06 14:23:17.740541 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736244    2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 06 14:23:17.740541 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736248    2565 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 06 14:23:17.740541 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736254    2565 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 06 14:23:17.740541 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736257    2565 flags.go:64] FLAG: --enable-load-reader="false"
Jul 06 14:23:17.740541 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736260    2565 flags.go:64] FLAG: --enable-server="true"
Jul 06 14:23:17.740541 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736263    2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 06 14:23:17.740541 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736268    2565 flags.go:64] FLAG: --event-burst="100"
Jul 06 14:23:17.740541 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736271    2565 flags.go:64] FLAG: --event-qps="50"
Jul 06 14:23:17.740541 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736274    2565 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 06 14:23:17.740541 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736280    2565 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 06 14:23:17.740541 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736283    2565 flags.go:64] FLAG: --eviction-hard=""
Jul 06 14:23:17.740541 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736287    2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 06 14:23:17.740541 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736289    2565 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 06 14:23:17.740541 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736293    2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 06 14:23:17.740541 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736295    2565 flags.go:64] FLAG: --eviction-soft=""
Jul 06 14:23:17.740541 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736300    2565 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 06 14:23:17.740541 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736303    2565 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 06 14:23:17.740541 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736306    2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 06 14:23:17.740541 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736308    2565 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 06 14:23:17.741169 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736312    2565 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 06 14:23:17.741169 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736315    2565 flags.go:64] FLAG: --fail-swap-on="true"
Jul 06 14:23:17.741169 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736317    2565 flags.go:64] FLAG: --feature-gates=""
Jul 06 14:23:17.741169 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736321    2565 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 06 14:23:17.741169 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736324    2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 06 14:23:17.741169 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736327    2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 06 14:23:17.741169 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736330    2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 06 14:23:17.741169 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736333    2565 flags.go:64] FLAG: --healthz-port="10248"
Jul 06 14:23:17.741169 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736348    2565 flags.go:64] FLAG: --help="false"
Jul 06 14:23:17.741169 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736351    2565 flags.go:64] FLAG: --hostname-override="ip-10-0-138-90.ec2.internal"
Jul 06 14:23:17.741169 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736354    2565 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 06 14:23:17.741169 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736357    2565 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 06 14:23:17.741169 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736361    2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 06 14:23:17.741169 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736364    2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 06 14:23:17.741169 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736367    2565 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 06 14:23:17.741169 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736370    2565 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 06 14:23:17.741169 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736373    2565 flags.go:64] FLAG: --image-service-endpoint=""
Jul 06 14:23:17.741169 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736376    2565 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 06 14:23:17.741169 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736383    2565 flags.go:64] FLAG: --kube-api-burst="100"
Jul 06 14:23:17.741169 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736386    2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 06 14:23:17.741169 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736389    2565 flags.go:64] FLAG: --kube-api-qps="50"
Jul 06 14:23:17.741169 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736391    2565 flags.go:64] FLAG: --kube-reserved=""
Jul 06 14:23:17.741169 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736396    2565 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 06 14:23:17.741169 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736398    2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 06 14:23:17.741812 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736401    2565 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 06 14:23:17.741812 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736404    2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 06 14:23:17.741812 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736407    2565 flags.go:64] FLAG: --lock-file=""
Jul 06 14:23:17.741812 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736410    2565 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 06 14:23:17.741812 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736414    2565 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 06 14:23:17.741812 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736418    2565 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 06 14:23:17.741812 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736423    2565 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 06 14:23:17.741812 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736425    2565 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 06 14:23:17.741812 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736428    2565 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 06 14:23:17.741812 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736432    2565 flags.go:64] FLAG: --logging-format="text"
Jul 06 14:23:17.741812 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736434    2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 06 14:23:17.741812 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736438    2565 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 06 14:23:17.741812 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736441    2565 flags.go:64] FLAG: --manifest-url=""
Jul 06 14:23:17.741812 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736443    2565 flags.go:64] FLAG: --manifest-url-header=""
Jul 06 14:23:17.741812 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736447    2565 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 06 14:23:17.741812 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736450    2565 flags.go:64] FLAG: --max-open-files="1000000"
Jul 06 14:23:17.741812 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736454    2565 flags.go:64] FLAG: --max-pods="110"
Jul 06 14:23:17.741812 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736457    2565 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 06 14:23:17.741812 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736460    2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 06 14:23:17.741812 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736463    2565 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 06 14:23:17.741812 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736466    2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 06 14:23:17.741812 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736469    2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 06 14:23:17.741812 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736472    2565 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 06 14:23:17.741812 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736475    2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 06 14:23:17.741812 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736482    2565 flags.go:64] FLAG: --node-status-max-images="50"
Jul 06 14:23:17.742427 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736485    2565 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 06 14:23:17.742427 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736488    2565 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 06 14:23:17.742427 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736491    2565 flags.go:64] FLAG: --pod-cidr=""
Jul 06 14:23:17.742427 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736494    2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 06 14:23:17.742427 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736499    2565 flags.go:64] FLAG: --pod-manifest-path=""
Jul 06 14:23:17.742427 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736501    2565 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 06 14:23:17.742427 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736506    2565 flags.go:64] FLAG: --pods-per-core="0"
Jul 06 14:23:17.742427 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736508    2565 flags.go:64] FLAG: --port="10250"
Jul 06 14:23:17.742427 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736511    2565 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 06 14:23:17.742427 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736514    2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a25887ea116145fe"
Jul 06 14:23:17.742427 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736517    2565 flags.go:64] FLAG: --qos-reserved=""
Jul 06 14:23:17.742427 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736521    2565 flags.go:64] FLAG: --read-only-port="10255"
Jul 06 14:23:17.742427 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736524    2565 flags.go:64] FLAG: --register-node="true"
Jul 06 14:23:17.742427 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736527    2565 flags.go:64] FLAG: --register-with-taints=""
Jul 06 14:23:17.742427 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736530    2565 flags.go:64] FLAG: --registry-burst="10"
Jul 06 14:23:17.742427 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736533    2565 flags.go:64] FLAG: --registry-qps="5"
Jul 06 14:23:17.742427 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736536    2565 flags.go:64] FLAG: --reserved-cpus=""
Jul 06 14:23:17.742427 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736539    2565 flags.go:64] FLAG: --reserved-memory=""
Jul 06 14:23:17.742427 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736542    2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 06 14:23:17.742427 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736546    2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 06 14:23:17.742427 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736548    2565 flags.go:64] FLAG: --rotate-certificates="false"
Jul 06 14:23:17.742427 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736551    2565 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 06 14:23:17.742427 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736554    2565 flags.go:64] FLAG: --runonce="false"
Jul 06 14:23:17.742427 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736557    2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 06 14:23:17.742427 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736560    2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 06 14:23:17.743018 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736562    2565 flags.go:64] FLAG: --seccomp-default="false"
Jul 06 14:23:17.743018 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736565    2565 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 06 14:23:17.743018 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736568    2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 06 14:23:17.743018 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736571    2565 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 06 14:23:17.743018 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736574    2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 06 14:23:17.743018 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736577    2565 flags.go:64] FLAG: --storage-driver-password="root"
Jul 06 14:23:17.743018 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736579    2565 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 06 14:23:17.743018 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736582    2565 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 06 14:23:17.743018 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736585    2565 flags.go:64] FLAG: --storage-driver-user="root"
Jul 06 14:23:17.743018 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736588    2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 06 14:23:17.743018 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736592    2565 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 06 14:23:17.743018 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736594    2565 flags.go:64] FLAG: --system-cgroups=""
Jul 06 14:23:17.743018 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736597    2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 06 14:23:17.743018 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736605    2565 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 06 14:23:17.743018 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736607    2565 flags.go:64] FLAG: --tls-cert-file=""
Jul 06 14:23:17.743018 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736610    2565 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 06 14:23:17.743018 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736614    2565 flags.go:64] FLAG: --tls-min-version=""
Jul 06 14:23:17.743018 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736617    2565 flags.go:64] FLAG: --tls-private-key-file=""
Jul 06 14:23:17.743018 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736622    2565 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 06 14:23:17.743018 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736625    2565 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 06 14:23:17.743018 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736628    2565 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 06 14:23:17.743018 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736631    2565 flags.go:64] FLAG: --v="2"
Jul 06 14:23:17.743018 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736635    2565 flags.go:64] FLAG: --version="false"
Jul 06 14:23:17.743018 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736639    2565 flags.go:64] FLAG: --vmodule=""
Jul 06 14:23:17.743018 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736643    2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 06 14:23:17.743626 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.736647    2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 06 14:23:17.743626 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736762    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 14:23:17.743626 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736767    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 14:23:17.743626 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736770    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 14:23:17.743626 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736773    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 14:23:17.743626 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736776    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 14:23:17.743626 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736779    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 14:23:17.743626 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736781    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 14:23:17.743626 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736784    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 14:23:17.743626 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736787    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 14:23:17.743626 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736789    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 14:23:17.743626 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736792    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 14:23:17.743626 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736795    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 14:23:17.743626 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736797    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 14:23:17.743626 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736800    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 14:23:17.743626 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736804    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 14:23:17.743626 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736808    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 14:23:17.743626 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736810    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 14:23:17.743626 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736813    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 14:23:17.743626 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736816    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 14:23:17.744108 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736819    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 14:23:17.744108 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736821    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 14:23:17.744108 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736824    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 14:23:17.744108 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736827    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 14:23:17.744108 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736829    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 14:23:17.744108 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736832    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 14:23:17.744108 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736834    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 14:23:17.744108 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736837    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 14:23:17.744108 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736839    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 14:23:17.744108 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736842    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 14:23:17.744108 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736845    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 14:23:17.744108 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736848    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 14:23:17.744108 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736850    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 14:23:17.744108 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736853    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 14:23:17.744108 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736856    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 14:23:17.744108 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736858    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 14:23:17.744108 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736860    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 14:23:17.744108 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736863    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 14:23:17.744108 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736865    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 14:23:17.744108 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736868    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 14:23:17.744694 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736870    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 14:23:17.744694 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736873    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 14:23:17.744694 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736877    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 14:23:17.744694 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736880    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 14:23:17.744694 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736882    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 14:23:17.744694 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736885    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 14:23:17.744694 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736888    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 14:23:17.744694 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736891    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 14:23:17.744694 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736893    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 14:23:17.744694 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736896    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 14:23:17.744694 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736898    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 14:23:17.744694 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736901    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 14:23:17.744694 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736903    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 14:23:17.744694 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736906    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 14:23:17.744694 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736909    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 14:23:17.744694 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736911    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 14:23:17.744694 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736914    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 14:23:17.744694 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736916    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 14:23:17.744694 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736919    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 14:23:17.745163 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736921    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 14:23:17.745163 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736923    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 14:23:17.745163 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736926    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 14:23:17.745163 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736928    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 14:23:17.745163 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736931    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 14:23:17.745163 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736933    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 14:23:17.745163 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736936    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 14:23:17.745163 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.736983    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 14:23:17.745163 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.737944    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 14:23:17.745163 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.737960    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 14:23:17.745163 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.738123    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 14:23:17.745163 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.738130    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 14:23:17.745163 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.738134    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 14:23:17.745163 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.738137    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 14:23:17.745163 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.738141    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 14:23:17.745163 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.738144    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 14:23:17.745163 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.738147    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 14:23:17.745163 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.738150    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 14:23:17.745163 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.738152    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 14:23:17.745644 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.738155    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 14:23:17.745644 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.738158    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 14:23:17.745644 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.738160    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 14:23:17.745644 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.738163    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 14:23:17.745644 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.738166    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 14:23:17.745644 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.738168    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 14:23:17.745644 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.738171    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 14:23:17.745644 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.738173    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 14:23:17.745644 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.738176    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 14:23:17.745644 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.738178    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 14:23:17.745644 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.738181    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 14:23:17.745644 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.738183    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 14:23:17.745644 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.738185    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 14:23:17.745644 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.738188    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 14:23:17.745644 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.738191    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 14:23:17.745644 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.738193    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 14:23:17.745644 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.738198    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 14:23:17.745644 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.738201    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 14:23:17.745644 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.738203    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 14:23:17.745644 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.738206    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 14:23:17.746132 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.738208    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 14:23:17.746132 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.738211    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 14:23:17.746132 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.738825    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 14:23:17.746132 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.745887    2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 06 14:23:17.746132 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.745901    2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 06 14:23:17.746132 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.745919    2565 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 06 14:23:17.746132 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.745925    2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 06 14:23:17.746132 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.745982    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 14:23:17.746132 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.745987    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 14:23:17.746132 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.745991    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 14:23:17.746132 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.745994    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 14:23:17.746132 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.745997    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 14:23:17.746132 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746001    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 14:23:17.746132 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746005    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 14:23:17.746505 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746008    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 14:23:17.746505 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746011    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 14:23:17.746505 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746015    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 14:23:17.746505 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746019    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 14:23:17.746505 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746022    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 14:23:17.746505 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746025    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 14:23:17.746505 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746028    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 14:23:17.746505 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746032    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 14:23:17.746505 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746035    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 14:23:17.746505 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746037    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 14:23:17.746505 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746040    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 14:23:17.746505 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746043    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 14:23:17.746505 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746046    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 14:23:17.746505 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746049    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 14:23:17.746505 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746051    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 14:23:17.746505 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746054    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 14:23:17.746505 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746056    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 14:23:17.746505 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746059    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 14:23:17.746505 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746062    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 14:23:17.746505 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746064    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 14:23:17.746992 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746067    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 14:23:17.746992 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746069    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 14:23:17.746992 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746073    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 14:23:17.746992 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746076    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 14:23:17.746992 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746079    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 14:23:17.746992 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746082    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 14:23:17.746992 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746084    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 14:23:17.746992 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746087    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 14:23:17.746992 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746090    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 14:23:17.746992 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746092    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 14:23:17.746992 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746095    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 14:23:17.746992 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746097    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 14:23:17.746992 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746100    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 14:23:17.746992 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746102    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 14:23:17.746992 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746105    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 14:23:17.746992 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746108    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 14:23:17.746992 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746112    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 14:23:17.746992 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746115    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 14:23:17.746992 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746118    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 14:23:17.747514 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746121    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 14:23:17.747514 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746124    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 14:23:17.747514 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746126    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 14:23:17.747514 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746129    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 14:23:17.747514 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746131    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 14:23:17.747514 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746134    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 14:23:17.747514 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746137    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 14:23:17.747514 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746139    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 14:23:17.747514 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746142    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 14:23:17.747514 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746145    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 14:23:17.747514 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746147    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 14:23:17.747514 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746150    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 14:23:17.747514 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746152    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 14:23:17.747514 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746155    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 14:23:17.747514 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746157    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 14:23:17.747514 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746161    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 14:23:17.747514 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746164    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 14:23:17.747514 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746166    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 14:23:17.747514 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746169    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 14:23:17.747514 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746171    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 14:23:17.747976 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746174    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 14:23:17.747976 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746176    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 14:23:17.747976 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746179    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 14:23:17.747976 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746181    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 14:23:17.747976 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746184    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 14:23:17.747976 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746186    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 14:23:17.747976 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746189    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 14:23:17.747976 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746192    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 14:23:17.747976 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746194    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 14:23:17.747976 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746197    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 14:23:17.747976 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746200    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 14:23:17.747976 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746203    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 14:23:17.747976 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746205    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 14:23:17.747976 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746208    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 14:23:17.747976 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746210    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 14:23:17.747976 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746213    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 14:23:17.747976 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746215    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 14:23:17.747976 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746218    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 14:23:17.747976 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746220    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 14:23:17.748433 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746223    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 14:23:17.748433 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746225    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 14:23:17.748433 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746228    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 14:23:17.748433 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746230    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 14:23:17.748433 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746233    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 14:23:17.748433 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746235    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 14:23:17.748433 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746238    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 14:23:17.748433 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746240    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 14:23:17.748433 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746244    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 14:23:17.748433 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746247    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 14:23:17.748433 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746249    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 14:23:17.748433 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746252    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 14:23:17.748433 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746255    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 14:23:17.748433 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746257    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 14:23:17.748433 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.746262    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 14:23:17.748807 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746405    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 14:23:17.748807 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746411    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 14:23:17.748807 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746414    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 14:23:17.748807 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746417    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 14:23:17.748807 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746419    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 14:23:17.748807 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746422    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 14:23:17.748807 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746425    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 14:23:17.748807 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746429    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 14:23:17.748807 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746432    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 14:23:17.748807 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746435    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 14:23:17.748807 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746438    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 14:23:17.748807 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746441    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 14:23:17.748807 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746444    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 14:23:17.748807 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746446    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 14:23:17.748807 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746449    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 14:23:17.748807 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746451    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 14:23:17.748807 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746454    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 14:23:17.748807 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746457    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 14:23:17.748807 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746459    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 14:23:17.749303 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746462    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 14:23:17.749303 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746464    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 14:23:17.749303 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746467    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 14:23:17.749303 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746469    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 14:23:17.749303 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746471    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 14:23:17.749303 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746474    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 14:23:17.749303 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746477    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 14:23:17.749303 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746480    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 14:23:17.749303 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746483    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 14:23:17.749303 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746485    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 14:23:17.749303 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746488    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 14:23:17.749303 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746490    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 14:23:17.749303 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746493    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 14:23:17.749303 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746495    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 14:23:17.749303 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746498    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 14:23:17.749303 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746500    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 14:23:17.749303 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746502    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 14:23:17.749303 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746505    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 14:23:17.749303 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746507    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 14:23:17.749303 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746510    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 14:23:17.749816 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746513    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 14:23:17.749816 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746516    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 14:23:17.749816 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746518    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 14:23:17.749816 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746522    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 14:23:17.749816 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746524    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 14:23:17.749816 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746527    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 14:23:17.749816 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746529    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 14:23:17.749816 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746532    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 14:23:17.749816 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746534    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 14:23:17.749816 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746537    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 14:23:17.749816 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746539    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 14:23:17.749816 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746542    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 14:23:17.749816 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746544    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 14:23:17.749816 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746547    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 14:23:17.749816 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746549    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 14:23:17.749816 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746552    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 14:23:17.749816 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746554    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 14:23:17.749816 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746557    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 14:23:17.749816 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746560    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 14:23:17.749816 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746563    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 14:23:17.750305 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746565    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 14:23:17.750305 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746568    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 14:23:17.750305 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746571    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 14:23:17.750305 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746573    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 14:23:17.750305 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746576    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 14:23:17.750305 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746578    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 14:23:17.750305 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746581    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 14:23:17.750305 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746583    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 14:23:17.750305 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746586    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 14:23:17.750305 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746589    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 14:23:17.750305 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746593    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 14:23:17.750305 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746595    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 14:23:17.750305 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746598    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 14:23:17.750305 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746601    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 14:23:17.750305 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746603    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 14:23:17.750305 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746606    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 14:23:17.750305 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746609    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 14:23:17.750305 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746612    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 14:23:17.750305 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746614    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 14:23:17.750305 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746617    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 14:23:17.750791 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746619    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 14:23:17.750791 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746622    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 14:23:17.750791 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746624    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 14:23:17.750791 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746627    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 14:23:17.750791 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746631    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 14:23:17.750791 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746634    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 14:23:17.750791 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746637    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 14:23:17.750791 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746639    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 14:23:17.750791 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746642    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 14:23:17.750791 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746645    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 14:23:17.750791 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746647    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 14:23:17.750791 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746650    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 14:23:17.750791 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746653    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 14:23:17.750791 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746655    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 14:23:17.750791 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746658    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 14:23:17.750791 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746660    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 14:23:17.750791 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746662    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 14:23:17.750791 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746665    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 14:23:17.750791 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746667    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 14:23:17.750791 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:17.746669    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 14:23:17.751266 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.746674    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 14:23:17.751266 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.746770    2565 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 06 14:23:17.751266 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.748718    2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 06 14:23:17.751266 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.750118    2565 server.go:1019] "Starting client certificate rotation"
Jul 06 14:23:17.751266 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.750217    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 14:23:17.751266 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.750243    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 14:23:17.753880 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.753867    2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 14:23:17.755268 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.755254    2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 14:23:17.763780 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.763761    2565 log.go:25] "Validated CRI v1 runtime API"
Jul 06 14:23:17.767178 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.767158    2565 log.go:25] "Validated CRI v1 image API"
Jul 06 14:23:17.768709 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.768690    2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 06 14:23:17.771087 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.771068    2565 fs.go:135] Filesystem UUIDs: map[2c4d9802-f946-46ee-ac55-a2786ebbf11e:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 c4a8775e-e920-44d5-8126-df44ee403843:/dev/nvme0n1p4]
Jul 06 14:23:17.771141 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.771087    2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 06 14:23:17.777617 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.777513    2565 manager.go:216] Machine: {Timestamp:2026-07-06 14:23:17.776248821 +0000 UTC m=+0.954897858 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101552 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2228b308ccc115319fbcfe7c256d9b SystemUUID:ec2228b3-08cc-c115-319f-bcfe7c256d9b BootID:a76a1602-bc41-40c8-aca2-07765988b864 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:18:ee:85:3b:55 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:18:ee:85:3b:55 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1e:5d:70:45:9c:2e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 06 14:23:17.777617 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.777609    2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 06 14:23:17.777755 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.777682    2565 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 06 14:23:17.780534 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.780510    2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 06 14:23:17.780690 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.780538    2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-90.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 06 14:23:17.781173 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.781158    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 14:23:17.781858 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.781845    2565 topology_manager.go:138] "Creating topology manager with none policy"
Jul 06 14:23:17.781924 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.781863    2565 container_manager_linux.go:309] "Creating device plugin manager"
Jul 06 14:23:17.781924 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.781874    2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 14:23:17.782488 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.782477    2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 14:23:17.783732 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.783719    2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 06 14:23:17.786854 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.786840    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 14:23:17.786991 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.786980    2565 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 06 14:23:17.787047 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.787018    2565 kubelet.go:486] "Attempting to sync node with API server"
Jul 06 14:23:17.787047 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.787039    2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 06 14:23:17.787142 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.787060    2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 06 14:23:17.787142 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.787074    2565 kubelet.go:398] "Adding apiserver pod source"
Jul 06 14:23:17.787142 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.787086    2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 06 14:23:17.787480 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.787467    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 14:23:17.787480 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.787490    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 14:23:17.789729 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.789714    2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 06 14:23:17.791564 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.791551    2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 06 14:23:17.791602 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.791581    2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 06 14:23:17.792766 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.792755    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 06 14:23:17.792799 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.792771    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 06 14:23:17.792799 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.792777    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 06 14:23:17.792799 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.792783    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 06 14:23:17.792799 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.792792    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 06 14:23:17.792799 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.792798    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 06 14:23:17.792930 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.792806    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 06 14:23:17.792930 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.792811    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 06 14:23:17.792930 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.792817    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 06 14:23:17.792930 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.792822    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 06 14:23:17.792930 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.792844    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 06 14:23:17.792930 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.792849    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 06 14:23:17.794125 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.794112    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 06 14:23:17.794166 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.794127    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 06 14:23:17.795853 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.795832    2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-90.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 06 14:23:17.797186 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:17.797164    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 06 14:23:17.797258 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:17.797166    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-90.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 06 14:23:17.797689 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.797677    2565 server.go:1268] "Started kubelet"
Jul 06 14:23:17.797772 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.797751    2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 06 14:23:17.798130 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.798051    2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 06 14:23:17.798211 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.798141    2565 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 06 14:23:17.798514 ip-10-0-138-90 systemd[1]: Started Kubernetes Kubelet.
Jul 06 14:23:17.799879 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.799861    2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 06 14:23:17.803376 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.803354    2565 server.go:310] "Adding debug handlers to kubelet server"
Jul 06 14:23:17.804253 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:17.804228    2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 06 14:23:17.806390 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:17.805439    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-90.ec2.internal.18bfb95f9eb402b4  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-90.ec2.internal,UID:ip-10-0-138-90.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-90.ec2.internal,},FirstTimestamp:2026-07-06 14:23:17.79763474 +0000 UTC m=+0.976283816,LastTimestamp:2026-07-06 14:23:17.79763474 +0000 UTC m=+0.976283816,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-90.ec2.internal,}"
Jul 06 14:23:17.807440 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.807425    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mhccp"
Jul 06 14:23:17.808893 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.808877    2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 06 14:23:17.808959 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.808895    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 06 14:23:17.809005 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:17.808971    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-90.ec2.internal\" not found"
Jul 06 14:23:17.809538 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.809521    2565 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 06 14:23:17.809538 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.809541    2565 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 06 14:23:17.809672 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.809521    2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 06 14:23:17.809672 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.809627    2565 reconstruct.go:97] "Volume reconstruction finished"
Jul 06 14:23:17.809672 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.809636    2565 reconciler.go:29] "Reconciler: start to sync state"
Jul 06 14:23:17.810978 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:17.810954    2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-90.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 06 14:23:17.811068 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:17.811012    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 06 14:23:17.811197 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.811183    2565 factory.go:55] Registering systemd factory
Jul 06 14:23:17.811245 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.811202    2565 factory.go:223] Registration of the systemd container factory successfully
Jul 06 14:23:17.811443 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.811429    2565 factory.go:153] Registering CRI-O factory
Jul 06 14:23:17.811518 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.811446    2565 factory.go:223] Registration of the crio container factory successfully
Jul 06 14:23:17.811518 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.811494    2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 06 14:23:17.811518 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.811515    2565 factory.go:103] Registering Raw factory
Jul 06 14:23:17.811640 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.811529    2565 manager.go:1196] Started watching for new ooms in manager
Jul 06 14:23:17.811916 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.811902    2565 manager.go:349] Starting recovery of all containers
Jul 06 14:23:17.815354 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.815308    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mhccp"
Jul 06 14:23:17.821921 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.821906    2565 manager.go:354] Recovery completed
Jul 06 14:23:17.832518 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.826854    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 14:23:17.832518 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.828821    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-90.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 14:23:17.832518 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.828849    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-90.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 14:23:17.832518 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.828863    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-90.ec2.internal" event="NodeHasSufficientPID"
Jul 06 14:23:17.832518 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.829515    2565 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 06 14:23:17.832518 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.829525    2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 06 14:23:17.832518 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.829536    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 14:23:17.832518 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.829542    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 14:23:17.832518 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.830210    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-90.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 14:23:17.832518 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.830233    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-90.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 14:23:17.832518 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.830243    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-90.ec2.internal" event="NodeHasSufficientPID"
Jul 06 14:23:17.832518 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.830790    2565 policy_none.go:49] "None policy: Start"
Jul 06 14:23:17.832518 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.830802    2565 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 06 14:23:17.832518 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.830813    2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 06 14:23:17.832518 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.831771    2565 policy_none.go:47] "Start"
Jul 06 14:23:17.878004 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.877842    2565 manager.go:337] "Starting Device Plugin manager"
Jul 06 14:23:17.878108 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:17.878029    2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 06 14:23:17.878108 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.878043    2565 server.go:87] "Starting device plugin registration server"
Jul 06 14:23:17.878321 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.878310    2565 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 06 14:23:17.878378 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.878324    2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 06 14:23:17.878422 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.878405    2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 06 14:23:17.878503 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.878483    2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 06 14:23:17.878503 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.878502    2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 06 14:23:17.878983 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:17.878965    2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 06 14:23:17.879060 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:17.879013    2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-90.ec2.internal\" not found"
Jul 06 14:23:17.945880 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.945845    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 06 14:23:17.947073 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.947055    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 06 14:23:17.947131 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.947104    2565 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 06 14:23:17.947176 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.947134    2565 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 06 14:23:17.947222 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:17.947175    2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 06 14:23:17.949717 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.949700    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 14:23:17.978814 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.978756    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 14:23:17.981511 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.981495    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-90.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 14:23:17.981595 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.981526    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-90.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 14:23:17.981595 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.981540    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-90.ec2.internal" event="NodeHasSufficientPID"
Jul 06 14:23:17.981595 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.981564    2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-90.ec2.internal"
Jul 06 14:23:17.989632 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:17.989618    2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-90.ec2.internal"
Jul 06 14:23:17.989678 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:17.989640    2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-90.ec2.internal\": node \"ip-10-0-138-90.ec2.internal\" not found"
Jul 06 14:23:18.045918 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:18.045893    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-90.ec2.internal\" not found"
Jul 06 14:23:18.047981 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.047964    2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-90.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-90.ec2.internal"]
Jul 06 14:23:18.048028 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.048022    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 14:23:18.050128 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.050114    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-90.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 14:23:18.050193 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.050143    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-90.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 14:23:18.050193 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.050152    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-90.ec2.internal" event="NodeHasSufficientPID"
Jul 06 14:23:18.051394 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.051383    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 14:23:18.051502 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.051489    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-90.ec2.internal"
Jul 06 14:23:18.051538 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.051526    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 14:23:18.052130 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.052114    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-90.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 14:23:18.052130 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.052139    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-90.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 14:23:18.052293 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.052140    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-90.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 14:23:18.052293 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.052155    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-90.ec2.internal" event="NodeHasSufficientPID"
Jul 06 14:23:18.052293 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.052165    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-90.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 14:23:18.052293 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.052179    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-90.ec2.internal" event="NodeHasSufficientPID"
Jul 06 14:23:18.053606 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.053588    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-90.ec2.internal"
Jul 06 14:23:18.053700 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.053612    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 14:23:18.054535 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.054520    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-90.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 14:23:18.054607 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.054549    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-90.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 14:23:18.054607 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.054565    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-90.ec2.internal" event="NodeHasSufficientPID"
Jul 06 14:23:18.068845 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:18.068825    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-90.ec2.internal\" not found" node="ip-10-0-138-90.ec2.internal"
Jul 06 14:23:18.072011 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:18.071995    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-90.ec2.internal\" not found" node="ip-10-0-138-90.ec2.internal"
Jul 06 14:23:18.111008 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.110983    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/60ec09cbbb04b70f6c9c89c0e76536aa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-90.ec2.internal\" (UID: \"60ec09cbbb04b70f6c9c89c0e76536aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-90.ec2.internal"
Jul 06 14:23:18.111106 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.111011    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/60ec09cbbb04b70f6c9c89c0e76536aa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-90.ec2.internal\" (UID: \"60ec09cbbb04b70f6c9c89c0e76536aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-90.ec2.internal"
Jul 06 14:23:18.111106 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.111028    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d0f234e3101ecdfbdf1e54df6d4f5e57-config\") pod \"kube-apiserver-proxy-ip-10-0-138-90.ec2.internal\" (UID: \"d0f234e3101ecdfbdf1e54df6d4f5e57\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-90.ec2.internal"
Jul 06 14:23:18.146728 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:18.146700    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-90.ec2.internal\" not found"
Jul 06 14:23:18.212147 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.212123    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/60ec09cbbb04b70f6c9c89c0e76536aa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-90.ec2.internal\" (UID: \"60ec09cbbb04b70f6c9c89c0e76536aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-90.ec2.internal"
Jul 06 14:23:18.212241 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.212149    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/60ec09cbbb04b70f6c9c89c0e76536aa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-90.ec2.internal\" (UID: \"60ec09cbbb04b70f6c9c89c0e76536aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-90.ec2.internal"
Jul 06 14:23:18.212241 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.212168    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d0f234e3101ecdfbdf1e54df6d4f5e57-config\") pod \"kube-apiserver-proxy-ip-10-0-138-90.ec2.internal\" (UID: \"d0f234e3101ecdfbdf1e54df6d4f5e57\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-90.ec2.internal"
Jul 06 14:23:18.212241 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.212218    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d0f234e3101ecdfbdf1e54df6d4f5e57-config\") pod \"kube-apiserver-proxy-ip-10-0-138-90.ec2.internal\" (UID: \"d0f234e3101ecdfbdf1e54df6d4f5e57\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-90.ec2.internal"
Jul 06 14:23:18.212241 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.212226    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/60ec09cbbb04b70f6c9c89c0e76536aa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-90.ec2.internal\" (UID: \"60ec09cbbb04b70f6c9c89c0e76536aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-90.ec2.internal"
Jul 06 14:23:18.212388 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.212231    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/60ec09cbbb04b70f6c9c89c0e76536aa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-90.ec2.internal\" (UID: \"60ec09cbbb04b70f6c9c89c0e76536aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-90.ec2.internal"
Jul 06 14:23:18.247319 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:18.247241    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-90.ec2.internal\" not found"
Jul 06 14:23:18.348037 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:18.347998    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-90.ec2.internal\" not found"
Jul 06 14:23:18.373167 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.373143    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-90.ec2.internal"
Jul 06 14:23:18.375309 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.375292    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-90.ec2.internal"
Jul 06 14:23:18.448352 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:18.448291    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-90.ec2.internal\" not found"
Jul 06 14:23:18.548860 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:18.548802    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-90.ec2.internal\" not found"
Jul 06 14:23:18.649278 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:18.649252    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-90.ec2.internal\" not found"
Jul 06 14:23:18.668809 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.668787    2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 14:23:18.709880 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.709852    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-90.ec2.internal"
Jul 06 14:23:18.725677 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.725662    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 14:23:18.727485 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.727473    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-90.ec2.internal"
Jul 06 14:23:18.735811 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.735797    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 14:23:18.749993 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.749979    2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 06 14:23:18.750123 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.750094    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 14:23:18.750179 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.750110    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 14:23:18.788161 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.788138    2565 apiserver.go:52] "Watching apiserver"
Jul 06 14:23:18.803848 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.803786    2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 06 14:23:18.807240 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.807221    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-bgtbf","openshift-cluster-node-tuning-operator/tuned-fsx7v","openshift-dns/node-resolver-487gs","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-90.ec2.internal","openshift-multus/multus-additional-cni-plugins-k58jw","openshift-multus/multus-tbtc2","openshift-multus/network-metrics-daemon-ppp6z","openshift-ovn-kubernetes/ovnkube-node-ksgbf","kube-system/konnectivity-agent-p8t94","kube-system/kube-apiserver-proxy-ip-10-0-138-90.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jkd2","openshift-image-registry/node-ca-bqxgr","openshift-network-diagnostics/network-check-target-dfsgm","openshift-network-operator/iptables-alerter-xjbjb"]
Jul 06 14:23:18.808805 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.808790    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-487gs"
Jul 06 14:23:18.808990 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.808975    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 06 14:23:18.810725 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.810697    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ppp6z"
Jul 06 14:23:18.810832 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:18.810807    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ppp6z" podUID="1c66051e-7f90-46b6-9189-1842d9f84426"
Jul 06 14:23:18.810935 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.810915    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4666g\""
Jul 06 14:23:18.811320 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.811102    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 06 14:23:18.811320 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.811103    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 06 14:23:18.812499 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.812478    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fsx7v"
Jul 06 14:23:18.814029 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.814011    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ss4mf\""
Jul 06 14:23:18.814118 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.814041    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 06 14:23:18.814118 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.814106    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-k58jw"
Jul 06 14:23:18.814200 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.814183    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 06 14:23:18.815182 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.815164    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ab8aa9ec-dfe2-450f-ad33-41ac93232eb5-hosts-file\") pod \"node-resolver-487gs\" (UID: \"ab8aa9ec-dfe2-450f-ad33-41ac93232eb5\") " pod="openshift-dns/node-resolver-487gs"
Jul 06 14:23:18.815273 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.815188    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab8aa9ec-dfe2-450f-ad33-41ac93232eb5-tmp-dir\") pod \"node-resolver-487gs\" (UID: \"ab8aa9ec-dfe2-450f-ad33-41ac93232eb5\") " pod="openshift-dns/node-resolver-487gs"
Jul 06 14:23:18.815273 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.815206    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v47jj\" (UniqueName: \"kubernetes.io/projected/ab8aa9ec-dfe2-450f-ad33-41ac93232eb5-kube-api-access-v47jj\") pod \"node-resolver-487gs\" (UID: \"ab8aa9ec-dfe2-450f-ad33-41ac93232eb5\") " pod="openshift-dns/node-resolver-487gs"
Jul 06 14:23:18.815273 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.815231    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c66051e-7f90-46b6-9189-1842d9f84426-metrics-certs\") pod \"network-metrics-daemon-ppp6z\" (UID: \"1c66051e-7f90-46b6-9189-1842d9f84426\") " pod="openshift-multus/network-metrics-daemon-ppp6z"
Jul 06 14:23:18.815273 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.815254    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7z7g\" (UniqueName: \"kubernetes.io/projected/1c66051e-7f90-46b6-9189-1842d9f84426-kube-api-access-h7z7g\") pod \"network-metrics-daemon-ppp6z\" (UID: \"1c66051e-7f90-46b6-9189-1842d9f84426\") " pod="openshift-multus/network-metrics-daemon-ppp6z"
Jul 06 14:23:18.815479 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.815275    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tbtc2"
Jul 06 14:23:18.815614 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.815601    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 06 14:23:18.815843 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.815827    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4gfqs\""
Jul 06 14:23:18.816165 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.816153    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 06 14:23:18.816397 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.816380    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 06 14:23:18.816476 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.816422    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 06 14:23:18.816476 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.816388    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 06 14:23:18.816625 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.816606    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgtbf"
Jul 06 14:23:18.816719 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:18.816674    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgtbf" podUID="a6c6da04-8e16-45a3-b8bc-e6dfa6ede872"
Jul 06 14:23:18.816719 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.816709    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 06 14:23:18.817534 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.817518    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-f7qzc\""
Jul 06 14:23:18.817596 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.817541    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 14:18:17 +0000 UTC" deadline="2028-03-20 22:26:03.614959462 +0000 UTC"
Jul 06 14:23:18.817596 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.817591    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14960h2m44.797371233s"
Jul 06 14:23:18.818309 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.818293    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:18.819717 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.819700    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-p8t94"
Jul 06 14:23:18.820025 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.820012    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 06 14:23:18.820289 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.820278    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 06 14:23:18.820363 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.820333    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-gdv6c\""
Jul 06 14:23:18.820423 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.820405    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 06 14:23:18.820641 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.820625    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 06 14:23:18.820691 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.820655    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 06 14:23:18.820691 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.820656    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 06 14:23:18.820851 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.820839    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 14:23:18.821068 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.821056    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jkd2"
Jul 06 14:23:18.821348 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.821319    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 06 14:23:18.821528 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.821514    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-2lvfv\""
Jul 06 14:23:18.822363 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.822351    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bqxgr"
Jul 06 14:23:18.823672 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.823657    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfsgm"
Jul 06 14:23:18.823722 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:18.823704    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfsgm" podUID="17707cd3-41ff-4805-a140-934dd45b5547"
Jul 06 14:23:18.824775 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.824758    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 06 14:23:18.825063 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.825048    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xjbjb"
Jul 06 14:23:18.825495 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.825481    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 06 14:23:18.825580 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.825529    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 06 14:23:18.825580 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.825534    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 06 14:23:18.825580 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.825554    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 06 14:23:18.825705 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.825584    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5h7tq\""
Jul 06 14:23:18.826034 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.826012    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 06 14:23:18.826127 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.826012    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-c5dqx\""
Jul 06 14:23:18.827458 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.827251    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 06 14:23:18.827458 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.827398    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 06 14:23:18.827611 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.827578    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xfqch\""
Jul 06 14:23:18.827674 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.827578    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 06 14:23:18.828128 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.828114    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 06 14:23:18.857582 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.857559    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vltfr"
Jul 06 14:23:18.866114 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.866086    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vltfr"
Jul 06 14:23:18.910822 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.910802    2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 06 14:23:18.915833 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.915806    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/62c96d7e-de74-4544-b034-aee512c74793-cnibin\") pod \"multus-tbtc2\" (UID: \"62c96d7e-de74-4544-b034-aee512c74793\") " pod="openshift-multus/multus-tbtc2"
Jul 06 14:23:18.915932 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.915839    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/62c96d7e-de74-4544-b034-aee512c74793-cni-binary-copy\") pod \"multus-tbtc2\" (UID: \"62c96d7e-de74-4544-b034-aee512c74793\") " pod="openshift-multus/multus-tbtc2"
Jul 06 14:23:18.915932 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.915859    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/62c96d7e-de74-4544-b034-aee512c74793-multus-socket-dir-parent\") pod \"multus-tbtc2\" (UID: \"62c96d7e-de74-4544-b034-aee512c74793\") " pod="openshift-multus/multus-tbtc2"
Jul 06 14:23:18.915932 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.915895    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ca19c2c-b7bd-44a3-a792-2a91e0637866-etc-openvswitch\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:18.915932 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.915923    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8ca19c2c-b7bd-44a3-a792-2a91e0637866-ovn-node-metrics-cert\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:18.916054 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.915940    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c71659e5-9048-44b4-899c-081ede3cf7dc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4jkd2\" (UID: \"c71659e5-9048-44b4-899c-081ede3cf7dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jkd2"
Jul 06 14:23:18.916054 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.915968    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbtzk\" (UniqueName: \"kubernetes.io/projected/d3b974e0-a207-4976-8b28-07d878302459-kube-api-access-pbtzk\") pod \"node-ca-bqxgr\" (UID: \"d3b974e0-a207-4976-8b28-07d878302459\") " pod="openshift-image-registry/node-ca-bqxgr"
Jul 06 14:23:18.916054 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.915992    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c8975397-e166-4a41-a395-606fc8fffe2b-tmp\") pod \"tuned-fsx7v\" (UID: \"c8975397-e166-4a41-a395-606fc8fffe2b\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx7v"
Jul 06 14:23:18.916054 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.916008    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/62c96d7e-de74-4544-b034-aee512c74793-host-var-lib-cni-multus\") pod \"multus-tbtc2\" (UID: \"62c96d7e-de74-4544-b034-aee512c74793\") " pod="openshift-multus/multus-tbtc2"
Jul 06 14:23:18.916054 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.916024    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8ca19c2c-b7bd-44a3-a792-2a91e0637866-host-run-netns\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:18.916054 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.916044    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b717a842-24ed-4b29-ace1-7a1e9cde682d-konnectivity-ca\") pod \"konnectivity-agent-p8t94\" (UID: \"b717a842-24ed-4b29-ace1-7a1e9cde682d\") " pod="kube-system/konnectivity-agent-p8t94"
Jul 06 14:23:18.916229 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.916061    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c71659e5-9048-44b4-899c-081ede3cf7dc-sys-fs\") pod \"aws-ebs-csi-driver-node-4jkd2\" (UID: \"c71659e5-9048-44b4-899c-081ede3cf7dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jkd2"
Jul 06 14:23:18.916229 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.916075    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c8975397-e166-4a41-a395-606fc8fffe2b-etc-sysctl-conf\") pod \"tuned-fsx7v\" (UID: \"c8975397-e166-4a41-a395-606fc8fffe2b\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx7v"
Jul 06 14:23:18.916229 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.916088    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c8975397-e166-4a41-a395-606fc8fffe2b-etc-tuned\") pod \"tuned-fsx7v\" (UID: \"c8975397-e166-4a41-a395-606fc8fffe2b\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx7v"
Jul 06 14:23:18.916229 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.916112    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7z7g\" (UniqueName: \"kubernetes.io/projected/1c66051e-7f90-46b6-9189-1842d9f84426-kube-api-access-h7z7g\") pod \"network-metrics-daemon-ppp6z\" (UID: \"1c66051e-7f90-46b6-9189-1842d9f84426\") " pod="openshift-multus/network-metrics-daemon-ppp6z"
Jul 06 14:23:18.916229 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.916132    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/62c96d7e-de74-4544-b034-aee512c74793-multus-daemon-config\") pod \"multus-tbtc2\" (UID: \"62c96d7e-de74-4544-b034-aee512c74793\") " pod="openshift-multus/multus-tbtc2"
Jul 06 14:23:18.916229 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.916147    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c8975397-e166-4a41-a395-606fc8fffe2b-host\") pod \"tuned-fsx7v\" (UID: \"c8975397-e166-4a41-a395-606fc8fffe2b\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx7v"
Jul 06 14:23:18.916229 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.916167    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c3769694-2787-4d0d-92cd-a7dc7fdbad46-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k58jw\" (UID: \"c3769694-2787-4d0d-92cd-a7dc7fdbad46\") " pod="openshift-multus/multus-additional-cni-plugins-k58jw"
Jul 06 14:23:18.916229 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.916196    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c66051e-7f90-46b6-9189-1842d9f84426-metrics-certs\") pod \"network-metrics-daemon-ppp6z\" (UID: \"1c66051e-7f90-46b6-9189-1842d9f84426\") " pod="openshift-multus/network-metrics-daemon-ppp6z"
Jul 06 14:23:18.916229 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.916216    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/62c96d7e-de74-4544-b034-aee512c74793-hostroot\") pod \"multus-tbtc2\" (UID: \"62c96d7e-de74-4544-b034-aee512c74793\") " pod="openshift-multus/multus-tbtc2"
Jul 06 14:23:18.916582 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.916231    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62c96d7e-de74-4544-b034-aee512c74793-etc-kubernetes\") pod \"multus-tbtc2\" (UID: \"62c96d7e-de74-4544-b034-aee512c74793\") " pod="openshift-multus/multus-tbtc2"
Jul 06 14:23:18.916582 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.916248    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c71659e5-9048-44b4-899c-081ede3cf7dc-etc-selinux\") pod \"aws-ebs-csi-driver-node-4jkd2\" (UID: \"c71659e5-9048-44b4-899c-081ede3cf7dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jkd2"
Jul 06 14:23:18.916582 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.916289    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c8975397-e166-4a41-a395-606fc8fffe2b-etc-sysctl-d\") pod \"tuned-fsx7v\" (UID: \"c8975397-e166-4a41-a395-606fc8fffe2b\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx7v"
Jul 06 14:23:18.916582 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:18.916309    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:23:18.916582 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.916326    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1962350b-82b5-4bd5-b4ba-804113c8f8a2-iptables-alerter-script\") pod \"iptables-alerter-xjbjb\" (UID: \"1962350b-82b5-4bd5-b4ba-804113c8f8a2\") " pod="openshift-network-operator/iptables-alerter-xjbjb"
Jul 06 14:23:18.916582 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.916368    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/62c96d7e-de74-4544-b034-aee512c74793-multus-cni-dir\") pod \"multus-tbtc2\" (UID: \"62c96d7e-de74-4544-b034-aee512c74793\") " pod="openshift-multus/multus-tbtc2"
Jul 06 14:23:18.916582 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.916398    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/62c96d7e-de74-4544-b034-aee512c74793-host-var-lib-cni-bin\") pod \"multus-tbtc2\" (UID: \"62c96d7e-de74-4544-b034-aee512c74793\") " pod="openshift-multus/multus-tbtc2"
Jul 06 14:23:18.916582 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.916422    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c8975397-e166-4a41-a395-606fc8fffe2b-lib-modules\") pod \"tuned-fsx7v\" (UID: \"c8975397-e166-4a41-a395-606fc8fffe2b\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx7v"
Jul 06 14:23:18.916582 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.916447    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6cbk\" (UniqueName: \"kubernetes.io/projected/c8975397-e166-4a41-a395-606fc8fffe2b-kube-api-access-g6cbk\") pod \"tuned-fsx7v\" (UID: \"c8975397-e166-4a41-a395-606fc8fffe2b\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx7v"
Jul 06 14:23:18.916582 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.916476    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c3769694-2787-4d0d-92cd-a7dc7fdbad46-system-cni-dir\") pod \"multus-additional-cni-plugins-k58jw\" (UID: \"c3769694-2787-4d0d-92cd-a7dc7fdbad46\") " pod="openshift-multus/multus-additional-cni-plugins-k58jw"
Jul 06 14:23:18.916582 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.916515    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c3769694-2787-4d0d-92cd-a7dc7fdbad46-os-release\") pod \"multus-additional-cni-plugins-k58jw\" (UID: \"c3769694-2787-4d0d-92cd-a7dc7fdbad46\") " pod="openshift-multus/multus-additional-cni-plugins-k58jw"
Jul 06 14:23:18.916582 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:18.916539    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c66051e-7f90-46b6-9189-1842d9f84426-metrics-certs podName:1c66051e-7f90-46b6-9189-1842d9f84426 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:19.416517447 +0000 UTC m=+2.595166483 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1c66051e-7f90-46b6-9189-1842d9f84426-metrics-certs") pod "network-metrics-daemon-ppp6z" (UID: "1c66051e-7f90-46b6-9189-1842d9f84426") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:23:18.917135 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.916629    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1962350b-82b5-4bd5-b4ba-804113c8f8a2-host-slash\") pod \"iptables-alerter-xjbjb\" (UID: \"1962350b-82b5-4bd5-b4ba-804113c8f8a2\") " pod="openshift-network-operator/iptables-alerter-xjbjb"
Jul 06 14:23:18.917135 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.916659    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8ca19c2c-b7bd-44a3-a792-2a91e0637866-env-overrides\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:18.917135 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.916684    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/62c96d7e-de74-4544-b034-aee512c74793-host-var-lib-kubelet\") pod \"multus-tbtc2\" (UID: \"62c96d7e-de74-4544-b034-aee512c74793\") " pod="openshift-multus/multus-tbtc2"
Jul 06 14:23:18.917135 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.916716    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ca19c2c-b7bd-44a3-a792-2a91e0637866-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:18.917135 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.916740    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkdqd\" (UniqueName: \"kubernetes.io/projected/c71659e5-9048-44b4-899c-081ede3cf7dc-kube-api-access-dkdqd\") pod \"aws-ebs-csi-driver-node-4jkd2\" (UID: \"c71659e5-9048-44b4-899c-081ede3cf7dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jkd2"
Jul 06 14:23:18.917135 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.916766    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8ca19c2c-b7bd-44a3-a792-2a91e0637866-run-ovn\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:18.917135 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.916791    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ca19c2c-b7bd-44a3-a792-2a91e0637866-host-run-ovn-kubernetes\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:18.917135 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.916814    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d3b974e0-a207-4976-8b28-07d878302459-host\") pod \"node-ca-bqxgr\" (UID: \"d3b974e0-a207-4976-8b28-07d878302459\") " pod="openshift-image-registry/node-ca-bqxgr"
Jul 06 14:23:18.917135 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.916863    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c3769694-2787-4d0d-92cd-a7dc7fdbad46-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k58jw\" (UID: \"c3769694-2787-4d0d-92cd-a7dc7fdbad46\") " pod="openshift-multus/multus-additional-cni-plugins-k58jw"
Jul 06 14:23:18.917135 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.916892    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8ca19c2c-b7bd-44a3-a792-2a91e0637866-systemd-units\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:18.917135 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.916915    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8ca19c2c-b7bd-44a3-a792-2a91e0637866-host-slash\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:18.917135 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.916938    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8ca19c2c-b7bd-44a3-a792-2a91e0637866-node-log\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:18.917135 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.916961    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8ca19c2c-b7bd-44a3-a792-2a91e0637866-log-socket\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:18.917135 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.916986    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8ca19c2c-b7bd-44a3-a792-2a91e0637866-host-cni-netd\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:18.917135 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.917021    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfb6p\" (UniqueName: \"kubernetes.io/projected/8ca19c2c-b7bd-44a3-a792-2a91e0637866-kube-api-access-kfb6p\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:18.917135 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.917043    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b717a842-24ed-4b29-ace1-7a1e9cde682d-agent-certs\") pod \"konnectivity-agent-p8t94\" (UID: \"b717a842-24ed-4b29-ace1-7a1e9cde682d\") " pod="kube-system/konnectivity-agent-p8t94"
Jul 06 14:23:18.917653 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.917068    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/62c96d7e-de74-4544-b034-aee512c74793-host-run-k8s-cni-cncf-io\") pod \"multus-tbtc2\" (UID: \"62c96d7e-de74-4544-b034-aee512c74793\") " pod="openshift-multus/multus-tbtc2"
Jul 06 14:23:18.917653 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.917090    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c8975397-e166-4a41-a395-606fc8fffe2b-etc-kubernetes\") pod \"tuned-fsx7v\" (UID: \"c8975397-e166-4a41-a395-606fc8fffe2b\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx7v"
Jul 06 14:23:18.917653 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.917115    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8975397-e166-4a41-a395-606fc8fffe2b-var-lib-kubelet\") pod \"tuned-fsx7v\" (UID: \"c8975397-e166-4a41-a395-606fc8fffe2b\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx7v"
Jul 06 14:23:18.917653 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.917139    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c3769694-2787-4d0d-92cd-a7dc7fdbad46-cni-binary-copy\") pod \"multus-additional-cni-plugins-k58jw\" (UID: \"c3769694-2787-4d0d-92cd-a7dc7fdbad46\") " pod="openshift-multus/multus-additional-cni-plugins-k58jw"
Jul 06 14:23:18.917653 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.917162    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pldbb\" (UniqueName: \"kubernetes.io/projected/1962350b-82b5-4bd5-b4ba-804113c8f8a2-kube-api-access-pldbb\") pod \"iptables-alerter-xjbjb\" (UID: \"1962350b-82b5-4bd5-b4ba-804113c8f8a2\") " pod="openshift-network-operator/iptables-alerter-xjbjb"
Jul 06 14:23:18.917653 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.917201    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ca19c2c-b7bd-44a3-a792-2a91e0637866-host-kubelet\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:18.917653 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.917224    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8ca19c2c-b7bd-44a3-a792-2a91e0637866-run-systemd\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:18.917653 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.917288    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ca19c2c-b7bd-44a3-a792-2a91e0637866-var-lib-openvswitch\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:18.917653 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.917312    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ca19c2c-b7bd-44a3-a792-2a91e0637866-run-openvswitch\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:18.917653 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.917326    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8ca19c2c-b7bd-44a3-a792-2a91e0637866-ovnkube-script-lib\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:18.917653 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.917394    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c8975397-e166-4a41-a395-606fc8fffe2b-etc-modprobe-d\") pod \"tuned-fsx7v\" (UID: \"c8975397-e166-4a41-a395-606fc8fffe2b\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx7v"
Jul 06 14:23:18.917653 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.917434    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c8975397-e166-4a41-a395-606fc8fffe2b-etc-systemd\") pod \"tuned-fsx7v\" (UID: \"c8975397-e166-4a41-a395-606fc8fffe2b\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx7v"
Jul 06 14:23:18.917653 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.917471    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8975397-e166-4a41-a395-606fc8fffe2b-sys\") pod \"tuned-fsx7v\" (UID: \"c8975397-e166-4a41-a395-606fc8fffe2b\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx7v"
Jul 06 14:23:18.917653 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.917495    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a6c6da04-8e16-45a3-b8bc-e6dfa6ede872-original-pull-secret\") pod \"global-pull-secret-syncer-bgtbf\" (UID: \"a6c6da04-8e16-45a3-b8bc-e6dfa6ede872\") " pod="kube-system/global-pull-secret-syncer-bgtbf"
Jul 06 14:23:18.917653 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.917529    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c71659e5-9048-44b4-899c-081ede3cf7dc-socket-dir\") pod \"aws-ebs-csi-driver-node-4jkd2\" (UID: \"c71659e5-9048-44b4-899c-081ede3cf7dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jkd2"
Jul 06 14:23:18.917653 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.917550    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/62c96d7e-de74-4544-b034-aee512c74793-os-release\") pod \"multus-tbtc2\" (UID: \"62c96d7e-de74-4544-b034-aee512c74793\") " pod="openshift-multus/multus-tbtc2"
Jul 06 14:23:18.918213 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.917567    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5g6x5\" (UniqueName: \"kubernetes.io/projected/62c96d7e-de74-4544-b034-aee512c74793-kube-api-access-5g6x5\") pod \"multus-tbtc2\" (UID: \"62c96d7e-de74-4544-b034-aee512c74793\") " pod="openshift-multus/multus-tbtc2"
Jul 06 14:23:18.918213 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.917581    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a6c6da04-8e16-45a3-b8bc-e6dfa6ede872-kubelet-config\") pod \"global-pull-secret-syncer-bgtbf\" (UID: \"a6c6da04-8e16-45a3-b8bc-e6dfa6ede872\") " pod="kube-system/global-pull-secret-syncer-bgtbf"
Jul 06 14:23:18.918213 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.917612    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bw6t\" (UniqueName: \"kubernetes.io/projected/17707cd3-41ff-4805-a140-934dd45b5547-kube-api-access-5bw6t\") pod \"network-check-target-dfsgm\" (UID: \"17707cd3-41ff-4805-a140-934dd45b5547\") " pod="openshift-network-diagnostics/network-check-target-dfsgm"
Jul 06 14:23:18.918213 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.917641    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/62c96d7e-de74-4544-b034-aee512c74793-host-run-netns\") pod \"multus-tbtc2\" (UID: \"62c96d7e-de74-4544-b034-aee512c74793\") " pod="openshift-multus/multus-tbtc2"
Jul 06 14:23:18.918213 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.917668    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d3b974e0-a207-4976-8b28-07d878302459-serviceca\") pod \"node-ca-bqxgr\" (UID: \"d3b974e0-a207-4976-8b28-07d878302459\") " pod="openshift-image-registry/node-ca-bqxgr"
Jul 06 14:23:18.918213 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.917690    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c8975397-e166-4a41-a395-606fc8fffe2b-etc-sysconfig\") pod \"tuned-fsx7v\" (UID: \"c8975397-e166-4a41-a395-606fc8fffe2b\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx7v"
Jul 06 14:23:18.918213 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.917711    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rg2jf\" (UniqueName: \"kubernetes.io/projected/c3769694-2787-4d0d-92cd-a7dc7fdbad46-kube-api-access-rg2jf\") pod \"multus-additional-cni-plugins-k58jw\" (UID: \"c3769694-2787-4d0d-92cd-a7dc7fdbad46\") " pod="openshift-multus/multus-additional-cni-plugins-k58jw"
Jul 06 14:23:18.918213 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.917743    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab8aa9ec-dfe2-450f-ad33-41ac93232eb5-tmp-dir\") pod \"node-resolver-487gs\" (UID: \"ab8aa9ec-dfe2-450f-ad33-41ac93232eb5\") " pod="openshift-dns/node-resolver-487gs"
Jul 06 14:23:18.918213 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.917768    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v47jj\" (UniqueName: \"kubernetes.io/projected/ab8aa9ec-dfe2-450f-ad33-41ac93232eb5-kube-api-access-v47jj\") pod \"node-resolver-487gs\" (UID: \"ab8aa9ec-dfe2-450f-ad33-41ac93232eb5\") " pod="openshift-dns/node-resolver-487gs"
Jul 06 14:23:18.918213 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.917796    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a6c6da04-8e16-45a3-b8bc-e6dfa6ede872-dbus\") pod \"global-pull-secret-syncer-bgtbf\" (UID: \"a6c6da04-8e16-45a3-b8bc-e6dfa6ede872\") " pod="kube-system/global-pull-secret-syncer-bgtbf"
Jul 06 14:23:18.918213 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.917818    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8ca19c2c-b7bd-44a3-a792-2a91e0637866-ovnkube-config\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:18.918213 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.917840    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c3769694-2787-4d0d-92cd-a7dc7fdbad46-cnibin\") pod \"multus-additional-cni-plugins-k58jw\" (UID: \"c3769694-2787-4d0d-92cd-a7dc7fdbad46\") " pod="openshift-multus/multus-additional-cni-plugins-k58jw"
Jul 06 14:23:18.918213 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.917864    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ab8aa9ec-dfe2-450f-ad33-41ac93232eb5-hosts-file\") pod \"node-resolver-487gs\" (UID: \"ab8aa9ec-dfe2-450f-ad33-41ac93232eb5\") " pod="openshift-dns/node-resolver-487gs"
Jul 06 14:23:18.918213 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.917888    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/62c96d7e-de74-4544-b034-aee512c74793-multus-conf-dir\") pod \"multus-tbtc2\" (UID: \"62c96d7e-de74-4544-b034-aee512c74793\") " pod="openshift-multus/multus-tbtc2"
Jul 06 14:23:18.918213 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.917914    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/62c96d7e-de74-4544-b034-aee512c74793-host-run-multus-certs\") pod \"multus-tbtc2\" (UID: \"62c96d7e-de74-4544-b034-aee512c74793\") " pod="openshift-multus/multus-tbtc2"
Jul 06 14:23:18.918213 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.917943    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8ca19c2c-b7bd-44a3-a792-2a91e0637866-host-cni-bin\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:18.918213 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.917954    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ab8aa9ec-dfe2-450f-ad33-41ac93232eb5-hosts-file\") pod \"node-resolver-487gs\" (UID: \"ab8aa9ec-dfe2-450f-ad33-41ac93232eb5\") " pod="openshift-dns/node-resolver-487gs"
Jul 06 14:23:18.918846 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.917967    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c8975397-e166-4a41-a395-606fc8fffe2b-run\") pod \"tuned-fsx7v\" (UID: \"c8975397-e166-4a41-a395-606fc8fffe2b\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx7v"
Jul 06 14:23:18.918846 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.917995    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c3769694-2787-4d0d-92cd-a7dc7fdbad46-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k58jw\" (UID: \"c3769694-2787-4d0d-92cd-a7dc7fdbad46\") " pod="openshift-multus/multus-additional-cni-plugins-k58jw"
Jul 06 14:23:18.918846 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.918020    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/62c96d7e-de74-4544-b034-aee512c74793-system-cni-dir\") pod \"multus-tbtc2\" (UID: \"62c96d7e-de74-4544-b034-aee512c74793\") " pod="openshift-multus/multus-tbtc2"
Jul 06 14:23:18.918846 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.918044    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab8aa9ec-dfe2-450f-ad33-41ac93232eb5-tmp-dir\") pod \"node-resolver-487gs\" (UID: \"ab8aa9ec-dfe2-450f-ad33-41ac93232eb5\") " pod="openshift-dns/node-resolver-487gs"
Jul 06 14:23:18.918846 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.918089    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c71659e5-9048-44b4-899c-081ede3cf7dc-registration-dir\") pod \"aws-ebs-csi-driver-node-4jkd2\" (UID: \"c71659e5-9048-44b4-899c-081ede3cf7dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jkd2"
Jul 06 14:23:18.918846 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.918124    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c71659e5-9048-44b4-899c-081ede3cf7dc-device-dir\") pod \"aws-ebs-csi-driver-node-4jkd2\" (UID: \"c71659e5-9048-44b4-899c-081ede3cf7dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jkd2"
Jul 06 14:23:18.931374 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.931354    2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 06 14:23:18.934624 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.934601    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v47jj\" (UniqueName: \"kubernetes.io/projected/ab8aa9ec-dfe2-450f-ad33-41ac93232eb5-kube-api-access-v47jj\") pod \"node-resolver-487gs\" (UID: \"ab8aa9ec-dfe2-450f-ad33-41ac93232eb5\") " pod="openshift-dns/node-resolver-487gs"
Jul 06 14:23:18.934709 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.934606    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7z7g\" (UniqueName: \"kubernetes.io/projected/1c66051e-7f90-46b6-9189-1842d9f84426-kube-api-access-h7z7g\") pod \"network-metrics-daemon-ppp6z\" (UID: \"1c66051e-7f90-46b6-9189-1842d9f84426\") " pod="openshift-multus/network-metrics-daemon-ppp6z"
Jul 06 14:23:18.974212 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:18.974182    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0f234e3101ecdfbdf1e54df6d4f5e57.slice/crio-79db3f7899593a38f638ec4e5d83bd9092332fd80b48ef995d53e62d753e51c0 WatchSource:0}: Error finding container 79db3f7899593a38f638ec4e5d83bd9092332fd80b48ef995d53e62d753e51c0: Status 404 returned error can't find the container with id 79db3f7899593a38f638ec4e5d83bd9092332fd80b48ef995d53e62d753e51c0
Jul 06 14:23:18.974950 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:18.974927    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60ec09cbbb04b70f6c9c89c0e76536aa.slice/crio-17e9e8aef17f1eb941e9c21283e6cbf4a756c30b42317a96343af909fcbd0bfe WatchSource:0}: Error finding container 17e9e8aef17f1eb941e9c21283e6cbf4a756c30b42317a96343af909fcbd0bfe: Status 404 returned error can't find the container with id 17e9e8aef17f1eb941e9c21283e6cbf4a756c30b42317a96343af909fcbd0bfe
Jul 06 14:23:18.981471 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:18.979325    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 14:23:19.018827 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.018795    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/62c96d7e-de74-4544-b034-aee512c74793-os-release\") pod \"multus-tbtc2\" (UID: \"62c96d7e-de74-4544-b034-aee512c74793\") " pod="openshift-multus/multus-tbtc2"
Jul 06 14:23:19.018933 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.018831    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5g6x5\" (UniqueName: \"kubernetes.io/projected/62c96d7e-de74-4544-b034-aee512c74793-kube-api-access-5g6x5\") pod \"multus-tbtc2\" (UID: \"62c96d7e-de74-4544-b034-aee512c74793\") " pod="openshift-multus/multus-tbtc2"
Jul 06 14:23:19.018933 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.018850    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a6c6da04-8e16-45a3-b8bc-e6dfa6ede872-kubelet-config\") pod \"global-pull-secret-syncer-bgtbf\" (UID: \"a6c6da04-8e16-45a3-b8bc-e6dfa6ede872\") " pod="kube-system/global-pull-secret-syncer-bgtbf"
Jul 06 14:23:19.019042 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.018956    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bw6t\" (UniqueName: \"kubernetes.io/projected/17707cd3-41ff-4805-a140-934dd45b5547-kube-api-access-5bw6t\") pod \"network-check-target-dfsgm\" (UID: \"17707cd3-41ff-4805-a140-934dd45b5547\") " pod="openshift-network-diagnostics/network-check-target-dfsgm"
Jul 06 14:23:19.019042 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.018978    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a6c6da04-8e16-45a3-b8bc-e6dfa6ede872-kubelet-config\") pod \"global-pull-secret-syncer-bgtbf\" (UID: \"a6c6da04-8e16-45a3-b8bc-e6dfa6ede872\") " pod="kube-system/global-pull-secret-syncer-bgtbf"
Jul 06 14:23:19.019042 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.018989    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/62c96d7e-de74-4544-b034-aee512c74793-os-release\") pod \"multus-tbtc2\" (UID: \"62c96d7e-de74-4544-b034-aee512c74793\") " pod="openshift-multus/multus-tbtc2"
Jul 06 14:23:19.019042 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.019005    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/62c96d7e-de74-4544-b034-aee512c74793-host-run-netns\") pod \"multus-tbtc2\" (UID: \"62c96d7e-de74-4544-b034-aee512c74793\") " pod="openshift-multus/multus-tbtc2"
Jul 06 14:23:19.019042 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.019032    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d3b974e0-a207-4976-8b28-07d878302459-serviceca\") pod \"node-ca-bqxgr\" (UID: \"d3b974e0-a207-4976-8b28-07d878302459\") " pod="openshift-image-registry/node-ca-bqxgr"
Jul 06 14:23:19.019288 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.019047    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c8975397-e166-4a41-a395-606fc8fffe2b-etc-sysconfig\") pod \"tuned-fsx7v\" (UID: \"c8975397-e166-4a41-a395-606fc8fffe2b\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx7v"
Jul 06 14:23:19.019288 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.019053    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/62c96d7e-de74-4544-b034-aee512c74793-host-run-netns\") pod \"multus-tbtc2\" (UID: \"62c96d7e-de74-4544-b034-aee512c74793\") " pod="openshift-multus/multus-tbtc2"
Jul 06 14:23:19.019288 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.019062    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg2jf\" (UniqueName: \"kubernetes.io/projected/c3769694-2787-4d0d-92cd-a7dc7fdbad46-kube-api-access-rg2jf\") pod \"multus-additional-cni-plugins-k58jw\" (UID: \"c3769694-2787-4d0d-92cd-a7dc7fdbad46\") " pod="openshift-multus/multus-additional-cni-plugins-k58jw"
Jul 06 14:23:19.019288 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.019118    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a6c6da04-8e16-45a3-b8bc-e6dfa6ede872-dbus\") pod \"global-pull-secret-syncer-bgtbf\" (UID: \"a6c6da04-8e16-45a3-b8bc-e6dfa6ede872\") " pod="kube-system/global-pull-secret-syncer-bgtbf"
Jul 06 14:23:19.019288 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.019123    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c8975397-e166-4a41-a395-606fc8fffe2b-etc-sysconfig\") pod \"tuned-fsx7v\" (UID: \"c8975397-e166-4a41-a395-606fc8fffe2b\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx7v"
Jul 06 14:23:19.019288 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.019150    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8ca19c2c-b7bd-44a3-a792-2a91e0637866-ovnkube-config\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:19.019288 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.019172    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c3769694-2787-4d0d-92cd-a7dc7fdbad46-cnibin\") pod \"multus-additional-cni-plugins-k58jw\" (UID: \"c3769694-2787-4d0d-92cd-a7dc7fdbad46\") " pod="openshift-multus/multus-additional-cni-plugins-k58jw"
Jul 06 14:23:19.019288 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.019192    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/62c96d7e-de74-4544-b034-aee512c74793-multus-conf-dir\") pod \"multus-tbtc2\" (UID: \"62c96d7e-de74-4544-b034-aee512c74793\") " pod="openshift-multus/multus-tbtc2"
Jul 06 14:23:19.019288 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.019229    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/62c96d7e-de74-4544-b034-aee512c74793-host-run-multus-certs\") pod \"multus-tbtc2\" (UID: \"62c96d7e-de74-4544-b034-aee512c74793\") " pod="openshift-multus/multus-tbtc2"
Jul 06 14:23:19.019288 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.019251    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8ca19c2c-b7bd-44a3-a792-2a91e0637866-host-cni-bin\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:19.019288 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.019279    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c8975397-e166-4a41-a395-606fc8fffe2b-run\") pod \"tuned-fsx7v\" (UID: \"c8975397-e166-4a41-a395-606fc8fffe2b\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx7v"
Jul 06 14:23:19.019288 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.019284    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/62c96d7e-de74-4544-b034-aee512c74793-multus-conf-dir\") pod \"multus-tbtc2\" (UID: \"62c96d7e-de74-4544-b034-aee512c74793\") " pod="openshift-multus/multus-tbtc2"
Jul 06 14:23:19.019288 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.019284    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a6c6da04-8e16-45a3-b8bc-e6dfa6ede872-dbus\") pod \"global-pull-secret-syncer-bgtbf\" (UID: \"a6c6da04-8e16-45a3-b8bc-e6dfa6ede872\") " pod="kube-system/global-pull-secret-syncer-bgtbf"
Jul 06 14:23:19.019922 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.019304    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c3769694-2787-4d0d-92cd-a7dc7fdbad46-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k58jw\" (UID: \"c3769694-2787-4d0d-92cd-a7dc7fdbad46\") " pod="openshift-multus/multus-additional-cni-plugins-k58jw"
Jul 06 14:23:19.019922 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.019318    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8ca19c2c-b7bd-44a3-a792-2a91e0637866-host-cni-bin\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:19.019922 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.019318    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c3769694-2787-4d0d-92cd-a7dc7fdbad46-cnibin\") pod \"multus-additional-cni-plugins-k58jw\" (UID: \"c3769694-2787-4d0d-92cd-a7dc7fdbad46\") " pod="openshift-multus/multus-additional-cni-plugins-k58jw"
Jul 06 14:23:19.019922 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.019330    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/62c96d7e-de74-4544-b034-aee512c74793-system-cni-dir\") pod \"multus-tbtc2\" (UID: \"62c96d7e-de74-4544-b034-aee512c74793\") " pod="openshift-multus/multus-tbtc2"
Jul 06 14:23:19.019922 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.019361    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/62c96d7e-de74-4544-b034-aee512c74793-host-run-multus-certs\") pod \"multus-tbtc2\" (UID: \"62c96d7e-de74-4544-b034-aee512c74793\") " pod="openshift-multus/multus-tbtc2"
Jul 06 14:23:19.019922 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.019372    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c71659e5-9048-44b4-899c-081ede3cf7dc-registration-dir\") pod \"aws-ebs-csi-driver-node-4jkd2\" (UID: \"c71659e5-9048-44b4-899c-081ede3cf7dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jkd2"
Jul 06 14:23:19.019922 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.019388    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c8975397-e166-4a41-a395-606fc8fffe2b-run\") pod \"tuned-fsx7v\" (UID: \"c8975397-e166-4a41-a395-606fc8fffe2b\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx7v"
Jul 06 14:23:19.019922 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.019395    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c71659e5-9048-44b4-899c-081ede3cf7dc-device-dir\") pod \"aws-ebs-csi-driver-node-4jkd2\" (UID: \"c71659e5-9048-44b4-899c-081ede3cf7dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jkd2"
Jul 06 14:23:19.019922 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.019419    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/62c96d7e-de74-4544-b034-aee512c74793-cnibin\") pod \"multus-tbtc2\" (UID: \"62c96d7e-de74-4544-b034-aee512c74793\") " pod="openshift-multus/multus-tbtc2"
Jul 06 14:23:19.019922 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.019434    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/62c96d7e-de74-4544-b034-aee512c74793-system-cni-dir\") pod \"multus-tbtc2\" (UID: \"62c96d7e-de74-4544-b034-aee512c74793\") " pod="openshift-multus/multus-tbtc2"
Jul 06 14:23:19.019922 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.019461    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/62c96d7e-de74-4544-b034-aee512c74793-cni-binary-copy\") pod \"multus-tbtc2\" (UID: \"62c96d7e-de74-4544-b034-aee512c74793\") " pod="openshift-multus/multus-tbtc2"
Jul 06 14:23:19.019922 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.019481    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c71659e5-9048-44b4-899c-081ede3cf7dc-registration-dir\") pod \"aws-ebs-csi-driver-node-4jkd2\" (UID: \"c71659e5-9048-44b4-899c-081ede3cf7dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jkd2"
Jul 06 14:23:19.019922 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.019487    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/62c96d7e-de74-4544-b034-aee512c74793-multus-socket-dir-parent\") pod \"multus-tbtc2\" (UID: \"62c96d7e-de74-4544-b034-aee512c74793\") " pod="openshift-multus/multus-tbtc2"
Jul 06 14:23:19.019922 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.019514    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ca19c2c-b7bd-44a3-a792-2a91e0637866-etc-openvswitch\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:19.019922 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.019542    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8ca19c2c-b7bd-44a3-a792-2a91e0637866-ovn-node-metrics-cert\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:19.019922 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.019550    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/62c96d7e-de74-4544-b034-aee512c74793-cnibin\") pod \"multus-tbtc2\" (UID: \"62c96d7e-de74-4544-b034-aee512c74793\") " pod="openshift-multus/multus-tbtc2"
Jul 06 14:23:19.019922 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.019556    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d3b974e0-a207-4976-8b28-07d878302459-serviceca\") pod \"node-ca-bqxgr\" (UID: \"d3b974e0-a207-4976-8b28-07d878302459\") " pod="openshift-image-registry/node-ca-bqxgr"
Jul 06 14:23:19.019922 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.019566    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c71659e5-9048-44b4-899c-081ede3cf7dc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4jkd2\" (UID: \"c71659e5-9048-44b4-899c-081ede3cf7dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jkd2"
Jul 06 14:23:19.021147 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.019597    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c71659e5-9048-44b4-899c-081ede3cf7dc-device-dir\") pod \"aws-ebs-csi-driver-node-4jkd2\" (UID: \"c71659e5-9048-44b4-899c-081ede3cf7dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jkd2"
Jul 06 14:23:19.021147 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.019606    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbtzk\" (UniqueName: \"kubernetes.io/projected/d3b974e0-a207-4976-8b28-07d878302459-kube-api-access-pbtzk\") pod \"node-ca-bqxgr\" (UID: \"d3b974e0-a207-4976-8b28-07d878302459\") " pod="openshift-image-registry/node-ca-bqxgr"
Jul 06 14:23:19.021147 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.019629    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c8975397-e166-4a41-a395-606fc8fffe2b-tmp\") pod \"tuned-fsx7v\" (UID: \"c8975397-e166-4a41-a395-606fc8fffe2b\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx7v"
Jul 06 14:23:19.021147 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.019644    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/62c96d7e-de74-4544-b034-aee512c74793-multus-socket-dir-parent\") pod \"multus-tbtc2\" (UID: \"62c96d7e-de74-4544-b034-aee512c74793\") " pod="openshift-multus/multus-tbtc2"
Jul 06 14:23:19.021147 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.019652    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/62c96d7e-de74-4544-b034-aee512c74793-host-var-lib-cni-multus\") pod \"multus-tbtc2\" (UID: \"62c96d7e-de74-4544-b034-aee512c74793\") " pod="openshift-multus/multus-tbtc2"
Jul 06 14:23:19.021147 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.019695    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8ca19c2c-b7bd-44a3-a792-2a91e0637866-host-run-netns\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:19.021147 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.019726    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b717a842-24ed-4b29-ace1-7a1e9cde682d-konnectivity-ca\") pod \"konnectivity-agent-p8t94\" (UID: \"b717a842-24ed-4b29-ace1-7a1e9cde682d\") " pod="kube-system/konnectivity-agent-p8t94"
Jul 06 14:23:19.021147 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.019748    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c71659e5-9048-44b4-899c-081ede3cf7dc-sys-fs\") pod \"aws-ebs-csi-driver-node-4jkd2\" (UID: \"c71659e5-9048-44b4-899c-081ede3cf7dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jkd2"
Jul 06 14:23:19.021147 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.019782    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c3769694-2787-4d0d-92cd-a7dc7fdbad46-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k58jw\" (UID: \"c3769694-2787-4d0d-92cd-a7dc7fdbad46\") " pod="openshift-multus/multus-additional-cni-plugins-k58jw"
Jul 06 14:23:19.021147 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.019772    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c8975397-e166-4a41-a395-606fc8fffe2b-etc-sysctl-conf\") pod \"tuned-fsx7v\" (UID: \"c8975397-e166-4a41-a395-606fc8fffe2b\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx7v"
Jul 06 14:23:19.021147 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.019805    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8ca19c2c-b7bd-44a3-a792-2a91e0637866-ovnkube-config\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:19.021147 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.019815    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c8975397-e166-4a41-a395-606fc8fffe2b-etc-tuned\") pod \"tuned-fsx7v\" (UID: \"c8975397-e166-4a41-a395-606fc8fffe2b\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx7v"
Jul 06 14:23:19.021147 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.019855    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c71659e5-9048-44b4-899c-081ede3cf7dc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4jkd2\" (UID: \"c71659e5-9048-44b4-899c-081ede3cf7dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jkd2"
Jul 06 14:23:19.021147 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.019864    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c71659e5-9048-44b4-899c-081ede3cf7dc-sys-fs\") pod \"aws-ebs-csi-driver-node-4jkd2\" (UID: \"c71659e5-9048-44b4-899c-081ede3cf7dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jkd2"
Jul 06 14:23:19.021147 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.019875    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/62c96d7e-de74-4544-b034-aee512c74793-host-var-lib-cni-multus\") pod \"multus-tbtc2\" (UID: \"62c96d7e-de74-4544-b034-aee512c74793\") " pod="openshift-multus/multus-tbtc2"
Jul 06 14:23:19.021147 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.019953    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c8975397-e166-4a41-a395-606fc8fffe2b-etc-sysctl-conf\") pod \"tuned-fsx7v\" (UID: \"c8975397-e166-4a41-a395-606fc8fffe2b\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx7v"
Jul 06 14:23:19.021147 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.020001    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8ca19c2c-b7bd-44a3-a792-2a91e0637866-host-run-netns\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:19.021914 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.020020    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ca19c2c-b7bd-44a3-a792-2a91e0637866-etc-openvswitch\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:19.021914 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.020100    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/62c96d7e-de74-4544-b034-aee512c74793-multus-daemon-config\") pod \"multus-tbtc2\" (UID: \"62c96d7e-de74-4544-b034-aee512c74793\") " pod="openshift-multus/multus-tbtc2"
Jul 06 14:23:19.021914 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.020134    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c8975397-e166-4a41-a395-606fc8fffe2b-host\") pod \"tuned-fsx7v\" (UID: \"c8975397-e166-4a41-a395-606fc8fffe2b\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx7v"
Jul 06 14:23:19.021914 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.020159    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c3769694-2787-4d0d-92cd-a7dc7fdbad46-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k58jw\" (UID: \"c3769694-2787-4d0d-92cd-a7dc7fdbad46\") " pod="openshift-multus/multus-additional-cni-plugins-k58jw"
Jul 06 14:23:19.021914 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.020194    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/62c96d7e-de74-4544-b034-aee512c74793-hostroot\") pod \"multus-tbtc2\" (UID: \"62c96d7e-de74-4544-b034-aee512c74793\") " pod="openshift-multus/multus-tbtc2"
Jul 06 14:23:19.021914 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.020218    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62c96d7e-de74-4544-b034-aee512c74793-etc-kubernetes\") pod \"multus-tbtc2\" (UID: \"62c96d7e-de74-4544-b034-aee512c74793\") " pod="openshift-multus/multus-tbtc2"
Jul 06 14:23:19.021914 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.020241    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c8975397-e166-4a41-a395-606fc8fffe2b-host\") pod \"tuned-fsx7v\" (UID: \"c8975397-e166-4a41-a395-606fc8fffe2b\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx7v"
Jul 06 14:23:19.021914 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.020194    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/62c96d7e-de74-4544-b034-aee512c74793-cni-binary-copy\") pod \"multus-tbtc2\" (UID: \"62c96d7e-de74-4544-b034-aee512c74793\") " pod="openshift-multus/multus-tbtc2"
Jul 06 14:23:19.021914 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.020284    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/62c96d7e-de74-4544-b034-aee512c74793-hostroot\") pod \"multus-tbtc2\" (UID: \"62c96d7e-de74-4544-b034-aee512c74793\") " pod="openshift-multus/multus-tbtc2"
Jul 06 14:23:19.021914 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.020241    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c71659e5-9048-44b4-899c-081ede3cf7dc-etc-selinux\") pod \"aws-ebs-csi-driver-node-4jkd2\" (UID: \"c71659e5-9048-44b4-899c-081ede3cf7dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jkd2"
Jul 06 14:23:19.021914 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.020328    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62c96d7e-de74-4544-b034-aee512c74793-etc-kubernetes\") pod \"multus-tbtc2\" (UID: \"62c96d7e-de74-4544-b034-aee512c74793\") " pod="openshift-multus/multus-tbtc2"
Jul 06 14:23:19.021914 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.020378    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b717a842-24ed-4b29-ace1-7a1e9cde682d-konnectivity-ca\") pod \"konnectivity-agent-p8t94\" (UID: \"b717a842-24ed-4b29-ace1-7a1e9cde682d\") " pod="kube-system/konnectivity-agent-p8t94"
Jul 06 14:23:19.021914 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.020402    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c3769694-2787-4d0d-92cd-a7dc7fdbad46-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k58jw\" (UID: \"c3769694-2787-4d0d-92cd-a7dc7fdbad46\") " pod="openshift-multus/multus-additional-cni-plugins-k58jw"
Jul 06 14:23:19.021914 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.020428    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c8975397-e166-4a41-a395-606fc8fffe2b-etc-sysctl-d\") pod \"tuned-fsx7v\" (UID: \"c8975397-e166-4a41-a395-606fc8fffe2b\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx7v"
Jul 06 14:23:19.021914 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.020434    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c71659e5-9048-44b4-899c-081ede3cf7dc-etc-selinux\") pod \"aws-ebs-csi-driver-node-4jkd2\" (UID: \"c71659e5-9048-44b4-899c-081ede3cf7dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jkd2"
Jul 06 14:23:19.021914 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.020458    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1962350b-82b5-4bd5-b4ba-804113c8f8a2-iptables-alerter-script\") pod \"iptables-alerter-xjbjb\" (UID: \"1962350b-82b5-4bd5-b4ba-804113c8f8a2\") " pod="openshift-network-operator/iptables-alerter-xjbjb"
Jul 06 14:23:19.021914 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.020485    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/62c96d7e-de74-4544-b034-aee512c74793-multus-cni-dir\") pod \"multus-tbtc2\" (UID: \"62c96d7e-de74-4544-b034-aee512c74793\") " pod="openshift-multus/multus-tbtc2"
Jul 06 14:23:19.021914 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.020529    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/62c96d7e-de74-4544-b034-aee512c74793-host-var-lib-cni-bin\") pod \"multus-tbtc2\" (UID: \"62c96d7e-de74-4544-b034-aee512c74793\") " pod="openshift-multus/multus-tbtc2"
Jul 06 14:23:19.022716 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.020553    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c8975397-e166-4a41-a395-606fc8fffe2b-lib-modules\") pod \"tuned-fsx7v\" (UID: \"c8975397-e166-4a41-a395-606fc8fffe2b\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx7v"
Jul 06 14:23:19.022716 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.020530    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c8975397-e166-4a41-a395-606fc8fffe2b-etc-sysctl-d\") pod \"tuned-fsx7v\" (UID: \"c8975397-e166-4a41-a395-606fc8fffe2b\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx7v"
Jul 06 14:23:19.022716 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.020576    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6cbk\" (UniqueName: \"kubernetes.io/projected/c8975397-e166-4a41-a395-606fc8fffe2b-kube-api-access-g6cbk\") pod \"tuned-fsx7v\" (UID: \"c8975397-e166-4a41-a395-606fc8fffe2b\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx7v"
Jul 06 14:23:19.022716 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.020578    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/62c96d7e-de74-4544-b034-aee512c74793-multus-cni-dir\") pod \"multus-tbtc2\" (UID: \"62c96d7e-de74-4544-b034-aee512c74793\") " pod="openshift-multus/multus-tbtc2"
Jul 06 14:23:19.022716 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.020601    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c3769694-2787-4d0d-92cd-a7dc7fdbad46-system-cni-dir\") pod \"multus-additional-cni-plugins-k58jw\" (UID: \"c3769694-2787-4d0d-92cd-a7dc7fdbad46\") " pod="openshift-multus/multus-additional-cni-plugins-k58jw"
Jul 06 14:23:19.022716 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.020626    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/62c96d7e-de74-4544-b034-aee512c74793-host-var-lib-cni-bin\") pod \"multus-tbtc2\" (UID: \"62c96d7e-de74-4544-b034-aee512c74793\") " pod="openshift-multus/multus-tbtc2"
Jul 06 14:23:19.022716 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.020665    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c3769694-2787-4d0d-92cd-a7dc7fdbad46-os-release\") pod \"multus-additional-cni-plugins-k58jw\" (UID: \"c3769694-2787-4d0d-92cd-a7dc7fdbad46\") " pod="openshift-multus/multus-additional-cni-plugins-k58jw"
Jul 06 14:23:19.022716 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.020688    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c8975397-e166-4a41-a395-606fc8fffe2b-lib-modules\") pod \"tuned-fsx7v\" (UID: \"c8975397-e166-4a41-a395-606fc8fffe2b\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx7v"
Jul 06 14:23:19.022716 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.020695    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1962350b-82b5-4bd5-b4ba-804113c8f8a2-host-slash\") pod \"iptables-alerter-xjbjb\" (UID: \"1962350b-82b5-4bd5-b4ba-804113c8f8a2\") " pod="openshift-network-operator/iptables-alerter-xjbjb"
Jul 06 14:23:19.022716 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.020728    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8ca19c2c-b7bd-44a3-a792-2a91e0637866-env-overrides\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:19.022716 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.020749    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c3769694-2787-4d0d-92cd-a7dc7fdbad46-os-release\") pod \"multus-additional-cni-plugins-k58jw\" (UID: \"c3769694-2787-4d0d-92cd-a7dc7fdbad46\") " pod="openshift-multus/multus-additional-cni-plugins-k58jw"
Jul 06 14:23:19.022716 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.020753    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/62c96d7e-de74-4544-b034-aee512c74793-host-var-lib-kubelet\") pod \"multus-tbtc2\" (UID: \"62c96d7e-de74-4544-b034-aee512c74793\") " pod="openshift-multus/multus-tbtc2"
Jul 06 14:23:19.022716 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.020776    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/62c96d7e-de74-4544-b034-aee512c74793-multus-daemon-config\") pod \"multus-tbtc2\" (UID: \"62c96d7e-de74-4544-b034-aee512c74793\") " pod="openshift-multus/multus-tbtc2"
Jul 06 14:23:19.022716 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.020786    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c3769694-2787-4d0d-92cd-a7dc7fdbad46-system-cni-dir\") pod \"multus-additional-cni-plugins-k58jw\" (UID: \"c3769694-2787-4d0d-92cd-a7dc7fdbad46\") " pod="openshift-multus/multus-additional-cni-plugins-k58jw"
Jul 06 14:23:19.022716 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.020794    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ca19c2c-b7bd-44a3-a792-2a91e0637866-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:19.022716 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.020805    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1962350b-82b5-4bd5-b4ba-804113c8f8a2-host-slash\") pod \"iptables-alerter-xjbjb\" (UID: \"1962350b-82b5-4bd5-b4ba-804113c8f8a2\") " pod="openshift-network-operator/iptables-alerter-xjbjb"
Jul 06 14:23:19.022716 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.020915    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkdqd\" (UniqueName: \"kubernetes.io/projected/c71659e5-9048-44b4-899c-081ede3cf7dc-kube-api-access-dkdqd\") pod \"aws-ebs-csi-driver-node-4jkd2\" (UID: \"c71659e5-9048-44b4-899c-081ede3cf7dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jkd2"
Jul 06 14:23:19.023246 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.020913    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/62c96d7e-de74-4544-b034-aee512c74793-host-var-lib-kubelet\") pod \"multus-tbtc2\" (UID: \"62c96d7e-de74-4544-b034-aee512c74793\") " pod="openshift-multus/multus-tbtc2"
Jul 06 14:23:19.023246 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.020944    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ca19c2c-b7bd-44a3-a792-2a91e0637866-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:19.023246 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.020961    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1962350b-82b5-4bd5-b4ba-804113c8f8a2-iptables-alerter-script\") pod \"iptables-alerter-xjbjb\" (UID: \"1962350b-82b5-4bd5-b4ba-804113c8f8a2\") " pod="openshift-network-operator/iptables-alerter-xjbjb"
Jul 06 14:23:19.023246 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.020984    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8ca19c2c-b7bd-44a3-a792-2a91e0637866-run-ovn\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:19.023246 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.021078    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8ca19c2c-b7bd-44a3-a792-2a91e0637866-env-overrides\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:19.023246 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.021095    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ca19c2c-b7bd-44a3-a792-2a91e0637866-host-run-ovn-kubernetes\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:19.023246 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.021113    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8ca19c2c-b7bd-44a3-a792-2a91e0637866-run-ovn\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:19.023246 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.021156    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d3b974e0-a207-4976-8b28-07d878302459-host\") pod \"node-ca-bqxgr\" (UID: \"d3b974e0-a207-4976-8b28-07d878302459\") " pod="openshift-image-registry/node-ca-bqxgr"
Jul 06 14:23:19.023246 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.021183    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c3769694-2787-4d0d-92cd-a7dc7fdbad46-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k58jw\" (UID: \"c3769694-2787-4d0d-92cd-a7dc7fdbad46\") " pod="openshift-multus/multus-additional-cni-plugins-k58jw"
Jul 06 14:23:19.023246 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.021209    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ca19c2c-b7bd-44a3-a792-2a91e0637866-host-run-ovn-kubernetes\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:19.023246 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.021247    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d3b974e0-a207-4976-8b28-07d878302459-host\") pod \"node-ca-bqxgr\" (UID: \"d3b974e0-a207-4976-8b28-07d878302459\") " pod="openshift-image-registry/node-ca-bqxgr"
Jul 06 14:23:19.023246 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.021282    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8ca19c2c-b7bd-44a3-a792-2a91e0637866-systemd-units\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:19.023246 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.021314    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8ca19c2c-b7bd-44a3-a792-2a91e0637866-host-slash\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:19.023246 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.021351    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8ca19c2c-b7bd-44a3-a792-2a91e0637866-systemd-units\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:19.023246 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.021379    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8ca19c2c-b7bd-44a3-a792-2a91e0637866-node-log\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:19.023246 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.021441    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8ca19c2c-b7bd-44a3-a792-2a91e0637866-host-slash\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:19.023246 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.021522    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8ca19c2c-b7bd-44a3-a792-2a91e0637866-log-socket\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:19.023246 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.021524    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8ca19c2c-b7bd-44a3-a792-2a91e0637866-node-log\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:19.023803 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.021592    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8ca19c2c-b7bd-44a3-a792-2a91e0637866-host-cni-netd\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:19.023803 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.021611    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8ca19c2c-b7bd-44a3-a792-2a91e0637866-log-socket\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:19.023803 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.021624    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c3769694-2787-4d0d-92cd-a7dc7fdbad46-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k58jw\" (UID: \"c3769694-2787-4d0d-92cd-a7dc7fdbad46\") " pod="openshift-multus/multus-additional-cni-plugins-k58jw"
Jul 06 14:23:19.023803 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.021640    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8ca19c2c-b7bd-44a3-a792-2a91e0637866-host-cni-netd\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:19.023803 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.021664    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfb6p\" (UniqueName: \"kubernetes.io/projected/8ca19c2c-b7bd-44a3-a792-2a91e0637866-kube-api-access-kfb6p\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:19.023803 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.021694    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b717a842-24ed-4b29-ace1-7a1e9cde682d-agent-certs\") pod \"konnectivity-agent-p8t94\" (UID: \"b717a842-24ed-4b29-ace1-7a1e9cde682d\") " pod="kube-system/konnectivity-agent-p8t94"
Jul 06 14:23:19.023803 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.021721    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/62c96d7e-de74-4544-b034-aee512c74793-host-run-k8s-cni-cncf-io\") pod \"multus-tbtc2\" (UID: \"62c96d7e-de74-4544-b034-aee512c74793\") " pod="openshift-multus/multus-tbtc2"
Jul 06 14:23:19.023803 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.021742    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c8975397-e166-4a41-a395-606fc8fffe2b-etc-kubernetes\") pod \"tuned-fsx7v\" (UID: \"c8975397-e166-4a41-a395-606fc8fffe2b\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx7v"
Jul 06 14:23:19.023803 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.021764    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8975397-e166-4a41-a395-606fc8fffe2b-var-lib-kubelet\") pod \"tuned-fsx7v\" (UID: \"c8975397-e166-4a41-a395-606fc8fffe2b\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx7v"
Jul 06 14:23:19.023803 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.021787    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c3769694-2787-4d0d-92cd-a7dc7fdbad46-cni-binary-copy\") pod \"multus-additional-cni-plugins-k58jw\" (UID: \"c3769694-2787-4d0d-92cd-a7dc7fdbad46\") " pod="openshift-multus/multus-additional-cni-plugins-k58jw"
Jul 06 14:23:19.023803 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.021810    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pldbb\" (UniqueName: \"kubernetes.io/projected/1962350b-82b5-4bd5-b4ba-804113c8f8a2-kube-api-access-pldbb\") pod \"iptables-alerter-xjbjb\" (UID: \"1962350b-82b5-4bd5-b4ba-804113c8f8a2\") " pod="openshift-network-operator/iptables-alerter-xjbjb"
Jul 06 14:23:19.023803 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.021832    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ca19c2c-b7bd-44a3-a792-2a91e0637866-host-kubelet\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:19.023803 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.021853    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8ca19c2c-b7bd-44a3-a792-2a91e0637866-run-systemd\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:19.023803 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.021877    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ca19c2c-b7bd-44a3-a792-2a91e0637866-var-lib-openvswitch\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:19.023803 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.021891    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8975397-e166-4a41-a395-606fc8fffe2b-var-lib-kubelet\") pod \"tuned-fsx7v\" (UID: \"c8975397-e166-4a41-a395-606fc8fffe2b\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx7v"
Jul 06 14:23:19.023803 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.021903    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ca19c2c-b7bd-44a3-a792-2a91e0637866-run-openvswitch\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:19.023803 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.021927    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8ca19c2c-b7bd-44a3-a792-2a91e0637866-ovnkube-script-lib\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:19.024252 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.021931    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/62c96d7e-de74-4544-b034-aee512c74793-host-run-k8s-cni-cncf-io\") pod \"multus-tbtc2\" (UID: \"62c96d7e-de74-4544-b034-aee512c74793\") " pod="openshift-multus/multus-tbtc2"
Jul 06 14:23:19.024252 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.021970    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c8975397-e166-4a41-a395-606fc8fffe2b-etc-modprobe-d\") pod \"tuned-fsx7v\" (UID: \"c8975397-e166-4a41-a395-606fc8fffe2b\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx7v"
Jul 06 14:23:19.024252 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.021980    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c8975397-e166-4a41-a395-606fc8fffe2b-etc-kubernetes\") pod \"tuned-fsx7v\" (UID: \"c8975397-e166-4a41-a395-606fc8fffe2b\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx7v"
Jul 06 14:23:19.024252 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.021993    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c8975397-e166-4a41-a395-606fc8fffe2b-etc-systemd\") pod \"tuned-fsx7v\" (UID: \"c8975397-e166-4a41-a395-606fc8fffe2b\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx7v"
Jul 06 14:23:19.024252 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.022016    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8975397-e166-4a41-a395-606fc8fffe2b-sys\") pod \"tuned-fsx7v\" (UID: \"c8975397-e166-4a41-a395-606fc8fffe2b\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx7v"
Jul 06 14:23:19.024252 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.022019    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ca19c2c-b7bd-44a3-a792-2a91e0637866-var-lib-openvswitch\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:19.024252 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.022042    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a6c6da04-8e16-45a3-b8bc-e6dfa6ede872-original-pull-secret\") pod \"global-pull-secret-syncer-bgtbf\" (UID: \"a6c6da04-8e16-45a3-b8bc-e6dfa6ede872\") " pod="kube-system/global-pull-secret-syncer-bgtbf"
Jul 06 14:23:19.024252 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:19.022110    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 14:23:19.024252 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:19.022160    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6c6da04-8e16-45a3-b8bc-e6dfa6ede872-original-pull-secret podName:a6c6da04-8e16-45a3-b8bc-e6dfa6ede872 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:19.522142408 +0000 UTC m=+2.700791433 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a6c6da04-8e16-45a3-b8bc-e6dfa6ede872-original-pull-secret") pod "global-pull-secret-syncer-bgtbf" (UID: "a6c6da04-8e16-45a3-b8bc-e6dfa6ede872") : object "kube-system"/"original-pull-secret" not registered
Jul 06 14:23:19.024252 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.022202    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ca19c2c-b7bd-44a3-a792-2a91e0637866-host-kubelet\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:19.024252 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.022286    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c71659e5-9048-44b4-899c-081ede3cf7dc-socket-dir\") pod \"aws-ebs-csi-driver-node-4jkd2\" (UID: \"c71659e5-9048-44b4-899c-081ede3cf7dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jkd2"
Jul 06 14:23:19.024252 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.022302    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ca19c2c-b7bd-44a3-a792-2a91e0637866-run-openvswitch\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:19.024252 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.022428    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c71659e5-9048-44b4-899c-081ede3cf7dc-socket-dir\") pod \"aws-ebs-csi-driver-node-4jkd2\" (UID: \"c71659e5-9048-44b4-899c-081ede3cf7dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jkd2"
Jul 06 14:23:19.024252 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.022438    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8975397-e166-4a41-a395-606fc8fffe2b-sys\") pod \"tuned-fsx7v\" (UID: \"c8975397-e166-4a41-a395-606fc8fffe2b\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx7v"
Jul 06 14:23:19.024252 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.022476    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8ca19c2c-b7bd-44a3-a792-2a91e0637866-run-systemd\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:19.024252 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.022514    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c8975397-e166-4a41-a395-606fc8fffe2b-etc-tuned\") pod \"tuned-fsx7v\" (UID: \"c8975397-e166-4a41-a395-606fc8fffe2b\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx7v"
Jul 06 14:23:19.024252 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.022526    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c3769694-2787-4d0d-92cd-a7dc7fdbad46-cni-binary-copy\") pod \"multus-additional-cni-plugins-k58jw\" (UID: \"c3769694-2787-4d0d-92cd-a7dc7fdbad46\") " pod="openshift-multus/multus-additional-cni-plugins-k58jw"
Jul 06 14:23:19.024772 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.022596    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c8975397-e166-4a41-a395-606fc8fffe2b-tmp\") pod \"tuned-fsx7v\" (UID: \"c8975397-e166-4a41-a395-606fc8fffe2b\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx7v"
Jul 06 14:23:19.024772 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.022616    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c8975397-e166-4a41-a395-606fc8fffe2b-etc-systemd\") pod \"tuned-fsx7v\" (UID: \"c8975397-e166-4a41-a395-606fc8fffe2b\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx7v"
Jul 06 14:23:19.024772 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.022648    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8ca19c2c-b7bd-44a3-a792-2a91e0637866-ovn-node-metrics-cert\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:19.024772 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.022698    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c8975397-e166-4a41-a395-606fc8fffe2b-etc-modprobe-d\") pod \"tuned-fsx7v\" (UID: \"c8975397-e166-4a41-a395-606fc8fffe2b\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx7v"
Jul 06 14:23:19.024772 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.022871    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8ca19c2c-b7bd-44a3-a792-2a91e0637866-ovnkube-script-lib\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:19.024772 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.023863    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b717a842-24ed-4b29-ace1-7a1e9cde682d-agent-certs\") pod \"konnectivity-agent-p8t94\" (UID: \"b717a842-24ed-4b29-ace1-7a1e9cde682d\") " pod="kube-system/konnectivity-agent-p8t94"
Jul 06 14:23:19.026815 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:19.026794    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 14:23:19.026897 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:19.026821    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 14:23:19.026897 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:19.026835    2565 projected.go:196] Error preparing data for projected volume kube-api-access-5bw6t for pod openshift-network-diagnostics/network-check-target-dfsgm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:23:19.026968 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:19.026897    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17707cd3-41ff-4805-a140-934dd45b5547-kube-api-access-5bw6t podName:17707cd3-41ff-4805-a140-934dd45b5547 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:19.52688162 +0000 UTC m=+2.705530662 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5bw6t" (UniqueName: "kubernetes.io/projected/17707cd3-41ff-4805-a140-934dd45b5547-kube-api-access-5bw6t") pod "network-check-target-dfsgm" (UID: "17707cd3-41ff-4805-a140-934dd45b5547") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:23:19.028458 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.028441    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5g6x5\" (UniqueName: \"kubernetes.io/projected/62c96d7e-de74-4544-b034-aee512c74793-kube-api-access-5g6x5\") pod \"multus-tbtc2\" (UID: \"62c96d7e-de74-4544-b034-aee512c74793\") " pod="openshift-multus/multus-tbtc2"
Jul 06 14:23:19.028603 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.028587    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg2jf\" (UniqueName: \"kubernetes.io/projected/c3769694-2787-4d0d-92cd-a7dc7fdbad46-kube-api-access-rg2jf\") pod \"multus-additional-cni-plugins-k58jw\" (UID: \"c3769694-2787-4d0d-92cd-a7dc7fdbad46\") " pod="openshift-multus/multus-additional-cni-plugins-k58jw"
Jul 06 14:23:19.034023 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.034003    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfb6p\" (UniqueName: \"kubernetes.io/projected/8ca19c2c-b7bd-44a3-a792-2a91e0637866-kube-api-access-kfb6p\") pod \"ovnkube-node-ksgbf\" (UID: \"8ca19c2c-b7bd-44a3-a792-2a91e0637866\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:19.034098 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.034021    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbtzk\" (UniqueName: \"kubernetes.io/projected/d3b974e0-a207-4976-8b28-07d878302459-kube-api-access-pbtzk\") pod \"node-ca-bqxgr\" (UID: \"d3b974e0-a207-4976-8b28-07d878302459\") " pod="openshift-image-registry/node-ca-bqxgr"
Jul 06 14:23:19.034423 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.034408    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6cbk\" (UniqueName: \"kubernetes.io/projected/c8975397-e166-4a41-a395-606fc8fffe2b-kube-api-access-g6cbk\") pod \"tuned-fsx7v\" (UID: \"c8975397-e166-4a41-a395-606fc8fffe2b\") " pod="openshift-cluster-node-tuning-operator/tuned-fsx7v"
Jul 06 14:23:19.034938 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.034924    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkdqd\" (UniqueName: \"kubernetes.io/projected/c71659e5-9048-44b4-899c-081ede3cf7dc-kube-api-access-dkdqd\") pod \"aws-ebs-csi-driver-node-4jkd2\" (UID: \"c71659e5-9048-44b4-899c-081ede3cf7dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jkd2"
Jul 06 14:23:19.038596 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.038580    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pldbb\" (UniqueName: \"kubernetes.io/projected/1962350b-82b5-4bd5-b4ba-804113c8f8a2-kube-api-access-pldbb\") pod \"iptables-alerter-xjbjb\" (UID: \"1962350b-82b5-4bd5-b4ba-804113c8f8a2\") " pod="openshift-network-operator/iptables-alerter-xjbjb"
Jul 06 14:23:19.121140 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.121076    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 14:23:19.145669 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.145647    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-487gs"
Jul 06 14:23:19.154831 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:19.154812    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab8aa9ec_dfe2_450f_ad33_41ac93232eb5.slice/crio-df6be801188a64f75a4651bbc0e1b2a602d0cf18a38262f12cde581dfcfbd6d4 WatchSource:0}: Error finding container df6be801188a64f75a4651bbc0e1b2a602d0cf18a38262f12cde581dfcfbd6d4: Status 404 returned error can't find the container with id df6be801188a64f75a4651bbc0e1b2a602d0cf18a38262f12cde581dfcfbd6d4
Jul 06 14:23:19.166254 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.166238    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fsx7v"
Jul 06 14:23:19.170202 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.170188    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-k58jw"
Jul 06 14:23:19.172893 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:19.172875    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8975397_e166_4a41_a395_606fc8fffe2b.slice/crio-7b56f8fef35387d15239dba3d44639e9ed8798b7f4737296463e97aa0d2fc42b WatchSource:0}: Error finding container 7b56f8fef35387d15239dba3d44639e9ed8798b7f4737296463e97aa0d2fc42b: Status 404 returned error can't find the container with id 7b56f8fef35387d15239dba3d44639e9ed8798b7f4737296463e97aa0d2fc42b
Jul 06 14:23:19.177987 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:19.177967    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3769694_2787_4d0d_92cd_a7dc7fdbad46.slice/crio-31727f6a4c9254dd7bd73c4ca649c3a4c87606b9c41bb548252c903d919c2cfc WatchSource:0}: Error finding container 31727f6a4c9254dd7bd73c4ca649c3a4c87606b9c41bb548252c903d919c2cfc: Status 404 returned error can't find the container with id 31727f6a4c9254dd7bd73c4ca649c3a4c87606b9c41bb548252c903d919c2cfc
Jul 06 14:23:19.204973 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.204948    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tbtc2"
Jul 06 14:23:19.213991 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:19.213961    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62c96d7e_de74_4544_b034_aee512c74793.slice/crio-d6244671a53fc4e09685df951dd3d5a590480a504dd8705a54ae299ae0e9614b WatchSource:0}: Error finding container d6244671a53fc4e09685df951dd3d5a590480a504dd8705a54ae299ae0e9614b: Status 404 returned error can't find the container with id d6244671a53fc4e09685df951dd3d5a590480a504dd8705a54ae299ae0e9614b
Jul 06 14:23:19.219054 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.219039    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:19.225021 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.225003    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-p8t94"
Jul 06 14:23:19.225628 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:19.225607    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ca19c2c_b7bd_44a3_a792_2a91e0637866.slice/crio-3e621334105396cf6c9e695ee5920615f0d75bdf52763384f392596164f640bc WatchSource:0}: Error finding container 3e621334105396cf6c9e695ee5920615f0d75bdf52763384f392596164f640bc: Status 404 returned error can't find the container with id 3e621334105396cf6c9e695ee5920615f0d75bdf52763384f392596164f640bc
Jul 06 14:23:19.232499 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:19.232477    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb717a842_24ed_4b29_ace1_7a1e9cde682d.slice/crio-721f87ba22bc82a23888ef04671bb98bf16e2bfadd5fed9b8b30e6fc0bdd687d WatchSource:0}: Error finding container 721f87ba22bc82a23888ef04671bb98bf16e2bfadd5fed9b8b30e6fc0bdd687d: Status 404 returned error can't find the container with id 721f87ba22bc82a23888ef04671bb98bf16e2bfadd5fed9b8b30e6fc0bdd687d
Jul 06 14:23:19.247983 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.247962    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jkd2"
Jul 06 14:23:19.254692 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:19.254667    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc71659e5_9048_44b4_899c_081ede3cf7dc.slice/crio-fc223bcde9b69e982c710aaea96ec85f0f14bcf2281cda92a5c39058cbfaddd1 WatchSource:0}: Error finding container fc223bcde9b69e982c710aaea96ec85f0f14bcf2281cda92a5c39058cbfaddd1: Status 404 returned error can't find the container with id fc223bcde9b69e982c710aaea96ec85f0f14bcf2281cda92a5c39058cbfaddd1
Jul 06 14:23:19.269103 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.269075    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bqxgr"
Jul 06 14:23:19.276681 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.276660    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xjbjb"
Jul 06 14:23:19.277206 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:23:19.277185    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3b974e0_a207_4976_8b28_07d878302459.slice/crio-ac9458954ae573b04caebd12b8a745d580e33634ab39264c82e1ad6eeaf08d58 WatchSource:0}: Error finding container ac9458954ae573b04caebd12b8a745d580e33634ab39264c82e1ad6eeaf08d58: Status 404 returned error can't find the container with id ac9458954ae573b04caebd12b8a745d580e33634ab39264c82e1ad6eeaf08d58
Jul 06 14:23:19.377365 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.377248    2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 14:23:19.425137 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.425112    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c66051e-7f90-46b6-9189-1842d9f84426-metrics-certs\") pod \"network-metrics-daemon-ppp6z\" (UID: \"1c66051e-7f90-46b6-9189-1842d9f84426\") " pod="openshift-multus/network-metrics-daemon-ppp6z"
Jul 06 14:23:19.425282 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:19.425261    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:23:19.425335 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:19.425325    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c66051e-7f90-46b6-9189-1842d9f84426-metrics-certs podName:1c66051e-7f90-46b6-9189-1842d9f84426 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:20.425310443 +0000 UTC m=+3.603959467 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1c66051e-7f90-46b6-9189-1842d9f84426-metrics-certs") pod "network-metrics-daemon-ppp6z" (UID: "1c66051e-7f90-46b6-9189-1842d9f84426") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:23:19.525956 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.525914    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a6c6da04-8e16-45a3-b8bc-e6dfa6ede872-original-pull-secret\") pod \"global-pull-secret-syncer-bgtbf\" (UID: \"a6c6da04-8e16-45a3-b8bc-e6dfa6ede872\") " pod="kube-system/global-pull-secret-syncer-bgtbf"
Jul 06 14:23:19.526167 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:19.526147    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 14:23:19.526248 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:19.526235    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6c6da04-8e16-45a3-b8bc-e6dfa6ede872-original-pull-secret podName:a6c6da04-8e16-45a3-b8bc-e6dfa6ede872 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:20.526214831 +0000 UTC m=+3.704863874 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a6c6da04-8e16-45a3-b8bc-e6dfa6ede872-original-pull-secret") pod "global-pull-secret-syncer-bgtbf" (UID: "a6c6da04-8e16-45a3-b8bc-e6dfa6ede872") : object "kube-system"/"original-pull-secret" not registered
Jul 06 14:23:19.626681 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.626622    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bw6t\" (UniqueName: \"kubernetes.io/projected/17707cd3-41ff-4805-a140-934dd45b5547-kube-api-access-5bw6t\") pod \"network-check-target-dfsgm\" (UID: \"17707cd3-41ff-4805-a140-934dd45b5547\") " pod="openshift-network-diagnostics/network-check-target-dfsgm"
Jul 06 14:23:19.626854 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:19.626831    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 14:23:19.626854 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:19.626850    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 14:23:19.627042 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:19.626862    2565 projected.go:196] Error preparing data for projected volume kube-api-access-5bw6t for pod openshift-network-diagnostics/network-check-target-dfsgm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:23:19.627042 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:19.626933    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17707cd3-41ff-4805-a140-934dd45b5547-kube-api-access-5bw6t podName:17707cd3-41ff-4805-a140-934dd45b5547 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:20.626913348 +0000 UTC m=+3.805562392 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5bw6t" (UniqueName: "kubernetes.io/projected/17707cd3-41ff-4805-a140-934dd45b5547-kube-api-access-5bw6t") pod "network-check-target-dfsgm" (UID: "17707cd3-41ff-4805-a140-934dd45b5547") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:23:19.868177 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.868007    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 14:18:18 +0000 UTC" deadline="2028-02-09 21:54:54.552122625 +0000 UTC"
Jul 06 14:23:19.868177 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.868077    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13999h31m34.684049596s"
Jul 06 14:23:19.965755 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.965717    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 14:23:19.985251 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.985145    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xjbjb" event={"ID":"1962350b-82b5-4bd5-b4ba-804113c8f8a2","Type":"ContainerStarted","Data":"720946b6868056182413ba06b61b87c2bbe59dbd68aaf4a3392cdf05c546c19e"}
Jul 06 14:23:19.994877 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.994805    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-p8t94" event={"ID":"b717a842-24ed-4b29-ace1-7a1e9cde682d","Type":"ContainerStarted","Data":"721f87ba22bc82a23888ef04671bb98bf16e2bfadd5fed9b8b30e6fc0bdd687d"}
Jul 06 14:23:19.997175 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:19.997032    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fsx7v" event={"ID":"c8975397-e166-4a41-a395-606fc8fffe2b","Type":"ContainerStarted","Data":"7b56f8fef35387d15239dba3d44639e9ed8798b7f4737296463e97aa0d2fc42b"}
Jul 06 14:23:20.017808 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:20.017719    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-487gs" event={"ID":"ab8aa9ec-dfe2-450f-ad33-41ac93232eb5","Type":"ContainerStarted","Data":"df6be801188a64f75a4651bbc0e1b2a602d0cf18a38262f12cde581dfcfbd6d4"}
Jul 06 14:23:20.031978 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:20.031937    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-90.ec2.internal" event={"ID":"60ec09cbbb04b70f6c9c89c0e76536aa","Type":"ContainerStarted","Data":"17e9e8aef17f1eb941e9c21283e6cbf4a756c30b42317a96343af909fcbd0bfe"}
Jul 06 14:23:20.041313 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:20.041264    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bqxgr" event={"ID":"d3b974e0-a207-4976-8b28-07d878302459","Type":"ContainerStarted","Data":"ac9458954ae573b04caebd12b8a745d580e33634ab39264c82e1ad6eeaf08d58"}
Jul 06 14:23:20.043191 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:20.043162    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jkd2" event={"ID":"c71659e5-9048-44b4-899c-081ede3cf7dc","Type":"ContainerStarted","Data":"fc223bcde9b69e982c710aaea96ec85f0f14bcf2281cda92a5c39058cbfaddd1"}
Jul 06 14:23:20.046201 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:20.046170    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf" event={"ID":"8ca19c2c-b7bd-44a3-a792-2a91e0637866","Type":"ContainerStarted","Data":"3e621334105396cf6c9e695ee5920615f0d75bdf52763384f392596164f640bc"}
Jul 06 14:23:20.048975 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:20.048903    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tbtc2" event={"ID":"62c96d7e-de74-4544-b034-aee512c74793","Type":"ContainerStarted","Data":"d6244671a53fc4e09685df951dd3d5a590480a504dd8705a54ae299ae0e9614b"}
Jul 06 14:23:20.058226 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:20.058201    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k58jw" event={"ID":"c3769694-2787-4d0d-92cd-a7dc7fdbad46","Type":"ContainerStarted","Data":"31727f6a4c9254dd7bd73c4ca649c3a4c87606b9c41bb548252c903d919c2cfc"}
Jul 06 14:23:20.072119 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:20.072046    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-90.ec2.internal" event={"ID":"d0f234e3101ecdfbdf1e54df6d4f5e57","Type":"ContainerStarted","Data":"79db3f7899593a38f638ec4e5d83bd9092332fd80b48ef995d53e62d753e51c0"}
Jul 06 14:23:20.432390 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:20.432355    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c66051e-7f90-46b6-9189-1842d9f84426-metrics-certs\") pod \"network-metrics-daemon-ppp6z\" (UID: \"1c66051e-7f90-46b6-9189-1842d9f84426\") " pod="openshift-multus/network-metrics-daemon-ppp6z"
Jul 06 14:23:20.432578 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:20.432552    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:23:20.432641 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:20.432614    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c66051e-7f90-46b6-9189-1842d9f84426-metrics-certs podName:1c66051e-7f90-46b6-9189-1842d9f84426 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:22.432594012 +0000 UTC m=+5.611243041 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1c66051e-7f90-46b6-9189-1842d9f84426-metrics-certs") pod "network-metrics-daemon-ppp6z" (UID: "1c66051e-7f90-46b6-9189-1842d9f84426") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:23:20.463035 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:20.462913    2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 14:23:20.533612 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:20.533561    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a6c6da04-8e16-45a3-b8bc-e6dfa6ede872-original-pull-secret\") pod \"global-pull-secret-syncer-bgtbf\" (UID: \"a6c6da04-8e16-45a3-b8bc-e6dfa6ede872\") " pod="kube-system/global-pull-secret-syncer-bgtbf"
Jul 06 14:23:20.533790 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:20.533718    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 14:23:20.533790 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:20.533789    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6c6da04-8e16-45a3-b8bc-e6dfa6ede872-original-pull-secret podName:a6c6da04-8e16-45a3-b8bc-e6dfa6ede872 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:22.533767174 +0000 UTC m=+5.712416199 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a6c6da04-8e16-45a3-b8bc-e6dfa6ede872-original-pull-secret") pod "global-pull-secret-syncer-bgtbf" (UID: "a6c6da04-8e16-45a3-b8bc-e6dfa6ede872") : object "kube-system"/"original-pull-secret" not registered
Jul 06 14:23:20.634974 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:20.634939    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bw6t\" (UniqueName: \"kubernetes.io/projected/17707cd3-41ff-4805-a140-934dd45b5547-kube-api-access-5bw6t\") pod \"network-check-target-dfsgm\" (UID: \"17707cd3-41ff-4805-a140-934dd45b5547\") " pod="openshift-network-diagnostics/network-check-target-dfsgm"
Jul 06 14:23:20.635156 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:20.635093    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 14:23:20.635156 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:20.635114    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 14:23:20.635156 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:20.635126    2565 projected.go:196] Error preparing data for projected volume kube-api-access-5bw6t for pod openshift-network-diagnostics/network-check-target-dfsgm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:23:20.635305 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:20.635195    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17707cd3-41ff-4805-a140-934dd45b5547-kube-api-access-5bw6t podName:17707cd3-41ff-4805-a140-934dd45b5547 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:22.635175763 +0000 UTC m=+5.813824805 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5bw6t" (UniqueName: "kubernetes.io/projected/17707cd3-41ff-4805-a140-934dd45b5547-kube-api-access-5bw6t") pod "network-check-target-dfsgm" (UID: "17707cd3-41ff-4805-a140-934dd45b5547") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:23:20.868979 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:20.868888    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 14:18:18 +0000 UTC" deadline="2028-04-06 15:50:57.94586902 +0000 UTC"
Jul 06 14:23:20.868979 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:20.868930    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15361h27m37.076944082s"
Jul 06 14:23:20.948303 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:20.948250    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgtbf"
Jul 06 14:23:20.948303 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:20.948269    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ppp6z"
Jul 06 14:23:20.948559 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:20.948385    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfsgm"
Jul 06 14:23:20.948559 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:20.948390    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgtbf" podUID="a6c6da04-8e16-45a3-b8bc-e6dfa6ede872"
Jul 06 14:23:20.948559 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:20.948503    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfsgm" podUID="17707cd3-41ff-4805-a140-934dd45b5547"
Jul 06 14:23:20.948717 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:20.948629    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ppp6z" podUID="1c66051e-7f90-46b6-9189-1842d9f84426"
Jul 06 14:23:22.449562 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:22.449530    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c66051e-7f90-46b6-9189-1842d9f84426-metrics-certs\") pod \"network-metrics-daemon-ppp6z\" (UID: \"1c66051e-7f90-46b6-9189-1842d9f84426\") " pod="openshift-multus/network-metrics-daemon-ppp6z"
Jul 06 14:23:22.450027 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:22.449727    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:23:22.450027 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:22.449786    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c66051e-7f90-46b6-9189-1842d9f84426-metrics-certs podName:1c66051e-7f90-46b6-9189-1842d9f84426 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:26.449767641 +0000 UTC m=+9.628416668 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1c66051e-7f90-46b6-9189-1842d9f84426-metrics-certs") pod "network-metrics-daemon-ppp6z" (UID: "1c66051e-7f90-46b6-9189-1842d9f84426") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:23:22.550654 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:22.550604    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a6c6da04-8e16-45a3-b8bc-e6dfa6ede872-original-pull-secret\") pod \"global-pull-secret-syncer-bgtbf\" (UID: \"a6c6da04-8e16-45a3-b8bc-e6dfa6ede872\") " pod="kube-system/global-pull-secret-syncer-bgtbf"
Jul 06 14:23:22.550842 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:22.550811    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 14:23:22.550932 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:22.550878    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6c6da04-8e16-45a3-b8bc-e6dfa6ede872-original-pull-secret podName:a6c6da04-8e16-45a3-b8bc-e6dfa6ede872 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:26.550859171 +0000 UTC m=+9.729508198 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a6c6da04-8e16-45a3-b8bc-e6dfa6ede872-original-pull-secret") pod "global-pull-secret-syncer-bgtbf" (UID: "a6c6da04-8e16-45a3-b8bc-e6dfa6ede872") : object "kube-system"/"original-pull-secret" not registered
Jul 06 14:23:22.652487 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:22.652445    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bw6t\" (UniqueName: \"kubernetes.io/projected/17707cd3-41ff-4805-a140-934dd45b5547-kube-api-access-5bw6t\") pod \"network-check-target-dfsgm\" (UID: \"17707cd3-41ff-4805-a140-934dd45b5547\") " pod="openshift-network-diagnostics/network-check-target-dfsgm"
Jul 06 14:23:22.652765 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:22.652747    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 14:23:22.652875 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:22.652769    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 14:23:22.652875 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:22.652782    2565 projected.go:196] Error preparing data for projected volume kube-api-access-5bw6t for pod openshift-network-diagnostics/network-check-target-dfsgm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:23:22.652875 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:22.652851    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17707cd3-41ff-4805-a140-934dd45b5547-kube-api-access-5bw6t podName:17707cd3-41ff-4805-a140-934dd45b5547 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:26.6528331 +0000 UTC m=+9.831482140 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5bw6t" (UniqueName: "kubernetes.io/projected/17707cd3-41ff-4805-a140-934dd45b5547-kube-api-access-5bw6t") pod "network-check-target-dfsgm" (UID: "17707cd3-41ff-4805-a140-934dd45b5547") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:23:22.948085 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:22.948047    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ppp6z"
Jul 06 14:23:22.948085 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:22.948076    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfsgm"
Jul 06 14:23:22.948329 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:22.948059    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgtbf"
Jul 06 14:23:22.948329 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:22.948190    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ppp6z" podUID="1c66051e-7f90-46b6-9189-1842d9f84426"
Jul 06 14:23:22.948329 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:22.948290    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgtbf" podUID="a6c6da04-8e16-45a3-b8bc-e6dfa6ede872"
Jul 06 14:23:22.948495 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:22.948377    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfsgm" podUID="17707cd3-41ff-4805-a140-934dd45b5547"
Jul 06 14:23:24.948071 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:24.948036    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ppp6z"
Jul 06 14:23:24.948497 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:24.948074    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgtbf"
Jul 06 14:23:24.948497 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:24.948190    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ppp6z" podUID="1c66051e-7f90-46b6-9189-1842d9f84426"
Jul 06 14:23:24.948497 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:24.948265    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgtbf" podUID="a6c6da04-8e16-45a3-b8bc-e6dfa6ede872"
Jul 06 14:23:24.948497 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:24.948278    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfsgm"
Jul 06 14:23:24.948497 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:24.948386    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfsgm" podUID="17707cd3-41ff-4805-a140-934dd45b5547"
Jul 06 14:23:26.483211 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:26.483171    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c66051e-7f90-46b6-9189-1842d9f84426-metrics-certs\") pod \"network-metrics-daemon-ppp6z\" (UID: \"1c66051e-7f90-46b6-9189-1842d9f84426\") " pod="openshift-multus/network-metrics-daemon-ppp6z"
Jul 06 14:23:26.483700 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:26.483360    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:23:26.483700 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:26.483444    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c66051e-7f90-46b6-9189-1842d9f84426-metrics-certs podName:1c66051e-7f90-46b6-9189-1842d9f84426 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:34.483421645 +0000 UTC m=+17.662070690 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1c66051e-7f90-46b6-9189-1842d9f84426-metrics-certs") pod "network-metrics-daemon-ppp6z" (UID: "1c66051e-7f90-46b6-9189-1842d9f84426") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:23:26.583649 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:26.583615    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a6c6da04-8e16-45a3-b8bc-e6dfa6ede872-original-pull-secret\") pod \"global-pull-secret-syncer-bgtbf\" (UID: \"a6c6da04-8e16-45a3-b8bc-e6dfa6ede872\") " pod="kube-system/global-pull-secret-syncer-bgtbf"
Jul 06 14:23:26.583820 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:26.583781    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 14:23:26.583884 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:26.583851    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6c6da04-8e16-45a3-b8bc-e6dfa6ede872-original-pull-secret podName:a6c6da04-8e16-45a3-b8bc-e6dfa6ede872 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:34.583832493 +0000 UTC m=+17.762481520 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a6c6da04-8e16-45a3-b8bc-e6dfa6ede872-original-pull-secret") pod "global-pull-secret-syncer-bgtbf" (UID: "a6c6da04-8e16-45a3-b8bc-e6dfa6ede872") : object "kube-system"/"original-pull-secret" not registered
Jul 06 14:23:26.685016 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:26.684977    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bw6t\" (UniqueName: \"kubernetes.io/projected/17707cd3-41ff-4805-a140-934dd45b5547-kube-api-access-5bw6t\") pod \"network-check-target-dfsgm\" (UID: \"17707cd3-41ff-4805-a140-934dd45b5547\") " pod="openshift-network-diagnostics/network-check-target-dfsgm"
Jul 06 14:23:26.685216 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:26.685176    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 14:23:26.685216 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:26.685194    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 14:23:26.685216 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:26.685208    2565 projected.go:196] Error preparing data for projected volume kube-api-access-5bw6t for pod openshift-network-diagnostics/network-check-target-dfsgm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:23:26.685415 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:26.685270    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17707cd3-41ff-4805-a140-934dd45b5547-kube-api-access-5bw6t podName:17707cd3-41ff-4805-a140-934dd45b5547 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:34.685252242 +0000 UTC m=+17.863901273 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5bw6t" (UniqueName: "kubernetes.io/projected/17707cd3-41ff-4805-a140-934dd45b5547-kube-api-access-5bw6t") pod "network-check-target-dfsgm" (UID: "17707cd3-41ff-4805-a140-934dd45b5547") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:23:26.948195 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:26.948155    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgtbf"
Jul 06 14:23:26.948195 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:26.948194    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfsgm"
Jul 06 14:23:26.948459 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:26.948298    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgtbf" podUID="a6c6da04-8e16-45a3-b8bc-e6dfa6ede872"
Jul 06 14:23:26.948459 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:26.948392    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfsgm" podUID="17707cd3-41ff-4805-a140-934dd45b5547"
Jul 06 14:23:26.948552 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:26.948465    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ppp6z"
Jul 06 14:23:26.948592 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:26.948576    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ppp6z" podUID="1c66051e-7f90-46b6-9189-1842d9f84426"
Jul 06 14:23:28.948029 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:28.947997    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgtbf"
Jul 06 14:23:28.948029 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:28.948001    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfsgm"
Jul 06 14:23:28.948523 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:28.948124    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgtbf" podUID="a6c6da04-8e16-45a3-b8bc-e6dfa6ede872"
Jul 06 14:23:28.948523 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:28.948138    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ppp6z"
Jul 06 14:23:28.948523 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:28.948209    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfsgm" podUID="17707cd3-41ff-4805-a140-934dd45b5547"
Jul 06 14:23:28.948523 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:28.948316    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ppp6z" podUID="1c66051e-7f90-46b6-9189-1842d9f84426"
Jul 06 14:23:30.948020 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:30.947980    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgtbf"
Jul 06 14:23:30.948480 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:30.947980    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ppp6z"
Jul 06 14:23:30.948480 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:30.948108    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgtbf" podUID="a6c6da04-8e16-45a3-b8bc-e6dfa6ede872"
Jul 06 14:23:30.948480 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:30.947981    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfsgm"
Jul 06 14:23:30.948480 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:30.948171    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ppp6z" podUID="1c66051e-7f90-46b6-9189-1842d9f84426"
Jul 06 14:23:30.948480 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:30.948289    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfsgm" podUID="17707cd3-41ff-4805-a140-934dd45b5547"
Jul 06 14:23:32.948121 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:32.948075    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfsgm"
Jul 06 14:23:32.948121 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:32.948120    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgtbf"
Jul 06 14:23:32.948623 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:32.948106    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ppp6z"
Jul 06 14:23:32.948623 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:32.948204    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfsgm" podUID="17707cd3-41ff-4805-a140-934dd45b5547"
Jul 06 14:23:32.948623 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:32.948385    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgtbf" podUID="a6c6da04-8e16-45a3-b8bc-e6dfa6ede872"
Jul 06 14:23:32.948623 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:32.948496    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ppp6z" podUID="1c66051e-7f90-46b6-9189-1842d9f84426"
Jul 06 14:23:34.544412 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:34.544375    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c66051e-7f90-46b6-9189-1842d9f84426-metrics-certs\") pod \"network-metrics-daemon-ppp6z\" (UID: \"1c66051e-7f90-46b6-9189-1842d9f84426\") " pod="openshift-multus/network-metrics-daemon-ppp6z"
Jul 06 14:23:34.544823 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:34.544496    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:23:34.544823 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:34.544568    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c66051e-7f90-46b6-9189-1842d9f84426-metrics-certs podName:1c66051e-7f90-46b6-9189-1842d9f84426 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:50.544551943 +0000 UTC m=+33.723200968 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1c66051e-7f90-46b6-9189-1842d9f84426-metrics-certs") pod "network-metrics-daemon-ppp6z" (UID: "1c66051e-7f90-46b6-9189-1842d9f84426") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:23:34.645500 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:34.645445    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a6c6da04-8e16-45a3-b8bc-e6dfa6ede872-original-pull-secret\") pod \"global-pull-secret-syncer-bgtbf\" (UID: \"a6c6da04-8e16-45a3-b8bc-e6dfa6ede872\") " pod="kube-system/global-pull-secret-syncer-bgtbf"
Jul 06 14:23:34.645668 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:34.645644    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 14:23:34.645731 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:34.645713    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6c6da04-8e16-45a3-b8bc-e6dfa6ede872-original-pull-secret podName:a6c6da04-8e16-45a3-b8bc-e6dfa6ede872 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:50.645695903 +0000 UTC m=+33.824344926 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a6c6da04-8e16-45a3-b8bc-e6dfa6ede872-original-pull-secret") pod "global-pull-secret-syncer-bgtbf" (UID: "a6c6da04-8e16-45a3-b8bc-e6dfa6ede872") : object "kube-system"/"original-pull-secret" not registered
Jul 06 14:23:34.746597 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:34.746560    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bw6t\" (UniqueName: \"kubernetes.io/projected/17707cd3-41ff-4805-a140-934dd45b5547-kube-api-access-5bw6t\") pod \"network-check-target-dfsgm\" (UID: \"17707cd3-41ff-4805-a140-934dd45b5547\") " pod="openshift-network-diagnostics/network-check-target-dfsgm"
Jul 06 14:23:34.746839 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:34.746741    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 14:23:34.746839 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:34.746767    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 14:23:34.746839 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:34.746779    2565 projected.go:196] Error preparing data for projected volume kube-api-access-5bw6t for pod openshift-network-diagnostics/network-check-target-dfsgm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:23:34.746839 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:34.746833    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17707cd3-41ff-4805-a140-934dd45b5547-kube-api-access-5bw6t podName:17707cd3-41ff-4805-a140-934dd45b5547 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:50.746819151 +0000 UTC m=+33.925468175 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5bw6t" (UniqueName: "kubernetes.io/projected/17707cd3-41ff-4805-a140-934dd45b5547-kube-api-access-5bw6t") pod "network-check-target-dfsgm" (UID: "17707cd3-41ff-4805-a140-934dd45b5547") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:23:34.947442 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:34.947359    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfsgm"
Jul 06 14:23:34.947600 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:34.947478    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ppp6z"
Jul 06 14:23:34.947600 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:34.947491    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfsgm" podUID="17707cd3-41ff-4805-a140-934dd45b5547"
Jul 06 14:23:34.947600 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:34.947518    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgtbf"
Jul 06 14:23:34.947765 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:34.947633    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ppp6z" podUID="1c66051e-7f90-46b6-9189-1842d9f84426"
Jul 06 14:23:34.947765 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:34.947726    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgtbf" podUID="a6c6da04-8e16-45a3-b8bc-e6dfa6ede872"
Jul 06 14:23:36.947569 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:36.947528    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ppp6z"
Jul 06 14:23:36.947569 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:36.947561    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfsgm"
Jul 06 14:23:36.948063 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:36.947565    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgtbf"
Jul 06 14:23:36.948063 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:36.947672    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ppp6z" podUID="1c66051e-7f90-46b6-9189-1842d9f84426"
Jul 06 14:23:36.948063 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:36.947748    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfsgm" podUID="17707cd3-41ff-4805-a140-934dd45b5547"
Jul 06 14:23:36.948063 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:36.947803    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgtbf" podUID="a6c6da04-8e16-45a3-b8bc-e6dfa6ede872"
Jul 06 14:23:38.950585 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:38.948004    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgtbf"
Jul 06 14:23:38.950585 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:38.948250    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfsgm"
Jul 06 14:23:38.950585 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:38.948393    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgtbf" podUID="a6c6da04-8e16-45a3-b8bc-e6dfa6ede872"
Jul 06 14:23:38.950585 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:38.948492    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfsgm" podUID="17707cd3-41ff-4805-a140-934dd45b5547"
Jul 06 14:23:38.950585 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:38.948553    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ppp6z"
Jul 06 14:23:38.950585 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:38.948634    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ppp6z" podUID="1c66051e-7f90-46b6-9189-1842d9f84426"
Jul 06 14:23:39.120237 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:39.120041    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf" event={"ID":"8ca19c2c-b7bd-44a3-a792-2a91e0637866","Type":"ContainerStarted","Data":"346841245ec774e128d4a5b11ea57cdc7a16c0c8fbd5cc24af8b3d140ec66021"}
Jul 06 14:23:39.120405 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:39.120291    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf" event={"ID":"8ca19c2c-b7bd-44a3-a792-2a91e0637866","Type":"ContainerStarted","Data":"394598757d8704a847f6ef4b9e1fc5abc637dba8774c4876127124cb1cad4284"}
Jul 06 14:23:39.121679 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:39.121648    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tbtc2" event={"ID":"62c96d7e-de74-4544-b034-aee512c74793","Type":"ContainerStarted","Data":"05d9842a54852c544b82d2e0be423d3b289a8fd85e025704ddaada4c657cbad7"}
Jul 06 14:23:39.123160 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:39.123139    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-90.ec2.internal" event={"ID":"d0f234e3101ecdfbdf1e54df6d4f5e57","Type":"ContainerStarted","Data":"5f65545affc0d41ada95d36fc57e63c472fd8529b8cb6af578f7b230f6934f0d"}
Jul 06 14:23:39.124777 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:39.124747    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fsx7v" event={"ID":"c8975397-e166-4a41-a395-606fc8fffe2b","Type":"ContainerStarted","Data":"68b24c9e9a2c9d59950ecf90f3fc26fc790ffc0f28e9ec64a022d229e7304fcb"}
Jul 06 14:23:39.138033 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:39.137968    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-tbtc2" podStartSLOduration=1.668856509 podStartE2EDuration="21.137940646s" totalImagesPullingTime="19.469084137s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:23:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:23:39.137939319 +0000 UTC m=+22.316588365" watchObservedRunningTime="2026-07-06 14:23:39.137940646 +0000 UTC m=+22.316589682"
Jul 06 14:23:39.155498 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:39.155462    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-90.ec2.internal" podStartSLOduration=21.155450132 podStartE2EDuration="21.155450132s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:23:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:23:39.154965949 +0000 UTC m=+22.333614994" watchObservedRunningTime="2026-07-06 14:23:39.155450132 +0000 UTC m=+22.334099177"
Jul 06 14:23:39.170776 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:39.170738    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-fsx7v" podStartSLOduration=1.7019233040000001 podStartE2EDuration="21.170724197s" totalImagesPullingTime="19.468800893s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:23:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:23:39.170590002 +0000 UTC m=+22.349239061" watchObservedRunningTime="2026-07-06 14:23:39.170724197 +0000 UTC m=+22.349373242"
Jul 06 14:23:40.127926 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:40.127852    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xjbjb" event={"ID":"1962350b-82b5-4bd5-b4ba-804113c8f8a2","Type":"ContainerStarted","Data":"4648164574df858c68192f0e50f2d1fb79e2c8cd349fbd92237d04e7661b78d2"}
Jul 06 14:23:40.129201 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:40.129176    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-p8t94" event={"ID":"b717a842-24ed-4b29-ace1-7a1e9cde682d","Type":"ContainerStarted","Data":"16ecd8295ba8eb1823b2de6683510b093e6d96f53f9505667ada74f392631c75"}
Jul 06 14:23:40.130579 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:40.130558    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-487gs" event={"ID":"ab8aa9ec-dfe2-450f-ad33-41ac93232eb5","Type":"ContainerStarted","Data":"eca8fe41dd0768d621ce4cd5a421283141841d9f67eecd8e85856ed72f5cd582"}
Jul 06 14:23:40.131915 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:40.131895    2565 generic.go:356] "Generic (PLEG): container finished" podID="60ec09cbbb04b70f6c9c89c0e76536aa" containerID="f2675962edc4c8f5ebd88ba7cc115efe9d002745a51ccfd913f3874776c3f727" exitCode=0
Jul 06 14:23:40.131992 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:40.131957    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-90.ec2.internal" event={"ID":"60ec09cbbb04b70f6c9c89c0e76536aa","Type":"ContainerDied","Data":"f2675962edc4c8f5ebd88ba7cc115efe9d002745a51ccfd913f3874776c3f727"}
Jul 06 14:23:40.133330 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:40.133310    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bqxgr" event={"ID":"d3b974e0-a207-4976-8b28-07d878302459","Type":"ContainerStarted","Data":"cb004cb5876eac54a3c9c246d7392acf2d4a927f8ffd1b3a52df1a7d323cf499"}
Jul 06 14:23:40.134765 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:40.134742    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jkd2" event={"ID":"c71659e5-9048-44b4-899c-081ede3cf7dc","Type":"ContainerStarted","Data":"ef47e7231e675d5c1a045b7350b29d4e27fb15e018ce93383880439748483ee1"}
Jul 06 14:23:40.137315 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:40.137295    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf" event={"ID":"8ca19c2c-b7bd-44a3-a792-2a91e0637866","Type":"ContainerStarted","Data":"4637aaf19a6eda313753f34bf3c8d9384ed3a8c08f6c7c3c829696e2e113b2fe"}
Jul 06 14:23:40.137431 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:40.137391    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf" event={"ID":"8ca19c2c-b7bd-44a3-a792-2a91e0637866","Type":"ContainerStarted","Data":"e1c8c46439ae21102185033e21374f924cb92b5c4e8874402ec6d993bf568c62"}
Jul 06 14:23:40.137495 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:40.137444    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf" event={"ID":"8ca19c2c-b7bd-44a3-a792-2a91e0637866","Type":"ContainerStarted","Data":"2f58995160401999bd9b345143e2259d441646f67fdb1f9ad51e369b467562bf"}
Jul 06 14:23:40.137547 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:40.137498    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf" event={"ID":"8ca19c2c-b7bd-44a3-a792-2a91e0637866","Type":"ContainerStarted","Data":"2863cac2359bef78738caa4e069ba95e8ff3938e1911fb01aed1b1059c1d4cb3"}
Jul 06 14:23:40.138585 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:40.138564    2565 generic.go:356] "Generic (PLEG): container finished" podID="c3769694-2787-4d0d-92cd-a7dc7fdbad46" containerID="9f6a3335de1e155ff8fa358fdf0b08f1396872aef232cbd976c7db410a13e937" exitCode=0
Jul 06 14:23:40.138657 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:40.138633    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k58jw" event={"ID":"c3769694-2787-4d0d-92cd-a7dc7fdbad46","Type":"ContainerDied","Data":"9f6a3335de1e155ff8fa358fdf0b08f1396872aef232cbd976c7db410a13e937"}
Jul 06 14:23:40.146306 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:40.146270    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xjbjb" podStartSLOduration=2.777322695 podStartE2EDuration="22.146254523s" totalImagesPullingTime="19.368931828s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:23:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:23:40.145613599 +0000 UTC m=+23.324262635" watchObservedRunningTime="2026-07-06 14:23:40.146254523 +0000 UTC m=+23.324903573"
Jul 06 14:23:40.163993 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:40.163670    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bqxgr" podStartSLOduration=2.8128404849999997 podStartE2EDuration="22.163652829s" totalImagesPullingTime="19.350812344s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:23:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:23:40.162908541 +0000 UTC m=+23.341557588" watchObservedRunningTime="2026-07-06 14:23:40.163652829 +0000 UTC m=+23.342301876"
Jul 06 14:23:40.264270 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:40.264212    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-p8t94" podStartSLOduration=2.854496057 podStartE2EDuration="22.264190928s" totalImagesPullingTime="19.409694871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:23:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:23:40.230573101 +0000 UTC m=+23.409222148" watchObservedRunningTime="2026-07-06 14:23:40.264190928 +0000 UTC m=+23.442839975"
Jul 06 14:23:40.313760 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:40.313712    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-487gs" podStartSLOduration=3.826620611 podStartE2EDuration="23.313696894s" totalImagesPullingTime="19.487076283s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:23:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:23:40.311452148 +0000 UTC m=+23.490101195" watchObservedRunningTime="2026-07-06 14:23:40.313696894 +0000 UTC m=+23.492345939"
Jul 06 14:23:40.878554 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:40.878531    2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 06 14:23:40.894183 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:40.894090    2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T14:23:40.87855024Z","UUID":"a5447794-5ad5-4bc9-b904-3a5fc5d1f294","Handler":null,"Name":"","Endpoint":""}
Jul 06 14:23:40.895699 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:40.895683    2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 06 14:23:40.895793 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:40.895717    2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 06 14:23:40.947964 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:40.947816    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ppp6z"
Jul 06 14:23:40.947964 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:40.947841    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfsgm"
Jul 06 14:23:40.947964 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:40.947829    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgtbf"
Jul 06 14:23:40.948228 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:40.947994    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgtbf" podUID="a6c6da04-8e16-45a3-b8bc-e6dfa6ede872"
Jul 06 14:23:40.948228 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:40.947929    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ppp6z" podUID="1c66051e-7f90-46b6-9189-1842d9f84426"
Jul 06 14:23:40.948228 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:40.948069    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfsgm" podUID="17707cd3-41ff-4805-a140-934dd45b5547"
Jul 06 14:23:41.142722 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:41.142646    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-90.ec2.internal" event={"ID":"60ec09cbbb04b70f6c9c89c0e76536aa","Type":"ContainerStarted","Data":"d16de206e7ac403e2d2cbc059ec7c88be7e3c643635be03811f6c5bf28cc6389"}
Jul 06 14:23:41.144493 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:41.144469    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jkd2" event={"ID":"c71659e5-9048-44b4-899c-081ede3cf7dc","Type":"ContainerStarted","Data":"b3214f719e8aaf2f887e0ac316e75dd923796c5be32a0f9f9a05dc4b6901c564"}
Jul 06 14:23:41.156002 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:41.155960    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-90.ec2.internal" podStartSLOduration=23.155947658 podStartE2EDuration="23.155947658s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:23:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:23:41.15566805 +0000 UTC m=+24.334317097" watchObservedRunningTime="2026-07-06 14:23:41.155947658 +0000 UTC m=+24.334596704"
Jul 06 14:23:42.030392 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:42.030357    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-p8t94"
Jul 06 14:23:42.031078 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:42.031057    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-p8t94"
Jul 06 14:23:42.150903 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:42.150872    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf" event={"ID":"8ca19c2c-b7bd-44a3-a792-2a91e0637866","Type":"ContainerStarted","Data":"985f2b78bc75d1b352f16a15402169a60b6c96d99fdf41426eaeb022d1e03368"}
Jul 06 14:23:42.584738 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:42.584707    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-487gs_ab8aa9ec-dfe2-450f-ad33-41ac93232eb5/dns-node-resolver/0.log"
Jul 06 14:23:42.947655 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:42.947626    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfsgm"
Jul 06 14:23:42.947837 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:42.947626    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ppp6z"
Jul 06 14:23:42.947837 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:42.947723    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfsgm" podUID="17707cd3-41ff-4805-a140-934dd45b5547"
Jul 06 14:23:42.947930 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:42.947835    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ppp6z" podUID="1c66051e-7f90-46b6-9189-1842d9f84426"
Jul 06 14:23:42.947930 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:42.947626    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgtbf"
Jul 06 14:23:42.947993 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:42.947925    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgtbf" podUID="a6c6da04-8e16-45a3-b8bc-e6dfa6ede872"
Jul 06 14:23:43.155946 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:43.155914    2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 06 14:23:43.155946 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:43.155935    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jkd2" event={"ID":"c71659e5-9048-44b4-899c-081ede3cf7dc","Type":"ContainerStarted","Data":"69e919030dea46af6d46d41bcc69b259bba0538ce705f0b76e568d5a8c02b8a8"}
Jul 06 14:23:43.174061 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:43.173950    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jkd2" podStartSLOduration=3.319296664 podStartE2EDuration="25.173930935s" totalImagesPullingTime="21.854634271s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:23:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:23:43.17295409 +0000 UTC m=+26.351603137" watchObservedRunningTime="2026-07-06 14:23:43.173930935 +0000 UTC m=+26.352579984"
Jul 06 14:23:43.547071 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:43.547044    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bqxgr_d3b974e0-a207-4976-8b28-07d878302459/node-ca/0.log"
Jul 06 14:23:44.163081 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:44.162838    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf" event={"ID":"8ca19c2c-b7bd-44a3-a792-2a91e0637866","Type":"ContainerStarted","Data":"0781ef0baf1f4cc7ff000a53bdbc7d88aa7cbea5500c43f2e4bd2e2692ca15d0"}
Jul 06 14:23:44.195468 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:44.195417    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf" podStartSLOduration=6.546354046 podStartE2EDuration="26.195394959s" totalImagesPullingTime="19.649040913s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:23:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:23:44.19532091 +0000 UTC m=+27.373969972" watchObservedRunningTime="2026-07-06 14:23:44.195394959 +0000 UTC m=+27.374044003"
Jul 06 14:23:44.948366 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:44.948328    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgtbf"
Jul 06 14:23:44.948541 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:44.948332    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ppp6z"
Jul 06 14:23:44.948541 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:44.948457    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgtbf" podUID="a6c6da04-8e16-45a3-b8bc-e6dfa6ede872"
Jul 06 14:23:44.948541 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:44.948466    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfsgm"
Jul 06 14:23:44.948673 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:44.948546    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ppp6z" podUID="1c66051e-7f90-46b6-9189-1842d9f84426"
Jul 06 14:23:44.948673 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:44.948618    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfsgm" podUID="17707cd3-41ff-4805-a140-934dd45b5547"
Jul 06 14:23:45.165879 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:45.165847    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:45.166527 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:45.165943    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:45.166527 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:45.165994    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:45.182708 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:45.182679    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:45.182844 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:45.182813    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:23:46.947400 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:46.947369    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfsgm"
Jul 06 14:23:46.947747 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:46.947412    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgtbf"
Jul 06 14:23:46.947747 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:46.947414    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ppp6z"
Jul 06 14:23:46.947747 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:46.947479    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfsgm" podUID="17707cd3-41ff-4805-a140-934dd45b5547"
Jul 06 14:23:46.947747 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:46.947559    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgtbf" podUID="a6c6da04-8e16-45a3-b8bc-e6dfa6ede872"
Jul 06 14:23:46.947747 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:46.947656    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ppp6z" podUID="1c66051e-7f90-46b6-9189-1842d9f84426"
Jul 06 14:23:47.179736 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:47.179709    2565 generic.go:356] "Generic (PLEG): container finished" podID="c3769694-2787-4d0d-92cd-a7dc7fdbad46" containerID="787f1d48ba96ae8de76ac1fe7f4425038d9e0708474425decadbf3493f2f9ce8" exitCode=0
Jul 06 14:23:47.179872 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:47.179766    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k58jw" event={"ID":"c3769694-2787-4d0d-92cd-a7dc7fdbad46","Type":"ContainerDied","Data":"787f1d48ba96ae8de76ac1fe7f4425038d9e0708474425decadbf3493f2f9ce8"}
Jul 06 14:23:48.443780 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:48.443756    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-p8t94"
Jul 06 14:23:48.444474 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:48.444457    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-p8t94"
Jul 06 14:23:48.947841 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:48.947813    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgtbf"
Jul 06 14:23:48.948013 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:48.947901    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfsgm"
Jul 06 14:23:48.948013 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:48.947911    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgtbf" podUID="a6c6da04-8e16-45a3-b8bc-e6dfa6ede872"
Jul 06 14:23:48.948013 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:48.947926    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ppp6z"
Jul 06 14:23:48.948013 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:48.947990    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfsgm" podUID="17707cd3-41ff-4805-a140-934dd45b5547"
Jul 06 14:23:48.948159 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:48.948049    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ppp6z" podUID="1c66051e-7f90-46b6-9189-1842d9f84426"
Jul 06 14:23:49.185353 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:49.185310    2565 generic.go:356] "Generic (PLEG): container finished" podID="c3769694-2787-4d0d-92cd-a7dc7fdbad46" containerID="d288a8b71fc4e8439a141859ea684b92a0681b42f65f50e58e0addb421bf3cc4" exitCode=0
Jul 06 14:23:49.185502 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:49.185403    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k58jw" event={"ID":"c3769694-2787-4d0d-92cd-a7dc7fdbad46","Type":"ContainerDied","Data":"d288a8b71fc4e8439a141859ea684b92a0681b42f65f50e58e0addb421bf3cc4"}
Jul 06 14:23:50.581034 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:50.580860    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c66051e-7f90-46b6-9189-1842d9f84426-metrics-certs\") pod \"network-metrics-daemon-ppp6z\" (UID: \"1c66051e-7f90-46b6-9189-1842d9f84426\") " pod="openshift-multus/network-metrics-daemon-ppp6z"
Jul 06 14:23:50.581328 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:50.580995    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:23:50.581328 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:50.581139    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c66051e-7f90-46b6-9189-1842d9f84426-metrics-certs podName:1c66051e-7f90-46b6-9189-1842d9f84426 nodeName:}" failed. No retries permitted until 2026-07-06 14:24:22.581124839 +0000 UTC m=+65.759773863 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1c66051e-7f90-46b6-9189-1842d9f84426-metrics-certs") pod "network-metrics-daemon-ppp6z" (UID: "1c66051e-7f90-46b6-9189-1842d9f84426") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:23:50.682308 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:50.682287    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a6c6da04-8e16-45a3-b8bc-e6dfa6ede872-original-pull-secret\") pod \"global-pull-secret-syncer-bgtbf\" (UID: \"a6c6da04-8e16-45a3-b8bc-e6dfa6ede872\") " pod="kube-system/global-pull-secret-syncer-bgtbf"
Jul 06 14:23:50.682454 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:50.682436    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 14:23:50.682513 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:50.682502    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6c6da04-8e16-45a3-b8bc-e6dfa6ede872-original-pull-secret podName:a6c6da04-8e16-45a3-b8bc-e6dfa6ede872 nodeName:}" failed. No retries permitted until 2026-07-06 14:24:22.682486549 +0000 UTC m=+65.861135578 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a6c6da04-8e16-45a3-b8bc-e6dfa6ede872-original-pull-secret") pod "global-pull-secret-syncer-bgtbf" (UID: "a6c6da04-8e16-45a3-b8bc-e6dfa6ede872") : object "kube-system"/"original-pull-secret" not registered
Jul 06 14:23:50.783178 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:50.783101    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bw6t\" (UniqueName: \"kubernetes.io/projected/17707cd3-41ff-4805-a140-934dd45b5547-kube-api-access-5bw6t\") pod \"network-check-target-dfsgm\" (UID: \"17707cd3-41ff-4805-a140-934dd45b5547\") " pod="openshift-network-diagnostics/network-check-target-dfsgm"
Jul 06 14:23:50.783331 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:50.783297    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 14:23:50.783331 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:50.783322    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 14:23:50.783331 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:50.783335    2565 projected.go:196] Error preparing data for projected volume kube-api-access-5bw6t for pod openshift-network-diagnostics/network-check-target-dfsgm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:23:50.783520 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:50.783417    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17707cd3-41ff-4805-a140-934dd45b5547-kube-api-access-5bw6t podName:17707cd3-41ff-4805-a140-934dd45b5547 nodeName:}" failed. No retries permitted until 2026-07-06 14:24:22.783398511 +0000 UTC m=+65.962047552 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5bw6t" (UniqueName: "kubernetes.io/projected/17707cd3-41ff-4805-a140-934dd45b5547-kube-api-access-5bw6t") pod "network-check-target-dfsgm" (UID: "17707cd3-41ff-4805-a140-934dd45b5547") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:23:50.948306 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:50.948273    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ppp6z"
Jul 06 14:23:50.948493 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:50.948273    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgtbf"
Jul 06 14:23:50.948493 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:50.948407    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ppp6z" podUID="1c66051e-7f90-46b6-9189-1842d9f84426"
Jul 06 14:23:50.948493 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:50.948273    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfsgm"
Jul 06 14:23:50.951148 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:50.948805    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgtbf" podUID="a6c6da04-8e16-45a3-b8bc-e6dfa6ede872"
Jul 06 14:23:50.951148 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:50.948941    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfsgm" podUID="17707cd3-41ff-4805-a140-934dd45b5547"
Jul 06 14:23:51.192458 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:51.192423    2565 generic.go:356] "Generic (PLEG): container finished" podID="c3769694-2787-4d0d-92cd-a7dc7fdbad46" containerID="414b6f4eb03126cfccabab73ab1c538f3f0e570f8032b4a1d6f5b22d8dd69cb8" exitCode=0
Jul 06 14:23:51.192611 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:51.192471    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k58jw" event={"ID":"c3769694-2787-4d0d-92cd-a7dc7fdbad46","Type":"ContainerDied","Data":"414b6f4eb03126cfccabab73ab1c538f3f0e570f8032b4a1d6f5b22d8dd69cb8"}
Jul 06 14:23:52.947957 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:52.947921    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ppp6z"
Jul 06 14:23:52.947957 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:52.947956    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfsgm"
Jul 06 14:23:52.948443 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:52.947956    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgtbf"
Jul 06 14:23:52.948443 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:52.948053    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ppp6z" podUID="1c66051e-7f90-46b6-9189-1842d9f84426"
Jul 06 14:23:52.948443 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:52.948107    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfsgm" podUID="17707cd3-41ff-4805-a140-934dd45b5547"
Jul 06 14:23:52.948443 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:52.948174    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgtbf" podUID="a6c6da04-8e16-45a3-b8bc-e6dfa6ede872"
Jul 06 14:23:54.947683 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:54.947649    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ppp6z"
Jul 06 14:23:54.948086 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:54.947665    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfsgm"
Jul 06 14:23:54.948086 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:54.947800    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ppp6z" podUID="1c66051e-7f90-46b6-9189-1842d9f84426"
Jul 06 14:23:54.948086 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:54.947665    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgtbf"
Jul 06 14:23:54.948086 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:54.947834    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfsgm" podUID="17707cd3-41ff-4805-a140-934dd45b5547"
Jul 06 14:23:54.948086 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:54.947909    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgtbf" podUID="a6c6da04-8e16-45a3-b8bc-e6dfa6ede872"
Jul 06 14:23:56.947766 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:56.947744    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfsgm"
Jul 06 14:23:56.947766 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:56.947755    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ppp6z"
Jul 06 14:23:56.948086 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:56.947751    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgtbf"
Jul 06 14:23:56.948086 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:56.947841    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfsgm" podUID="17707cd3-41ff-4805-a140-934dd45b5547"
Jul 06 14:23:56.948086 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:56.947907    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgtbf" podUID="a6c6da04-8e16-45a3-b8bc-e6dfa6ede872"
Jul 06 14:23:56.948086 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:56.947970    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ppp6z" podUID="1c66051e-7f90-46b6-9189-1842d9f84426"
Jul 06 14:23:57.208299 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:57.208269    2565 generic.go:356] "Generic (PLEG): container finished" podID="c3769694-2787-4d0d-92cd-a7dc7fdbad46" containerID="8c7a6a49000b85d2dca01ce988f7683b0359c94ea7196abc4a3c01a326e9d59b" exitCode=0
Jul 06 14:23:57.208475 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:57.208304    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k58jw" event={"ID":"c3769694-2787-4d0d-92cd-a7dc7fdbad46","Type":"ContainerDied","Data":"8c7a6a49000b85d2dca01ce988f7683b0359c94ea7196abc4a3c01a326e9d59b"}
Jul 06 14:23:58.212827 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:58.212795    2565 generic.go:356] "Generic (PLEG): container finished" podID="c3769694-2787-4d0d-92cd-a7dc7fdbad46" containerID="1a047fdd80761a7e195d88a0669cef7b5cd40149e831631c49d5c733326624c7" exitCode=0
Jul 06 14:23:58.213190 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:58.212835    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k58jw" event={"ID":"c3769694-2787-4d0d-92cd-a7dc7fdbad46","Type":"ContainerDied","Data":"1a047fdd80761a7e195d88a0669cef7b5cd40149e831631c49d5c733326624c7"}
Jul 06 14:23:58.947967 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:58.947936    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgtbf"
Jul 06 14:23:58.948104 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:58.948031    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfsgm"
Jul 06 14:23:58.948104 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:58.948039    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgtbf" podUID="a6c6da04-8e16-45a3-b8bc-e6dfa6ede872"
Jul 06 14:23:58.948187 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:58.948118    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfsgm" podUID="17707cd3-41ff-4805-a140-934dd45b5547"
Jul 06 14:23:58.948187 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:58.948141    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ppp6z"
Jul 06 14:23:58.948251 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:23:58.948206    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ppp6z" podUID="1c66051e-7f90-46b6-9189-1842d9f84426"
Jul 06 14:23:59.218068 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:59.217988    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k58jw" event={"ID":"c3769694-2787-4d0d-92cd-a7dc7fdbad46","Type":"ContainerStarted","Data":"3aae23da15acd20fb75a35c7adf5412f1ed91d7a978a08ec32d89f4a4a3caf11"}
Jul 06 14:23:59.240020 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:23:59.239973    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-k58jw" podStartSLOduration=15.007851214 podStartE2EDuration="41.239958978s" totalImagesPullingTime="26.232107764s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:23:18 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:23:59.238932685 +0000 UTC m=+42.417581731" watchObservedRunningTime="2026-07-06 14:23:59.239958978 +0000 UTC m=+42.418608023"
Jul 06 14:24:00.948041 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:00.948003    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ppp6z"
Jul 06 14:24:00.948484 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:00.948003    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgtbf"
Jul 06 14:24:00.948484 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:24:00.948115    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ppp6z" podUID="1c66051e-7f90-46b6-9189-1842d9f84426"
Jul 06 14:24:00.948484 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:24:00.948220    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgtbf" podUID="a6c6da04-8e16-45a3-b8bc-e6dfa6ede872"
Jul 06 14:24:00.948484 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:00.948010    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfsgm"
Jul 06 14:24:00.948484 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:24:00.948307    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfsgm" podUID="17707cd3-41ff-4805-a140-934dd45b5547"
Jul 06 14:24:02.948250 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:02.948217    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgtbf"
Jul 06 14:24:02.948637 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:02.948261    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfsgm"
Jul 06 14:24:02.948637 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:02.948304    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ppp6z"
Jul 06 14:24:02.948637 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:24:02.948322    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgtbf" podUID="a6c6da04-8e16-45a3-b8bc-e6dfa6ede872"
Jul 06 14:24:02.948637 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:24:02.948404    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ppp6z" podUID="1c66051e-7f90-46b6-9189-1842d9f84426"
Jul 06 14:24:02.948637 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:24:02.948464    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfsgm" podUID="17707cd3-41ff-4805-a140-934dd45b5547"
Jul 06 14:24:02.977852 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:02.977819    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dfsgm"]
Jul 06 14:24:02.980727 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:02.980702    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bgtbf"]
Jul 06 14:24:02.981424 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:02.981405    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ppp6z"]
Jul 06 14:24:03.227108 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:03.227081    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgtbf"
Jul 06 14:24:03.227267 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:03.227081    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ppp6z"
Jul 06 14:24:03.227267 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:24:03.227181    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgtbf" podUID="a6c6da04-8e16-45a3-b8bc-e6dfa6ede872"
Jul 06 14:24:03.227383 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:24:03.227272    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ppp6z" podUID="1c66051e-7f90-46b6-9189-1842d9f84426"
Jul 06 14:24:03.227383 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:03.227081    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfsgm"
Jul 06 14:24:03.227383 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:24:03.227363    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfsgm" podUID="17707cd3-41ff-4805-a140-934dd45b5547"
Jul 06 14:24:04.948102 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:04.948024    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgtbf"
Jul 06 14:24:04.948102 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:04.948049    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ppp6z"
Jul 06 14:24:04.948508 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:04.948024    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfsgm"
Jul 06 14:24:04.948508 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:24:04.948117    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgtbf" podUID="a6c6da04-8e16-45a3-b8bc-e6dfa6ede872"
Jul 06 14:24:04.948508 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:24:04.948188    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfsgm" podUID="17707cd3-41ff-4805-a140-934dd45b5547"
Jul 06 14:24:04.948508 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:24:04.948262    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ppp6z" podUID="1c66051e-7f90-46b6-9189-1842d9f84426"
Jul 06 14:24:06.639440 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.639365    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-90.ec2.internal" event="NodeReady"
Jul 06 14:24:06.639781 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.639481    2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 06 14:24:06.691652 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.691616    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-n95sc"]
Jul 06 14:24:06.715681 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.715658    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-csd7r"]
Jul 06 14:24:06.715831 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.715795    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n95sc"
Jul 06 14:24:06.717644 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.717618    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 06 14:24:06.717860 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.717843    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 06 14:24:06.717860 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.717853    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-m58h6\""
Jul 06 14:24:06.734231 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.734209    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-n95sc"]
Jul 06 14:24:06.734311 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.734241    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-csd7r"]
Jul 06 14:24:06.734365 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.734323    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-csd7r"
Jul 06 14:24:06.736270 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.736252    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-r6zhh\""
Jul 06 14:24:06.736418 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.736403    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 06 14:24:06.736713 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.736698    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 06 14:24:06.736791 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.736728    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 06 14:24:06.736917 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.736902    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 06 14:24:06.797843 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.797818    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lg447"]
Jul 06 14:24:06.799457 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.799443    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lg447"
Jul 06 14:24:06.801376 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.801333    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 06 14:24:06.801459 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.801357    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 06 14:24:06.801459 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.801357    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zr548\""
Jul 06 14:24:06.801546 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.801488    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 06 14:24:06.806751 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.806733    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a8bbde3e-29b5-4dc5-8543-d255cd3779fe-crio-socket\") pod \"insights-runtime-extractor-csd7r\" (UID: \"a8bbde3e-29b5-4dc5-8543-d255cd3779fe\") " pod="openshift-insights/insights-runtime-extractor-csd7r"
Jul 06 14:24:06.806838 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.806761    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a8bbde3e-29b5-4dc5-8543-d255cd3779fe-data-volume\") pod \"insights-runtime-extractor-csd7r\" (UID: \"a8bbde3e-29b5-4dc5-8543-d255cd3779fe\") " pod="openshift-insights/insights-runtime-extractor-csd7r"
Jul 06 14:24:06.806838 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.806790    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a8bbde3e-29b5-4dc5-8543-d255cd3779fe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-csd7r\" (UID: \"a8bbde3e-29b5-4dc5-8543-d255cd3779fe\") " pod="openshift-insights/insights-runtime-extractor-csd7r"
Jul 06 14:24:06.806838 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.806807    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1ea88141-d7f6-4ab0-9541-ff9471ac3c5e-config-volume\") pod \"dns-default-n95sc\" (UID: \"1ea88141-d7f6-4ab0-9541-ff9471ac3c5e\") " pod="openshift-dns/dns-default-n95sc"
Jul 06 14:24:06.806996 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.806880    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mc564\" (UniqueName: \"kubernetes.io/projected/a8bbde3e-29b5-4dc5-8543-d255cd3779fe-kube-api-access-mc564\") pod \"insights-runtime-extractor-csd7r\" (UID: \"a8bbde3e-29b5-4dc5-8543-d255cd3779fe\") " pod="openshift-insights/insights-runtime-extractor-csd7r"
Jul 06 14:24:06.806996 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.806940    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a8bbde3e-29b5-4dc5-8543-d255cd3779fe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-csd7r\" (UID: \"a8bbde3e-29b5-4dc5-8543-d255cd3779fe\") " pod="openshift-insights/insights-runtime-extractor-csd7r"
Jul 06 14:24:06.806996 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.806978    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rw5v\" (UniqueName: \"kubernetes.io/projected/1ea88141-d7f6-4ab0-9541-ff9471ac3c5e-kube-api-access-2rw5v\") pod \"dns-default-n95sc\" (UID: \"1ea88141-d7f6-4ab0-9541-ff9471ac3c5e\") " pod="openshift-dns/dns-default-n95sc"
Jul 06 14:24:06.807102 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.807050    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1ea88141-d7f6-4ab0-9541-ff9471ac3c5e-metrics-tls\") pod \"dns-default-n95sc\" (UID: \"1ea88141-d7f6-4ab0-9541-ff9471ac3c5e\") " pod="openshift-dns/dns-default-n95sc"
Jul 06 14:24:06.807102 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.807080    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ea88141-d7f6-4ab0-9541-ff9471ac3c5e-tmp-dir\") pod \"dns-default-n95sc\" (UID: \"1ea88141-d7f6-4ab0-9541-ff9471ac3c5e\") " pod="openshift-dns/dns-default-n95sc"
Jul 06 14:24:06.810053 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.810032    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lg447"]
Jul 06 14:24:06.907950 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.907923    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rw5v\" (UniqueName: \"kubernetes.io/projected/1ea88141-d7f6-4ab0-9541-ff9471ac3c5e-kube-api-access-2rw5v\") pod \"dns-default-n95sc\" (UID: \"1ea88141-d7f6-4ab0-9541-ff9471ac3c5e\") " pod="openshift-dns/dns-default-n95sc"
Jul 06 14:24:06.908091 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.907983    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1ea88141-d7f6-4ab0-9541-ff9471ac3c5e-metrics-tls\") pod \"dns-default-n95sc\" (UID: \"1ea88141-d7f6-4ab0-9541-ff9471ac3c5e\") " pod="openshift-dns/dns-default-n95sc"
Jul 06 14:24:06.908091 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.908010    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ea88141-d7f6-4ab0-9541-ff9471ac3c5e-tmp-dir\") pod \"dns-default-n95sc\" (UID: \"1ea88141-d7f6-4ab0-9541-ff9471ac3c5e\") " pod="openshift-dns/dns-default-n95sc"
Jul 06 14:24:06.908091 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.908044    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a8bbde3e-29b5-4dc5-8543-d255cd3779fe-crio-socket\") pod \"insights-runtime-extractor-csd7r\" (UID: \"a8bbde3e-29b5-4dc5-8543-d255cd3779fe\") " pod="openshift-insights/insights-runtime-extractor-csd7r"
Jul 06 14:24:06.908091 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.908068    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a8bbde3e-29b5-4dc5-8543-d255cd3779fe-data-volume\") pod \"insights-runtime-extractor-csd7r\" (UID: \"a8bbde3e-29b5-4dc5-8543-d255cd3779fe\") " pod="openshift-insights/insights-runtime-extractor-csd7r"
Jul 06 14:24:06.908232 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.908115    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a8bbde3e-29b5-4dc5-8543-d255cd3779fe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-csd7r\" (UID: \"a8bbde3e-29b5-4dc5-8543-d255cd3779fe\") " pod="openshift-insights/insights-runtime-extractor-csd7r"
Jul 06 14:24:06.908232 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.908136    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1ea88141-d7f6-4ab0-9541-ff9471ac3c5e-config-volume\") pod \"dns-default-n95sc\" (UID: \"1ea88141-d7f6-4ab0-9541-ff9471ac3c5e\") " pod="openshift-dns/dns-default-n95sc"
Jul 06 14:24:06.908232 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.908160    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mc564\" (UniqueName: \"kubernetes.io/projected/a8bbde3e-29b5-4dc5-8543-d255cd3779fe-kube-api-access-mc564\") pod \"insights-runtime-extractor-csd7r\" (UID: \"a8bbde3e-29b5-4dc5-8543-d255cd3779fe\") " pod="openshift-insights/insights-runtime-extractor-csd7r"
Jul 06 14:24:06.908232 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.908198    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a8bbde3e-29b5-4dc5-8543-d255cd3779fe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-csd7r\" (UID: \"a8bbde3e-29b5-4dc5-8543-d255cd3779fe\") " pod="openshift-insights/insights-runtime-extractor-csd7r"
Jul 06 14:24:06.908232 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.908228    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/56bf0c61-4788-4eef-bc06-c4be35b8d420-cert\") pod \"ingress-canary-lg447\" (UID: \"56bf0c61-4788-4eef-bc06-c4be35b8d420\") " pod="openshift-ingress-canary/ingress-canary-lg447"
Jul 06 14:24:06.908402 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.908228    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a8bbde3e-29b5-4dc5-8543-d255cd3779fe-crio-socket\") pod \"insights-runtime-extractor-csd7r\" (UID: \"a8bbde3e-29b5-4dc5-8543-d255cd3779fe\") " pod="openshift-insights/insights-runtime-extractor-csd7r"
Jul 06 14:24:06.908402 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.908251    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg8jt\" (UniqueName: \"kubernetes.io/projected/56bf0c61-4788-4eef-bc06-c4be35b8d420-kube-api-access-pg8jt\") pod \"ingress-canary-lg447\" (UID: \"56bf0c61-4788-4eef-bc06-c4be35b8d420\") " pod="openshift-ingress-canary/ingress-canary-lg447"
Jul 06 14:24:06.908496 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.908420    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ea88141-d7f6-4ab0-9541-ff9471ac3c5e-tmp-dir\") pod \"dns-default-n95sc\" (UID: \"1ea88141-d7f6-4ab0-9541-ff9471ac3c5e\") " pod="openshift-dns/dns-default-n95sc"
Jul 06 14:24:06.908543 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.908510    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a8bbde3e-29b5-4dc5-8543-d255cd3779fe-data-volume\") pod \"insights-runtime-extractor-csd7r\" (UID: \"a8bbde3e-29b5-4dc5-8543-d255cd3779fe\") " pod="openshift-insights/insights-runtime-extractor-csd7r"
Jul 06 14:24:06.908726 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.908705    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a8bbde3e-29b5-4dc5-8543-d255cd3779fe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-csd7r\" (UID: \"a8bbde3e-29b5-4dc5-8543-d255cd3779fe\") " pod="openshift-insights/insights-runtime-extractor-csd7r"
Jul 06 14:24:06.908880 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.908861    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1ea88141-d7f6-4ab0-9541-ff9471ac3c5e-config-volume\") pod \"dns-default-n95sc\" (UID: \"1ea88141-d7f6-4ab0-9541-ff9471ac3c5e\") " pod="openshift-dns/dns-default-n95sc"
Jul 06 14:24:06.912092 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.912073    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1ea88141-d7f6-4ab0-9541-ff9471ac3c5e-metrics-tls\") pod \"dns-default-n95sc\" (UID: \"1ea88141-d7f6-4ab0-9541-ff9471ac3c5e\") " pod="openshift-dns/dns-default-n95sc"
Jul 06 14:24:06.912194 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.912075    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a8bbde3e-29b5-4dc5-8543-d255cd3779fe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-csd7r\" (UID: \"a8bbde3e-29b5-4dc5-8543-d255cd3779fe\") " pod="openshift-insights/insights-runtime-extractor-csd7r"
Jul 06 14:24:06.915978 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.915952    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rw5v\" (UniqueName: \"kubernetes.io/projected/1ea88141-d7f6-4ab0-9541-ff9471ac3c5e-kube-api-access-2rw5v\") pod \"dns-default-n95sc\" (UID: \"1ea88141-d7f6-4ab0-9541-ff9471ac3c5e\") " pod="openshift-dns/dns-default-n95sc"
Jul 06 14:24:06.916107 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.916035    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mc564\" (UniqueName: \"kubernetes.io/projected/a8bbde3e-29b5-4dc5-8543-d255cd3779fe-kube-api-access-mc564\") pod \"insights-runtime-extractor-csd7r\" (UID: \"a8bbde3e-29b5-4dc5-8543-d255cd3779fe\") " pod="openshift-insights/insights-runtime-extractor-csd7r"
Jul 06 14:24:06.947373 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.947329    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfsgm"
Jul 06 14:24:06.947475 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.947376    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ppp6z"
Jul 06 14:24:06.947563 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.947542    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgtbf"
Jul 06 14:24:06.949448 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.949430    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 14:24:06.949548 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.949532    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 14:24:06.949618 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.949557    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fbtwb\""
Jul 06 14:24:06.949618 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.949532    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 14:24:06.949618 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.949571    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5wq2g\""
Jul 06 14:24:06.949618 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:06.949599    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 14:24:07.009550 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:07.009513    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/56bf0c61-4788-4eef-bc06-c4be35b8d420-cert\") pod \"ingress-canary-lg447\" (UID: \"56bf0c61-4788-4eef-bc06-c4be35b8d420\") " pod="openshift-ingress-canary/ingress-canary-lg447"
Jul 06 14:24:07.009550 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:07.009550    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pg8jt\" (UniqueName: \"kubernetes.io/projected/56bf0c61-4788-4eef-bc06-c4be35b8d420-kube-api-access-pg8jt\") pod \"ingress-canary-lg447\" (UID: \"56bf0c61-4788-4eef-bc06-c4be35b8d420\") " pod="openshift-ingress-canary/ingress-canary-lg447"
Jul 06 14:24:07.011832 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:07.011806    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/56bf0c61-4788-4eef-bc06-c4be35b8d420-cert\") pod \"ingress-canary-lg447\" (UID: \"56bf0c61-4788-4eef-bc06-c4be35b8d420\") " pod="openshift-ingress-canary/ingress-canary-lg447"
Jul 06 14:24:07.018919 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:07.018896    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg8jt\" (UniqueName: \"kubernetes.io/projected/56bf0c61-4788-4eef-bc06-c4be35b8d420-kube-api-access-pg8jt\") pod \"ingress-canary-lg447\" (UID: \"56bf0c61-4788-4eef-bc06-c4be35b8d420\") " pod="openshift-ingress-canary/ingress-canary-lg447"
Jul 06 14:24:07.024727 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:07.024706    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n95sc"
Jul 06 14:24:07.042353 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:07.042317    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-csd7r"
Jul 06 14:24:07.107680 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:07.107640    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lg447"
Jul 06 14:24:07.172604 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:07.172579    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-n95sc"]
Jul 06 14:24:07.175557 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:07.175483    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-csd7r"]
Jul 06 14:24:07.180973 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:24:07.180940    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8bbde3e_29b5_4dc5_8543_d255cd3779fe.slice/crio-22c0487a46a048bdd2502e71131f50b8ad97af553e287c33c6958e56285a8d83 WatchSource:0}: Error finding container 22c0487a46a048bdd2502e71131f50b8ad97af553e287c33c6958e56285a8d83: Status 404 returned error can't find the container with id 22c0487a46a048bdd2502e71131f50b8ad97af553e287c33c6958e56285a8d83
Jul 06 14:24:07.234236 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:07.234211    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lg447"]
Jul 06 14:24:07.236599 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:07.236568    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-csd7r" event={"ID":"a8bbde3e-29b5-4dc5-8543-d255cd3779fe","Type":"ContainerStarted","Data":"22c0487a46a048bdd2502e71131f50b8ad97af553e287c33c6958e56285a8d83"}
Jul 06 14:24:07.237713 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:07.237682    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n95sc" event={"ID":"1ea88141-d7f6-4ab0-9541-ff9471ac3c5e","Type":"ContainerStarted","Data":"b54b540511e8bb2c8ec44344f926291e18c0e823695cdc54bfc5cd62ce0e1f43"}
Jul 06 14:24:07.237799 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:24:07.237710    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56bf0c61_4788_4eef_bc06_c4be35b8d420.slice/crio-367b450fe03330a4b80fde346d5c74e5cd9a085379ed364b7dda2235aaa1e988 WatchSource:0}: Error finding container 367b450fe03330a4b80fde346d5c74e5cd9a085379ed364b7dda2235aaa1e988: Status 404 returned error can't find the container with id 367b450fe03330a4b80fde346d5c74e5cd9a085379ed364b7dda2235aaa1e988
Jul 06 14:24:08.242517 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:08.242242    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lg447" event={"ID":"56bf0c61-4788-4eef-bc06-c4be35b8d420","Type":"ContainerStarted","Data":"367b450fe03330a4b80fde346d5c74e5cd9a085379ed364b7dda2235aaa1e988"}
Jul 06 14:24:12.254049 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:12.254006    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lg447" event={"ID":"56bf0c61-4788-4eef-bc06-c4be35b8d420","Type":"ContainerStarted","Data":"2277a62b014a5c3b704ed9aeb5f244c71ee69caec2de1bd43991e951ca10839f"}
Jul 06 14:24:12.256949 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:12.256896    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-csd7r" event={"ID":"a8bbde3e-29b5-4dc5-8543-d255cd3779fe","Type":"ContainerStarted","Data":"52137e22de0fadf3f7e7337937462316370243f057e88ecc2604d8c69497ce86"}
Jul 06 14:24:12.258899 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:12.258857    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n95sc" event={"ID":"1ea88141-d7f6-4ab0-9541-ff9471ac3c5e","Type":"ContainerStarted","Data":"5f1ebfa13d79ad9d31e83108ed65a12ef4377af800727ea1fe964ede1230a9d5"}
Jul 06 14:24:12.259019 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:12.258907    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n95sc" event={"ID":"1ea88141-d7f6-4ab0-9541-ff9471ac3c5e","Type":"ContainerStarted","Data":"986104f8b058cae2ee17a0349eb7759341be84221e6e2072f4969decbcb73f3f"}
Jul 06 14:24:12.259302 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:12.259287    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-n95sc"
Jul 06 14:24:12.270827 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:12.270783    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lg447" podStartSLOduration=1.459188611 podStartE2EDuration="6.270769832s" totalImagesPullingTime="4.811581221s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:24:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:24:12.269806911 +0000 UTC m=+55.448455957" watchObservedRunningTime="2026-07-06 14:24:12.270769832 +0000 UTC m=+55.449418855"
Jul 06 14:24:12.291074 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:12.291029    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-n95sc" podStartSLOduration=1.4196187359999999 podStartE2EDuration="6.291014074s" totalImagesPullingTime="4.871395338s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:24:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:24:12.28998068 +0000 UTC m=+55.468629727" watchObservedRunningTime="2026-07-06 14:24:12.291014074 +0000 UTC m=+55.469663120"
Jul 06 14:24:12.432287 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:12.432218    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ct2gw"]
Jul 06 14:24:12.435114 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:12.435094    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ct2gw"
Jul 06 14:24:12.440646 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:12.440617    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 06 14:24:12.440966 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:12.440948    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-5crgz\""
Jul 06 14:24:12.460801 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:12.460779    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ct2gw"]
Jul 06 14:24:12.553741 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:12.553705    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f4bce6b1-da2c-4584-89c5-072da3205aee-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-ct2gw\" (UID: \"f4bce6b1-da2c-4584-89c5-072da3205aee\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ct2gw"
Jul 06 14:24:12.654925 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:12.654896    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f4bce6b1-da2c-4584-89c5-072da3205aee-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-ct2gw\" (UID: \"f4bce6b1-da2c-4584-89c5-072da3205aee\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ct2gw"
Jul 06 14:24:12.655116 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:24:12.655096    2565 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 06 14:24:12.655190 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:24:12.655172    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4bce6b1-da2c-4584-89c5-072da3205aee-tls-certificates podName:f4bce6b1-da2c-4584-89c5-072da3205aee nodeName:}" failed. No retries permitted until 2026-07-06 14:24:13.155148528 +0000 UTC m=+56.333797562 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/f4bce6b1-da2c-4584-89c5-072da3205aee-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-ct2gw" (UID: "f4bce6b1-da2c-4584-89c5-072da3205aee") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 06 14:24:13.150933 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:13.150782    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-78859cf567-429pl"]
Jul 06 14:24:13.153729 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:13.153715    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78859cf567-429pl"
Jul 06 14:24:13.155765 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:13.155740    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 06 14:24:13.155885 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:13.155800    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 06 14:24:13.156244 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:13.156225    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 06 14:24:13.156312 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:13.156245    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 06 14:24:13.156312 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:13.156271    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 06 14:24:13.156312 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:13.156232    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-f5fmd\""
Jul 06 14:24:13.156447 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:13.156233    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 06 14:24:13.156447 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:13.156389    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 06 14:24:13.158270 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:13.158249    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f4bce6b1-da2c-4584-89c5-072da3205aee-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-ct2gw\" (UID: \"f4bce6b1-da2c-4584-89c5-072da3205aee\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ct2gw"
Jul 06 14:24:13.161713 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:13.161693    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f4bce6b1-da2c-4584-89c5-072da3205aee-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-ct2gw\" (UID: \"f4bce6b1-da2c-4584-89c5-072da3205aee\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ct2gw"
Jul 06 14:24:13.165331 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:13.165311    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78859cf567-429pl"]
Jul 06 14:24:13.259478 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:13.259441    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/07355b0b-792e-48d5-bc8b-3c52b0a9a155-console-serving-cert\") pod \"console-78859cf567-429pl\" (UID: \"07355b0b-792e-48d5-bc8b-3c52b0a9a155\") " pod="openshift-console/console-78859cf567-429pl"
Jul 06 14:24:13.259478 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:13.259483    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/07355b0b-792e-48d5-bc8b-3c52b0a9a155-console-oauth-config\") pod \"console-78859cf567-429pl\" (UID: \"07355b0b-792e-48d5-bc8b-3c52b0a9a155\") " pod="openshift-console/console-78859cf567-429pl"
Jul 06 14:24:13.260001 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:13.259566    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/07355b0b-792e-48d5-bc8b-3c52b0a9a155-oauth-serving-cert\") pod \"console-78859cf567-429pl\" (UID: \"07355b0b-792e-48d5-bc8b-3c52b0a9a155\") " pod="openshift-console/console-78859cf567-429pl"
Jul 06 14:24:13.260001 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:13.259629    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/07355b0b-792e-48d5-bc8b-3c52b0a9a155-service-ca\") pod \"console-78859cf567-429pl\" (UID: \"07355b0b-792e-48d5-bc8b-3c52b0a9a155\") " pod="openshift-console/console-78859cf567-429pl"
Jul 06 14:24:13.260001 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:13.259683    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/07355b0b-792e-48d5-bc8b-3c52b0a9a155-console-config\") pod \"console-78859cf567-429pl\" (UID: \"07355b0b-792e-48d5-bc8b-3c52b0a9a155\") " pod="openshift-console/console-78859cf567-429pl"
Jul 06 14:24:13.260001 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:13.259707    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlpnz\" (UniqueName: \"kubernetes.io/projected/07355b0b-792e-48d5-bc8b-3c52b0a9a155-kube-api-access-hlpnz\") pod \"console-78859cf567-429pl\" (UID: \"07355b0b-792e-48d5-bc8b-3c52b0a9a155\") " pod="openshift-console/console-78859cf567-429pl"
Jul 06 14:24:13.263058 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:13.263033    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-csd7r" event={"ID":"a8bbde3e-29b5-4dc5-8543-d255cd3779fe","Type":"ContainerStarted","Data":"9342567197ddf5df7d8e4747a80d2486020693054ccb11381ef5aa7350354fcb"}
Jul 06 14:24:13.343876 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:13.343841    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ct2gw"
Jul 06 14:24:13.360975 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:13.360936    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/07355b0b-792e-48d5-bc8b-3c52b0a9a155-console-config\") pod \"console-78859cf567-429pl\" (UID: \"07355b0b-792e-48d5-bc8b-3c52b0a9a155\") " pod="openshift-console/console-78859cf567-429pl"
Jul 06 14:24:13.361117 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:13.360984    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlpnz\" (UniqueName: \"kubernetes.io/projected/07355b0b-792e-48d5-bc8b-3c52b0a9a155-kube-api-access-hlpnz\") pod \"console-78859cf567-429pl\" (UID: \"07355b0b-792e-48d5-bc8b-3c52b0a9a155\") " pod="openshift-console/console-78859cf567-429pl"
Jul 06 14:24:13.361117 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:13.361027    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/07355b0b-792e-48d5-bc8b-3c52b0a9a155-console-serving-cert\") pod \"console-78859cf567-429pl\" (UID: \"07355b0b-792e-48d5-bc8b-3c52b0a9a155\") " pod="openshift-console/console-78859cf567-429pl"
Jul 06 14:24:13.361117 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:13.361053    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/07355b0b-792e-48d5-bc8b-3c52b0a9a155-console-oauth-config\") pod \"console-78859cf567-429pl\" (UID: \"07355b0b-792e-48d5-bc8b-3c52b0a9a155\") " pod="openshift-console/console-78859cf567-429pl"
Jul 06 14:24:13.361117 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:13.361109    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/07355b0b-792e-48d5-bc8b-3c52b0a9a155-oauth-serving-cert\") pod \"console-78859cf567-429pl\" (UID: \"07355b0b-792e-48d5-bc8b-3c52b0a9a155\") " pod="openshift-console/console-78859cf567-429pl"
Jul 06 14:24:13.361420 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:13.361387    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/07355b0b-792e-48d5-bc8b-3c52b0a9a155-service-ca\") pod \"console-78859cf567-429pl\" (UID: \"07355b0b-792e-48d5-bc8b-3c52b0a9a155\") " pod="openshift-console/console-78859cf567-429pl"
Jul 06 14:24:13.361752 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:13.361725    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/07355b0b-792e-48d5-bc8b-3c52b0a9a155-console-config\") pod \"console-78859cf567-429pl\" (UID: \"07355b0b-792e-48d5-bc8b-3c52b0a9a155\") " pod="openshift-console/console-78859cf567-429pl"
Jul 06 14:24:13.361951 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:13.361933    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/07355b0b-792e-48d5-bc8b-3c52b0a9a155-oauth-serving-cert\") pod \"console-78859cf567-429pl\" (UID: \"07355b0b-792e-48d5-bc8b-3c52b0a9a155\") " pod="openshift-console/console-78859cf567-429pl"
Jul 06 14:24:13.362187 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:13.362164    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/07355b0b-792e-48d5-bc8b-3c52b0a9a155-service-ca\") pod \"console-78859cf567-429pl\" (UID: \"07355b0b-792e-48d5-bc8b-3c52b0a9a155\") " pod="openshift-console/console-78859cf567-429pl"
Jul 06 14:24:13.363546 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:13.363526    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/07355b0b-792e-48d5-bc8b-3c52b0a9a155-console-serving-cert\") pod \"console-78859cf567-429pl\" (UID: \"07355b0b-792e-48d5-bc8b-3c52b0a9a155\") " pod="openshift-console/console-78859cf567-429pl"
Jul 06 14:24:13.363690 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:13.363671    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/07355b0b-792e-48d5-bc8b-3c52b0a9a155-console-oauth-config\") pod \"console-78859cf567-429pl\" (UID: \"07355b0b-792e-48d5-bc8b-3c52b0a9a155\") " pod="openshift-console/console-78859cf567-429pl"
Jul 06 14:24:13.371470 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:13.371446    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlpnz\" (UniqueName: \"kubernetes.io/projected/07355b0b-792e-48d5-bc8b-3c52b0a9a155-kube-api-access-hlpnz\") pod \"console-78859cf567-429pl\" (UID: \"07355b0b-792e-48d5-bc8b-3c52b0a9a155\") " pod="openshift-console/console-78859cf567-429pl"
Jul 06 14:24:13.462743 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:13.462688    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78859cf567-429pl"
Jul 06 14:24:13.506909 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:13.506830    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ct2gw"]
Jul 06 14:24:13.510116 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:24:13.510076    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4bce6b1_da2c_4584_89c5_072da3205aee.slice/crio-44d4008fa2b9c90f1ee7d86ac6ab98ea367ab67f79f9d319bd9d09167aa7baf0 WatchSource:0}: Error finding container 44d4008fa2b9c90f1ee7d86ac6ab98ea367ab67f79f9d319bd9d09167aa7baf0: Status 404 returned error can't find the container with id 44d4008fa2b9c90f1ee7d86ac6ab98ea367ab67f79f9d319bd9d09167aa7baf0
Jul 06 14:24:13.598999 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:13.598958    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78859cf567-429pl"]
Jul 06 14:24:13.602546 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:24:13.602516    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07355b0b_792e_48d5_bc8b_3c52b0a9a155.slice/crio-9db5dad8e8bfa436d1c859541e68c73ef99b12df0e96cea947bbb82edc2b77f2 WatchSource:0}: Error finding container 9db5dad8e8bfa436d1c859541e68c73ef99b12df0e96cea947bbb82edc2b77f2: Status 404 returned error can't find the container with id 9db5dad8e8bfa436d1c859541e68c73ef99b12df0e96cea947bbb82edc2b77f2
Jul 06 14:24:14.267980 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:14.267940    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78859cf567-429pl" event={"ID":"07355b0b-792e-48d5-bc8b-3c52b0a9a155","Type":"ContainerStarted","Data":"9db5dad8e8bfa436d1c859541e68c73ef99b12df0e96cea947bbb82edc2b77f2"}
Jul 06 14:24:14.269733 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:14.269673    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ct2gw" event={"ID":"f4bce6b1-da2c-4584-89c5-072da3205aee","Type":"ContainerStarted","Data":"44d4008fa2b9c90f1ee7d86ac6ab98ea367ab67f79f9d319bd9d09167aa7baf0"}
Jul 06 14:24:16.278182 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:16.277769    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ct2gw" event={"ID":"f4bce6b1-da2c-4584-89c5-072da3205aee","Type":"ContainerStarted","Data":"e72eb378411c660cf3592b36c1add55823328022ff31d1ecf33f085947afa14b"}
Jul 06 14:24:16.278182 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:16.277974    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ct2gw"
Jul 06 14:24:16.280371 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:16.280283    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-csd7r" event={"ID":"a8bbde3e-29b5-4dc5-8543-d255cd3779fe","Type":"ContainerStarted","Data":"e89498831f87b7ef4d8e18879c6852611b440440e06f82267a3b5944c2f80825"}
Jul 06 14:24:16.283576 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:16.283552    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ct2gw"
Jul 06 14:24:16.295980 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:16.295923    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ct2gw" podStartSLOduration=1.9337901199999998 podStartE2EDuration="4.295905133s" totalImagesPullingTime="2.362115013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:24:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:24:16.294724698 +0000 UTC m=+59.473373759" watchObservedRunningTime="2026-07-06 14:24:16.295905133 +0000 UTC m=+59.474554181"
Jul 06 14:24:16.326965 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:16.326913    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-csd7r" podStartSLOduration=1.7578608180000002 podStartE2EDuration="10.326891938s" totalImagesPullingTime="8.56903112s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:24:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:24:16.325923696 +0000 UTC m=+59.504572775" watchObservedRunningTime="2026-07-06 14:24:16.326891938 +0000 UTC m=+59.505541004"
Jul 06 14:24:16.470327 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:16.470289    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-j9899"]
Jul 06 14:24:16.474584 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:16.474557    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-j9899"
Jul 06 14:24:16.477091 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:16.477061    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 06 14:24:16.477230 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:16.477121    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 06 14:24:16.477230 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:16.477073    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 06 14:24:16.477230 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:16.477193    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-wnbn6\""
Jul 06 14:24:16.477435 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:16.477289    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 06 14:24:16.477435 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:16.477317    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 06 14:24:16.490642 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:16.490614    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-j9899"]
Jul 06 14:24:16.587973 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:16.587886    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f73cfe28-7220-4535-8486-d9d6a363d23e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-j9899\" (UID: \"f73cfe28-7220-4535-8486-d9d6a363d23e\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-j9899"
Jul 06 14:24:16.587973 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:16.587942    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fnfx\" (UniqueName: \"kubernetes.io/projected/f73cfe28-7220-4535-8486-d9d6a363d23e-kube-api-access-2fnfx\") pod \"prometheus-operator-567f7b8b7c-j9899\" (UID: \"f73cfe28-7220-4535-8486-d9d6a363d23e\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-j9899"
Jul 06 14:24:16.588167 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:16.588033    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f73cfe28-7220-4535-8486-d9d6a363d23e-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-j9899\" (UID: \"f73cfe28-7220-4535-8486-d9d6a363d23e\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-j9899"
Jul 06 14:24:16.588167 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:16.588072    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f73cfe28-7220-4535-8486-d9d6a363d23e-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-j9899\" (UID: \"f73cfe28-7220-4535-8486-d9d6a363d23e\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-j9899"
Jul 06 14:24:16.688711 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:16.688675    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f73cfe28-7220-4535-8486-d9d6a363d23e-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-j9899\" (UID: \"f73cfe28-7220-4535-8486-d9d6a363d23e\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-j9899"
Jul 06 14:24:16.688711 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:16.688722    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f73cfe28-7220-4535-8486-d9d6a363d23e-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-j9899\" (UID: \"f73cfe28-7220-4535-8486-d9d6a363d23e\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-j9899"
Jul 06 14:24:16.688961 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:16.688828    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f73cfe28-7220-4535-8486-d9d6a363d23e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-j9899\" (UID: \"f73cfe28-7220-4535-8486-d9d6a363d23e\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-j9899"
Jul 06 14:24:16.688961 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:16.688864    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fnfx\" (UniqueName: \"kubernetes.io/projected/f73cfe28-7220-4535-8486-d9d6a363d23e-kube-api-access-2fnfx\") pod \"prometheus-operator-567f7b8b7c-j9899\" (UID: \"f73cfe28-7220-4535-8486-d9d6a363d23e\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-j9899"
Jul 06 14:24:16.689665 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:16.689626    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f73cfe28-7220-4535-8486-d9d6a363d23e-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-j9899\" (UID: \"f73cfe28-7220-4535-8486-d9d6a363d23e\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-j9899"
Jul 06 14:24:16.691504 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:16.691463    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f73cfe28-7220-4535-8486-d9d6a363d23e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-j9899\" (UID: \"f73cfe28-7220-4535-8486-d9d6a363d23e\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-j9899"
Jul 06 14:24:16.691612 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:16.691524    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f73cfe28-7220-4535-8486-d9d6a363d23e-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-j9899\" (UID: \"f73cfe28-7220-4535-8486-d9d6a363d23e\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-j9899"
Jul 06 14:24:16.696961 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:16.696938    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fnfx\" (UniqueName: \"kubernetes.io/projected/f73cfe28-7220-4535-8486-d9d6a363d23e-kube-api-access-2fnfx\") pod \"prometheus-operator-567f7b8b7c-j9899\" (UID: \"f73cfe28-7220-4535-8486-d9d6a363d23e\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-j9899"
Jul 06 14:24:16.784330 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:16.784286    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-j9899"
Jul 06 14:24:17.190641 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:17.190621    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ksgbf"
Jul 06 14:24:17.205352 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:17.205302    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-j9899"]
Jul 06 14:24:17.208642 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:24:17.208619    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf73cfe28_7220_4535_8486_d9d6a363d23e.slice/crio-539ff34e395a30e849f159dcdbb8603646580cd212f9438097d3363f32b377ea WatchSource:0}: Error finding container 539ff34e395a30e849f159dcdbb8603646580cd212f9438097d3363f32b377ea: Status 404 returned error can't find the container with id 539ff34e395a30e849f159dcdbb8603646580cd212f9438097d3363f32b377ea
Jul 06 14:24:17.284931 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:17.284889    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78859cf567-429pl" event={"ID":"07355b0b-792e-48d5-bc8b-3c52b0a9a155","Type":"ContainerStarted","Data":"bb23edf153e62c8b1a9e9ccc80acb887642fd25e7c798d48a5eddea9bab3297a"}
Jul 06 14:24:17.286047 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:17.286021    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-j9899" event={"ID":"f73cfe28-7220-4535-8486-d9d6a363d23e","Type":"ContainerStarted","Data":"539ff34e395a30e849f159dcdbb8603646580cd212f9438097d3363f32b377ea"}
Jul 06 14:24:17.304575 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:17.304527    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-78859cf567-429pl" podStartSLOduration=0.770038204 podStartE2EDuration="4.304511673s" totalImagesPullingTime="3.534473469s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:24:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:24:17.303944668 +0000 UTC m=+60.482593715" watchObservedRunningTime="2026-07-06 14:24:17.304511673 +0000 UTC m=+60.483160802"
Jul 06 14:24:19.295707 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:19.295680    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-j9899" event={"ID":"f73cfe28-7220-4535-8486-d9d6a363d23e","Type":"ContainerStarted","Data":"ed0284ef95996607871b6e2c27e5ac099aaaee74244864b488bf27115a1c86c2"}
Jul 06 14:24:20.300659 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:20.300623    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-j9899" event={"ID":"f73cfe28-7220-4535-8486-d9d6a363d23e","Type":"ContainerStarted","Data":"a3aa1d24284f911ee6394311f81a63e03005ab594143974d8f6bf8db365daca7"}
Jul 06 14:24:20.317887 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:20.317839    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-j9899" podStartSLOduration=2.331358352 podStartE2EDuration="4.317825363s" totalImagesPullingTime="1.986467011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:24:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:24:20.317484161 +0000 UTC m=+63.496133221" watchObservedRunningTime="2026-07-06 14:24:20.317825363 +0000 UTC m=+63.496474408"
Jul 06 14:24:21.542022 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.541987    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-846f7b859f-v929t"]
Jul 06 14:24:21.544500 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.544478    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-846f7b859f-v929t"
Jul 06 14:24:21.551064 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.551045    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 06 14:24:21.557559 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.557537    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-846f7b859f-v929t"]
Jul 06 14:24:21.630022 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.629993    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3a428a99-c8d9-4d2e-bc55-6dbfc9575bda-oauth-serving-cert\") pod \"console-846f7b859f-v929t\" (UID: \"3a428a99-c8d9-4d2e-bc55-6dbfc9575bda\") " pod="openshift-console/console-846f7b859f-v929t"
Jul 06 14:24:21.630022 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.630021    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3a428a99-c8d9-4d2e-bc55-6dbfc9575bda-console-config\") pod \"console-846f7b859f-v929t\" (UID: \"3a428a99-c8d9-4d2e-bc55-6dbfc9575bda\") " pod="openshift-console/console-846f7b859f-v929t"
Jul 06 14:24:21.630219 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.630047    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a428a99-c8d9-4d2e-bc55-6dbfc9575bda-trusted-ca-bundle\") pod \"console-846f7b859f-v929t\" (UID: \"3a428a99-c8d9-4d2e-bc55-6dbfc9575bda\") " pod="openshift-console/console-846f7b859f-v929t"
Jul 06 14:24:21.630219 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.630104    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5t8d\" (UniqueName: \"kubernetes.io/projected/3a428a99-c8d9-4d2e-bc55-6dbfc9575bda-kube-api-access-x5t8d\") pod \"console-846f7b859f-v929t\" (UID: \"3a428a99-c8d9-4d2e-bc55-6dbfc9575bda\") " pod="openshift-console/console-846f7b859f-v929t"
Jul 06 14:24:21.630219 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.630139    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3a428a99-c8d9-4d2e-bc55-6dbfc9575bda-service-ca\") pod \"console-846f7b859f-v929t\" (UID: \"3a428a99-c8d9-4d2e-bc55-6dbfc9575bda\") " pod="openshift-console/console-846f7b859f-v929t"
Jul 06 14:24:21.630219 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.630179    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a428a99-c8d9-4d2e-bc55-6dbfc9575bda-console-serving-cert\") pod \"console-846f7b859f-v929t\" (UID: \"3a428a99-c8d9-4d2e-bc55-6dbfc9575bda\") " pod="openshift-console/console-846f7b859f-v929t"
Jul 06 14:24:21.630219 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.630217    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3a428a99-c8d9-4d2e-bc55-6dbfc9575bda-console-oauth-config\") pod \"console-846f7b859f-v929t\" (UID: \"3a428a99-c8d9-4d2e-bc55-6dbfc9575bda\") " pod="openshift-console/console-846f7b859f-v929t"
Jul 06 14:24:21.730735 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.730696    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a428a99-c8d9-4d2e-bc55-6dbfc9575bda-trusted-ca-bundle\") pod \"console-846f7b859f-v929t\" (UID: \"3a428a99-c8d9-4d2e-bc55-6dbfc9575bda\") " pod="openshift-console/console-846f7b859f-v929t"
Jul 06 14:24:21.730735 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.730738    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5t8d\" (UniqueName: \"kubernetes.io/projected/3a428a99-c8d9-4d2e-bc55-6dbfc9575bda-kube-api-access-x5t8d\") pod \"console-846f7b859f-v929t\" (UID: \"3a428a99-c8d9-4d2e-bc55-6dbfc9575bda\") " pod="openshift-console/console-846f7b859f-v929t"
Jul 06 14:24:21.731034 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.730761    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3a428a99-c8d9-4d2e-bc55-6dbfc9575bda-service-ca\") pod \"console-846f7b859f-v929t\" (UID: \"3a428a99-c8d9-4d2e-bc55-6dbfc9575bda\") " pod="openshift-console/console-846f7b859f-v929t"
Jul 06 14:24:21.731034 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.730801    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a428a99-c8d9-4d2e-bc55-6dbfc9575bda-console-serving-cert\") pod \"console-846f7b859f-v929t\" (UID: \"3a428a99-c8d9-4d2e-bc55-6dbfc9575bda\") " pod="openshift-console/console-846f7b859f-v929t"
Jul 06 14:24:21.731034 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.730817    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3a428a99-c8d9-4d2e-bc55-6dbfc9575bda-console-oauth-config\") pod \"console-846f7b859f-v929t\" (UID: \"3a428a99-c8d9-4d2e-bc55-6dbfc9575bda\") " pod="openshift-console/console-846f7b859f-v929t"
Jul 06 14:24:21.731034 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.730859    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3a428a99-c8d9-4d2e-bc55-6dbfc9575bda-oauth-serving-cert\") pod \"console-846f7b859f-v929t\" (UID: \"3a428a99-c8d9-4d2e-bc55-6dbfc9575bda\") " pod="openshift-console/console-846f7b859f-v929t"
Jul 06 14:24:21.731034 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.730880    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3a428a99-c8d9-4d2e-bc55-6dbfc9575bda-console-config\") pod \"console-846f7b859f-v929t\" (UID: \"3a428a99-c8d9-4d2e-bc55-6dbfc9575bda\") " pod="openshift-console/console-846f7b859f-v929t"
Jul 06 14:24:21.731667 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.731644    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3a428a99-c8d9-4d2e-bc55-6dbfc9575bda-console-config\") pod \"console-846f7b859f-v929t\" (UID: \"3a428a99-c8d9-4d2e-bc55-6dbfc9575bda\") " pod="openshift-console/console-846f7b859f-v929t"
Jul 06 14:24:21.731667 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.731650    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3a428a99-c8d9-4d2e-bc55-6dbfc9575bda-service-ca\") pod \"console-846f7b859f-v929t\" (UID: \"3a428a99-c8d9-4d2e-bc55-6dbfc9575bda\") " pod="openshift-console/console-846f7b859f-v929t"
Jul 06 14:24:21.731814 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.731708    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a428a99-c8d9-4d2e-bc55-6dbfc9575bda-trusted-ca-bundle\") pod \"console-846f7b859f-v929t\" (UID: \"3a428a99-c8d9-4d2e-bc55-6dbfc9575bda\") " pod="openshift-console/console-846f7b859f-v929t"
Jul 06 14:24:21.731814 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.731766    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3a428a99-c8d9-4d2e-bc55-6dbfc9575bda-oauth-serving-cert\") pod \"console-846f7b859f-v929t\" (UID: \"3a428a99-c8d9-4d2e-bc55-6dbfc9575bda\") " pod="openshift-console/console-846f7b859f-v929t"
Jul 06 14:24:21.733221 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.733198    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3a428a99-c8d9-4d2e-bc55-6dbfc9575bda-console-oauth-config\") pod \"console-846f7b859f-v929t\" (UID: \"3a428a99-c8d9-4d2e-bc55-6dbfc9575bda\") " pod="openshift-console/console-846f7b859f-v929t"
Jul 06 14:24:21.733375 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.733334    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a428a99-c8d9-4d2e-bc55-6dbfc9575bda-console-serving-cert\") pod \"console-846f7b859f-v929t\" (UID: \"3a428a99-c8d9-4d2e-bc55-6dbfc9575bda\") " pod="openshift-console/console-846f7b859f-v929t"
Jul 06 14:24:21.743529 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.743509    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5t8d\" (UniqueName: \"kubernetes.io/projected/3a428a99-c8d9-4d2e-bc55-6dbfc9575bda-kube-api-access-x5t8d\") pod \"console-846f7b859f-v929t\" (UID: \"3a428a99-c8d9-4d2e-bc55-6dbfc9575bda\") " pod="openshift-console/console-846f7b859f-v929t"
Jul 06 14:24:21.822637 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.822566    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-tfwrt"]
Jul 06 14:24:21.826015 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.825998    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-tfwrt"
Jul 06 14:24:21.828009 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.827988    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 06 14:24:21.828352 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.828322    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-kx7v4\""
Jul 06 14:24:21.828454 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.828325    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 06 14:24:21.835098 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.835067    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-gsgv7"]
Jul 06 14:24:21.839145 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.839126    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-tfwrt"]
Jul 06 14:24:21.839231 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.839216    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gsgv7"
Jul 06 14:24:21.841261 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.841237    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 06 14:24:21.841396 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.841356    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 06 14:24:21.841538 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.841514    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-k77mc\""
Jul 06 14:24:21.842007 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.841988    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 06 14:24:21.842096 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.842047    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dsmqp"]
Jul 06 14:24:21.844490 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.844472    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dsmqp"
Jul 06 14:24:21.846917 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.846899    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 06 14:24:21.846917 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.846914    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 06 14:24:21.847812 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.847779    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 06 14:24:21.847915 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.847907    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-8spmr\""
Jul 06 14:24:21.852938 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.852876    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-846f7b859f-v929t"
Jul 06 14:24:21.860565 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.860541    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dsmqp"]
Jul 06 14:24:21.931905 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.931880    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/493ba4e0-525e-469c-8734-6f95bed71371-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-dsmqp\" (UID: \"493ba4e0-525e-469c-8734-6f95bed71371\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dsmqp"
Jul 06 14:24:21.932024 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.931943    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/680e4718-1d23-4146-b8b2-bf8970690dfd-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-tfwrt\" (UID: \"680e4718-1d23-4146-b8b2-bf8970690dfd\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-tfwrt"
Jul 06 14:24:21.932024 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.931973    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c9f1193d-c182-4701-a021-4bc4f2d8b344-node-exporter-textfile\") pod \"node-exporter-gsgv7\" (UID: \"c9f1193d-c182-4701-a021-4bc4f2d8b344\") " pod="openshift-monitoring/node-exporter-gsgv7"
Jul 06 14:24:21.932024 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.931999    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9f1193d-c182-4701-a021-4bc4f2d8b344-metrics-client-ca\") pod \"node-exporter-gsgv7\" (UID: \"c9f1193d-c182-4701-a021-4bc4f2d8b344\") " pod="openshift-monitoring/node-exporter-gsgv7"
Jul 06 14:24:21.932192 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.932024    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zskxr\" (UniqueName: \"kubernetes.io/projected/493ba4e0-525e-469c-8734-6f95bed71371-kube-api-access-zskxr\") pod \"kube-state-metrics-7c9dbb8b7d-dsmqp\" (UID: \"493ba4e0-525e-469c-8734-6f95bed71371\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dsmqp"
Jul 06 14:24:21.932192 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.932117    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c9f1193d-c182-4701-a021-4bc4f2d8b344-root\") pod \"node-exporter-gsgv7\" (UID: \"c9f1193d-c182-4701-a021-4bc4f2d8b344\") " pod="openshift-monitoring/node-exporter-gsgv7"
Jul 06 14:24:21.932192 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.932151    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/493ba4e0-525e-469c-8734-6f95bed71371-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-dsmqp\" (UID: \"493ba4e0-525e-469c-8734-6f95bed71371\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dsmqp"
Jul 06 14:24:21.932330 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.932189    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbh48\" (UniqueName: \"kubernetes.io/projected/680e4718-1d23-4146-b8b2-bf8970690dfd-kube-api-access-cbh48\") pod \"openshift-state-metrics-54cf96dfcf-tfwrt\" (UID: \"680e4718-1d23-4146-b8b2-bf8970690dfd\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-tfwrt"
Jul 06 14:24:21.932330 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.932233    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/680e4718-1d23-4146-b8b2-bf8970690dfd-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-tfwrt\" (UID: \"680e4718-1d23-4146-b8b2-bf8970690dfd\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-tfwrt"
Jul 06 14:24:21.932330 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.932310    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/493ba4e0-525e-469c-8734-6f95bed71371-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-dsmqp\" (UID: \"493ba4e0-525e-469c-8734-6f95bed71371\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dsmqp"
Jul 06 14:24:21.932494 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.932430    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/680e4718-1d23-4146-b8b2-bf8970690dfd-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-tfwrt\" (UID: \"680e4718-1d23-4146-b8b2-bf8970690dfd\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-tfwrt"
Jul 06 14:24:21.932494 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.932466    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/493ba4e0-525e-469c-8734-6f95bed71371-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-dsmqp\" (UID: \"493ba4e0-525e-469c-8734-6f95bed71371\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dsmqp"
Jul 06 14:24:21.932589 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.932512    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c9f1193d-c182-4701-a021-4bc4f2d8b344-node-exporter-tls\") pod \"node-exporter-gsgv7\" (UID: \"c9f1193d-c182-4701-a021-4bc4f2d8b344\") " pod="openshift-monitoring/node-exporter-gsgv7"
Jul 06 14:24:21.932589 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.932542    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c9f1193d-c182-4701-a021-4bc4f2d8b344-node-exporter-wtmp\") pod \"node-exporter-gsgv7\" (UID: \"c9f1193d-c182-4701-a021-4bc4f2d8b344\") " pod="openshift-monitoring/node-exporter-gsgv7"
Jul 06 14:24:21.932589 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.932574    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c9f1193d-c182-4701-a021-4bc4f2d8b344-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gsgv7\" (UID: \"c9f1193d-c182-4701-a021-4bc4f2d8b344\") " pod="openshift-monitoring/node-exporter-gsgv7"
Jul 06 14:24:21.932710 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.932599    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/493ba4e0-525e-469c-8734-6f95bed71371-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-dsmqp\" (UID: \"493ba4e0-525e-469c-8734-6f95bed71371\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dsmqp"
Jul 06 14:24:21.932710 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.932633    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vn4w\" (UniqueName: \"kubernetes.io/projected/c9f1193d-c182-4701-a021-4bc4f2d8b344-kube-api-access-6vn4w\") pod \"node-exporter-gsgv7\" (UID: \"c9f1193d-c182-4701-a021-4bc4f2d8b344\") " pod="openshift-monitoring/node-exporter-gsgv7"
Jul 06 14:24:21.932710 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.932663    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c9f1193d-c182-4701-a021-4bc4f2d8b344-sys\") pod \"node-exporter-gsgv7\" (UID: \"c9f1193d-c182-4701-a021-4bc4f2d8b344\") " pod="openshift-monitoring/node-exporter-gsgv7"
Jul 06 14:24:21.932710 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.932687    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c9f1193d-c182-4701-a021-4bc4f2d8b344-node-exporter-accelerators-collector-config\") pod \"node-exporter-gsgv7\" (UID: \"c9f1193d-c182-4701-a021-4bc4f2d8b344\") " pod="openshift-monitoring/node-exporter-gsgv7"
Jul 06 14:24:21.974008 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:21.973982    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-846f7b859f-v929t"]
Jul 06 14:24:21.976923 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:24:21.976899    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a428a99_c8d9_4d2e_bc55_6dbfc9575bda.slice/crio-a725c9307a2358a250a96b79fe72b0d6c4846327a6a0afb55f40df6b884a78f0 WatchSource:0}: Error finding container a725c9307a2358a250a96b79fe72b0d6c4846327a6a0afb55f40df6b884a78f0: Status 404 returned error can't find the container with id a725c9307a2358a250a96b79fe72b0d6c4846327a6a0afb55f40df6b884a78f0
Jul 06 14:24:22.034108 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.033295    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/493ba4e0-525e-469c-8734-6f95bed71371-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-dsmqp\" (UID: \"493ba4e0-525e-469c-8734-6f95bed71371\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dsmqp"
Jul 06 14:24:22.034108 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.033348    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/680e4718-1d23-4146-b8b2-bf8970690dfd-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-tfwrt\" (UID: \"680e4718-1d23-4146-b8b2-bf8970690dfd\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-tfwrt"
Jul 06 14:24:22.034108 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.033383    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/493ba4e0-525e-469c-8734-6f95bed71371-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-dsmqp\" (UID: \"493ba4e0-525e-469c-8734-6f95bed71371\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dsmqp"
Jul 06 14:24:22.034108 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.033434    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c9f1193d-c182-4701-a021-4bc4f2d8b344-node-exporter-tls\") pod \"node-exporter-gsgv7\" (UID: \"c9f1193d-c182-4701-a021-4bc4f2d8b344\") " pod="openshift-monitoring/node-exporter-gsgv7"
Jul 06 14:24:22.034108 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.033466    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c9f1193d-c182-4701-a021-4bc4f2d8b344-node-exporter-wtmp\") pod \"node-exporter-gsgv7\" (UID: \"c9f1193d-c182-4701-a021-4bc4f2d8b344\") " pod="openshift-monitoring/node-exporter-gsgv7"
Jul 06 14:24:22.034108 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:24:22.034008    2565 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 06 14:24:22.034108 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:24:22.034072    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/493ba4e0-525e-469c-8734-6f95bed71371-kube-state-metrics-tls podName:493ba4e0-525e-469c-8734-6f95bed71371 nodeName:}" failed. No retries permitted until 2026-07-06 14:24:22.534050325 +0000 UTC m=+65.712699367 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/493ba4e0-525e-469c-8734-6f95bed71371-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-dsmqp" (UID: "493ba4e0-525e-469c-8734-6f95bed71371") : secret "kube-state-metrics-tls" not found
Jul 06 14:24:22.034539 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.034115    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c9f1193d-c182-4701-a021-4bc4f2d8b344-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gsgv7\" (UID: \"c9f1193d-c182-4701-a021-4bc4f2d8b344\") " pod="openshift-monitoring/node-exporter-gsgv7"
Jul 06 14:24:22.034539 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:24:22.034143    2565 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 06 14:24:22.034539 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.034155    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/493ba4e0-525e-469c-8734-6f95bed71371-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-dsmqp\" (UID: \"493ba4e0-525e-469c-8734-6f95bed71371\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dsmqp"
Jul 06 14:24:22.034539 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:24:22.034193    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/680e4718-1d23-4146-b8b2-bf8970690dfd-openshift-state-metrics-tls podName:680e4718-1d23-4146-b8b2-bf8970690dfd nodeName:}" failed. No retries permitted until 2026-07-06 14:24:22.534175685 +0000 UTC m=+65.712824717 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/680e4718-1d23-4146-b8b2-bf8970690dfd-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-tfwrt" (UID: "680e4718-1d23-4146-b8b2-bf8970690dfd") : secret "openshift-state-metrics-tls" not found
Jul 06 14:24:22.034539 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.034210    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/493ba4e0-525e-469c-8734-6f95bed71371-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-dsmqp\" (UID: \"493ba4e0-525e-469c-8734-6f95bed71371\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dsmqp"
Jul 06 14:24:22.034539 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.034227    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vn4w\" (UniqueName: \"kubernetes.io/projected/c9f1193d-c182-4701-a021-4bc4f2d8b344-kube-api-access-6vn4w\") pod \"node-exporter-gsgv7\" (UID: \"c9f1193d-c182-4701-a021-4bc4f2d8b344\") " pod="openshift-monitoring/node-exporter-gsgv7"
Jul 06 14:24:22.034539 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.034274    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c9f1193d-c182-4701-a021-4bc4f2d8b344-sys\") pod \"node-exporter-gsgv7\" (UID: \"c9f1193d-c182-4701-a021-4bc4f2d8b344\") " pod="openshift-monitoring/node-exporter-gsgv7"
Jul 06 14:24:22.034539 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.034289    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c9f1193d-c182-4701-a021-4bc4f2d8b344-node-exporter-wtmp\") pod \"node-exporter-gsgv7\" (UID: \"c9f1193d-c182-4701-a021-4bc4f2d8b344\") " pod="openshift-monitoring/node-exporter-gsgv7"
Jul 06 14:24:22.034539 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.034302    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c9f1193d-c182-4701-a021-4bc4f2d8b344-node-exporter-accelerators-collector-config\") pod \"node-exporter-gsgv7\" (UID: \"c9f1193d-c182-4701-a021-4bc4f2d8b344\") " pod="openshift-monitoring/node-exporter-gsgv7"
Jul 06 14:24:22.034539 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.034334    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/493ba4e0-525e-469c-8734-6f95bed71371-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-dsmqp\" (UID: \"493ba4e0-525e-469c-8734-6f95bed71371\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dsmqp"
Jul 06 14:24:22.034539 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:24:22.034401    2565 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 06 14:24:22.034539 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.034398    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/680e4718-1d23-4146-b8b2-bf8970690dfd-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-tfwrt\" (UID: \"680e4718-1d23-4146-b8b2-bf8970690dfd\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-tfwrt"
Jul 06 14:24:22.034539 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:24:22.034443    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9f1193d-c182-4701-a021-4bc4f2d8b344-node-exporter-tls podName:c9f1193d-c182-4701-a021-4bc4f2d8b344 nodeName:}" failed. No retries permitted until 2026-07-06 14:24:22.534429332 +0000 UTC m=+65.713078357 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/c9f1193d-c182-4701-a021-4bc4f2d8b344-node-exporter-tls") pod "node-exporter-gsgv7" (UID: "c9f1193d-c182-4701-a021-4bc4f2d8b344") : secret "node-exporter-tls" not found
Jul 06 14:24:22.034539 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.034462    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c9f1193d-c182-4701-a021-4bc4f2d8b344-node-exporter-textfile\") pod \"node-exporter-gsgv7\" (UID: \"c9f1193d-c182-4701-a021-4bc4f2d8b344\") " pod="openshift-monitoring/node-exporter-gsgv7"
Jul 06 14:24:22.034539 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.034492    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9f1193d-c182-4701-a021-4bc4f2d8b344-metrics-client-ca\") pod \"node-exporter-gsgv7\" (UID: \"c9f1193d-c182-4701-a021-4bc4f2d8b344\") " pod="openshift-monitoring/node-exporter-gsgv7"
Jul 06 14:24:22.034539 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.034518    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zskxr\" (UniqueName: \"kubernetes.io/projected/493ba4e0-525e-469c-8734-6f95bed71371-kube-api-access-zskxr\") pod \"kube-state-metrics-7c9dbb8b7d-dsmqp\" (UID: \"493ba4e0-525e-469c-8734-6f95bed71371\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dsmqp"
Jul 06 14:24:22.035294 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.034564    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c9f1193d-c182-4701-a021-4bc4f2d8b344-root\") pod \"node-exporter-gsgv7\" (UID: \"c9f1193d-c182-4701-a021-4bc4f2d8b344\") " pod="openshift-monitoring/node-exporter-gsgv7"
Jul 06 14:24:22.035294 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.034590    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/493ba4e0-525e-469c-8734-6f95bed71371-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-dsmqp\" (UID: \"493ba4e0-525e-469c-8734-6f95bed71371\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dsmqp"
Jul 06 14:24:22.035294 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.034622    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbh48\" (UniqueName: \"kubernetes.io/projected/680e4718-1d23-4146-b8b2-bf8970690dfd-kube-api-access-cbh48\") pod \"openshift-state-metrics-54cf96dfcf-tfwrt\" (UID: \"680e4718-1d23-4146-b8b2-bf8970690dfd\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-tfwrt"
Jul 06 14:24:22.035294 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.034658    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/680e4718-1d23-4146-b8b2-bf8970690dfd-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-tfwrt\" (UID: \"680e4718-1d23-4146-b8b2-bf8970690dfd\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-tfwrt"
Jul 06 14:24:22.035294 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.035137    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/680e4718-1d23-4146-b8b2-bf8970690dfd-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-tfwrt\" (UID: \"680e4718-1d23-4146-b8b2-bf8970690dfd\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-tfwrt"
Jul 06 14:24:22.036170 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.035619    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c9f1193d-c182-4701-a021-4bc4f2d8b344-node-exporter-textfile\") pod \"node-exporter-gsgv7\" (UID: \"c9f1193d-c182-4701-a021-4bc4f2d8b344\") " pod="openshift-monitoring/node-exporter-gsgv7"
Jul 06 14:24:22.036170 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.035862    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/493ba4e0-525e-469c-8734-6f95bed71371-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-dsmqp\" (UID: \"493ba4e0-525e-469c-8734-6f95bed71371\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dsmqp"
Jul 06 14:24:22.036170 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.035934    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c9f1193d-c182-4701-a021-4bc4f2d8b344-sys\") pod \"node-exporter-gsgv7\" (UID: \"c9f1193d-c182-4701-a021-4bc4f2d8b344\") " pod="openshift-monitoring/node-exporter-gsgv7"
Jul 06 14:24:22.036170 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.035979    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c9f1193d-c182-4701-a021-4bc4f2d8b344-root\") pod \"node-exporter-gsgv7\" (UID: \"c9f1193d-c182-4701-a021-4bc4f2d8b344\") " pod="openshift-monitoring/node-exporter-gsgv7"
Jul 06 14:24:22.036170 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.036093    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c9f1193d-c182-4701-a021-4bc4f2d8b344-node-exporter-accelerators-collector-config\") pod \"node-exporter-gsgv7\" (UID: \"c9f1193d-c182-4701-a021-4bc4f2d8b344\") " pod="openshift-monitoring/node-exporter-gsgv7"
Jul 06 14:24:22.036525 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.036194    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9f1193d-c182-4701-a021-4bc4f2d8b344-metrics-client-ca\") pod \"node-exporter-gsgv7\" (UID: \"c9f1193d-c182-4701-a021-4bc4f2d8b344\") " pod="openshift-monitoring/node-exporter-gsgv7"
Jul 06 14:24:22.036988 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.036951    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/493ba4e0-525e-469c-8734-6f95bed71371-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-dsmqp\" (UID: \"493ba4e0-525e-469c-8734-6f95bed71371\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dsmqp"
Jul 06 14:24:22.037115 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.037096    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c9f1193d-c182-4701-a021-4bc4f2d8b344-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gsgv7\" (UID: \"c9f1193d-c182-4701-a021-4bc4f2d8b344\") " pod="openshift-monitoring/node-exporter-gsgv7"
Jul 06 14:24:22.038093 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.038073    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/680e4718-1d23-4146-b8b2-bf8970690dfd-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-tfwrt\" (UID: \"680e4718-1d23-4146-b8b2-bf8970690dfd\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-tfwrt"
Jul 06 14:24:22.038635 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.038615    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/493ba4e0-525e-469c-8734-6f95bed71371-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-dsmqp\" (UID: \"493ba4e0-525e-469c-8734-6f95bed71371\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dsmqp"
Jul 06 14:24:22.044605 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.044581    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vn4w\" (UniqueName: \"kubernetes.io/projected/c9f1193d-c182-4701-a021-4bc4f2d8b344-kube-api-access-6vn4w\") pod \"node-exporter-gsgv7\" (UID: \"c9f1193d-c182-4701-a021-4bc4f2d8b344\") " pod="openshift-monitoring/node-exporter-gsgv7"
Jul 06 14:24:22.045880 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.045856    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zskxr\" (UniqueName: \"kubernetes.io/projected/493ba4e0-525e-469c-8734-6f95bed71371-kube-api-access-zskxr\") pod \"kube-state-metrics-7c9dbb8b7d-dsmqp\" (UID: \"493ba4e0-525e-469c-8734-6f95bed71371\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dsmqp"
Jul 06 14:24:22.046105 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.046081    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbh48\" (UniqueName: \"kubernetes.io/projected/680e4718-1d23-4146-b8b2-bf8970690dfd-kube-api-access-cbh48\") pod \"openshift-state-metrics-54cf96dfcf-tfwrt\" (UID: \"680e4718-1d23-4146-b8b2-bf8970690dfd\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-tfwrt"
Jul 06 14:24:22.310010 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.309975    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-846f7b859f-v929t" event={"ID":"3a428a99-c8d9-4d2e-bc55-6dbfc9575bda","Type":"ContainerStarted","Data":"52be82ae2cc9302f149d1596cb633306375cdb20d4c7b9a12af36d15a90a11b4"}
Jul 06 14:24:22.310167 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.310030    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-846f7b859f-v929t" event={"ID":"3a428a99-c8d9-4d2e-bc55-6dbfc9575bda","Type":"ContainerStarted","Data":"a725c9307a2358a250a96b79fe72b0d6c4846327a6a0afb55f40df6b884a78f0"}
Jul 06 14:24:22.328778 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.328733    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-846f7b859f-v929t" podStartSLOduration=1.328718831 podStartE2EDuration="1.328718831s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:24:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:24:22.326978004 +0000 UTC m=+65.505627050" watchObservedRunningTime="2026-07-06 14:24:22.328718831 +0000 UTC m=+65.507367878"
Jul 06 14:24:22.539837 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.539802    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/680e4718-1d23-4146-b8b2-bf8970690dfd-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-tfwrt\" (UID: \"680e4718-1d23-4146-b8b2-bf8970690dfd\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-tfwrt"
Jul 06 14:24:22.539837 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.539841    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/493ba4e0-525e-469c-8734-6f95bed71371-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-dsmqp\" (UID: \"493ba4e0-525e-469c-8734-6f95bed71371\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dsmqp"
Jul 06 14:24:22.540036 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.539876    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c9f1193d-c182-4701-a021-4bc4f2d8b344-node-exporter-tls\") pod \"node-exporter-gsgv7\" (UID: \"c9f1193d-c182-4701-a021-4bc4f2d8b344\") " pod="openshift-monitoring/node-exporter-gsgv7"
Jul 06 14:24:22.542240 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.542215    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c9f1193d-c182-4701-a021-4bc4f2d8b344-node-exporter-tls\") pod \"node-exporter-gsgv7\" (UID: \"c9f1193d-c182-4701-a021-4bc4f2d8b344\") " pod="openshift-monitoring/node-exporter-gsgv7"
Jul 06 14:24:22.542565 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.542236    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/680e4718-1d23-4146-b8b2-bf8970690dfd-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-tfwrt\" (UID: \"680e4718-1d23-4146-b8b2-bf8970690dfd\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-tfwrt"
Jul 06 14:24:22.542565 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.542299    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/493ba4e0-525e-469c-8734-6f95bed71371-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-dsmqp\" (UID: \"493ba4e0-525e-469c-8734-6f95bed71371\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dsmqp"
Jul 06 14:24:22.640978 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.640897    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c66051e-7f90-46b6-9189-1842d9f84426-metrics-certs\") pod \"network-metrics-daemon-ppp6z\" (UID: \"1c66051e-7f90-46b6-9189-1842d9f84426\") " pod="openshift-multus/network-metrics-daemon-ppp6z"
Jul 06 14:24:22.646035 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.646014    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 14:24:22.653580 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.653557    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c66051e-7f90-46b6-9189-1842d9f84426-metrics-certs\") pod \"network-metrics-daemon-ppp6z\" (UID: \"1c66051e-7f90-46b6-9189-1842d9f84426\") " pod="openshift-multus/network-metrics-daemon-ppp6z"
Jul 06 14:24:22.740782 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.740750    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-tfwrt"
Jul 06 14:24:22.741993 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.741974    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a6c6da04-8e16-45a3-b8bc-e6dfa6ede872-original-pull-secret\") pod \"global-pull-secret-syncer-bgtbf\" (UID: \"a6c6da04-8e16-45a3-b8bc-e6dfa6ede872\") " pod="kube-system/global-pull-secret-syncer-bgtbf"
Jul 06 14:24:22.744144 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.744122    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 14:24:22.750789 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.750763    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gsgv7"
Jul 06 14:24:22.755081 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.755058    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a6c6da04-8e16-45a3-b8bc-e6dfa6ede872-original-pull-secret\") pod \"global-pull-secret-syncer-bgtbf\" (UID: \"a6c6da04-8e16-45a3-b8bc-e6dfa6ede872\") " pod="kube-system/global-pull-secret-syncer-bgtbf"
Jul 06 14:24:22.755911 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.755882    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dsmqp"
Jul 06 14:24:22.760564 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:24:22.760537    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9f1193d_c182_4701_a021_4bc4f2d8b344.slice/crio-42c6eefa12745f0e9a0bc5ba1b61feeaa93322308a58f4ee140e6af2f9d4df30 WatchSource:0}: Error finding container 42c6eefa12745f0e9a0bc5ba1b61feeaa93322308a58f4ee140e6af2f9d4df30: Status 404 returned error can't find the container with id 42c6eefa12745f0e9a0bc5ba1b61feeaa93322308a58f4ee140e6af2f9d4df30
Jul 06 14:24:22.843167 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.843056    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bw6t\" (UniqueName: \"kubernetes.io/projected/17707cd3-41ff-4805-a140-934dd45b5547-kube-api-access-5bw6t\") pod \"network-check-target-dfsgm\" (UID: \"17707cd3-41ff-4805-a140-934dd45b5547\") " pod="openshift-network-diagnostics/network-check-target-dfsgm"
Jul 06 14:24:22.845542 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.845522    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 14:24:22.855378 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.855354    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 14:24:22.863499 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.863475    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5wq2g\""
Jul 06 14:24:22.866287 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.866246    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bw6t\" (UniqueName: \"kubernetes.io/projected/17707cd3-41ff-4805-a140-934dd45b5547-kube-api-access-5bw6t\") pod \"network-check-target-dfsgm\" (UID: \"17707cd3-41ff-4805-a140-934dd45b5547\") " pod="openshift-network-diagnostics/network-check-target-dfsgm"
Jul 06 14:24:22.866446 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.866425    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgtbf"
Jul 06 14:24:22.872325 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.872306    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ppp6z"
Jul 06 14:24:22.881565 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.881540    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-tfwrt"]
Jul 06 14:24:22.885220 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:24:22.885192    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod680e4718_1d23_4146_b8b2_bf8970690dfd.slice/crio-473911fa1ea4225c9dfe0e832bd79b11cde6e5c12bb5156b90ccd57241419968 WatchSource:0}: Error finding container 473911fa1ea4225c9dfe0e832bd79b11cde6e5c12bb5156b90ccd57241419968: Status 404 returned error can't find the container with id 473911fa1ea4225c9dfe0e832bd79b11cde6e5c12bb5156b90ccd57241419968
Jul 06 14:24:22.906909 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.906878    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dsmqp"]
Jul 06 14:24:22.914220 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:24:22.914141    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod493ba4e0_525e_469c_8734_6f95bed71371.slice/crio-14e3bfe230438436913d343ca61d24d0d2b81a088543a387eb8c3b73b34f9a11 WatchSource:0}: Error finding container 14e3bfe230438436913d343ca61d24d0d2b81a088543a387eb8c3b73b34f9a11: Status 404 returned error can't find the container with id 14e3bfe230438436913d343ca61d24d0d2b81a088543a387eb8c3b73b34f9a11
Jul 06 14:24:22.917621 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.917593    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 14:24:22.923231 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.923174    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:24:22.933482 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.933458    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-q5ffs\""
Jul 06 14:24:22.934264 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.933721    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 06 14:24:22.934264 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.933785    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 06 14:24:22.934264 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.934029    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 06 14:24:22.935754 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.934819    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 06 14:24:22.935754 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.935032    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 06 14:24:22.935754 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.935233    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 06 14:24:22.935754 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.935434    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 06 14:24:22.935754 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.935619    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 06 14:24:22.940142 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.940124    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 06 14:24:22.956510 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:22.950737    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 14:24:23.025200 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:23.025127    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bgtbf"]
Jul 06 14:24:23.029048 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:24:23.028861    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6c6da04_8e16_45a3_b8bc_e6dfa6ede872.slice/crio-1b975aaf9141cbbc3d62c264f1f306cd67b51c824b5aeae34f64765c5a554d94 WatchSource:0}: Error finding container 1b975aaf9141cbbc3d62c264f1f306cd67b51c824b5aeae34f64765c5a554d94: Status 404 returned error can't find the container with id 1b975aaf9141cbbc3d62c264f1f306cd67b51c824b5aeae34f64765c5a554d94
Jul 06 14:24:23.052229 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:23.052199    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ppp6z"]
Jul 06 14:24:23.055197 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:24:23.055167    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c66051e_7f90_46b6_9189_1842d9f84426.slice/crio-4ec85d2332d3d6b326b7845b9710570ba61937f7be8c3d963aae6fa297371a98 WatchSource:0}: Error finding container 4ec85d2332d3d6b326b7845b9710570ba61937f7be8c3d963aae6fa297371a98: Status 404 returned error can't find the container with id 4ec85d2332d3d6b326b7845b9710570ba61937f7be8c3d963aae6fa297371a98
Jul 06 14:24:23.056488 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:23.056467    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/25b26612-ef26-4352-adfd-7254bf55f3bd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"25b26612-ef26-4352-adfd-7254bf55f3bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:24:23.056582 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:23.056500    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/25b26612-ef26-4352-adfd-7254bf55f3bd-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"25b26612-ef26-4352-adfd-7254bf55f3bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:24:23.056582 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:23.056526    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/25b26612-ef26-4352-adfd-7254bf55f3bd-web-config\") pod \"alertmanager-main-0\" (UID: \"25b26612-ef26-4352-adfd-7254bf55f3bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:24:23.056680 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:23.056604    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/25b26612-ef26-4352-adfd-7254bf55f3bd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"25b26612-ef26-4352-adfd-7254bf55f3bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:24:23.056680 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:23.056662    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/25b26612-ef26-4352-adfd-7254bf55f3bd-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"25b26612-ef26-4352-adfd-7254bf55f3bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:24:23.056766 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:23.056688    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/25b26612-ef26-4352-adfd-7254bf55f3bd-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"25b26612-ef26-4352-adfd-7254bf55f3bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:24:23.056766 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:23.056717    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/25b26612-ef26-4352-adfd-7254bf55f3bd-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"25b26612-ef26-4352-adfd-7254bf55f3bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:24:23.056853 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:23.056776    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msmxh\" (UniqueName: \"kubernetes.io/projected/25b26612-ef26-4352-adfd-7254bf55f3bd-kube-api-access-msmxh\") pod \"alertmanager-main-0\" (UID: \"25b26612-ef26-4352-adfd-7254bf55f3bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:24:23.056853 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:23.056827    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/25b26612-ef26-4352-adfd-7254bf55f3bd-config-out\") pod \"alertmanager-main-0\" (UID: \"25b26612-ef26-4352-adfd-7254bf55f3bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:24:23.056937 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:23.056875    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25b26612-ef26-4352-adfd-7254bf55f3bd-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"25b26612-ef26-4352-adfd-7254bf55f3bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:24:23.056983 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:23.056906    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/25b26612-ef26-4352-adfd-7254bf55f3bd-config-volume\") pod \"alertmanager-main-0\" (UID: \"25b26612-ef26-4352-adfd-7254bf55f3bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:24:23.056983 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:23.056958    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/25b26612-ef26-4352-adfd-7254bf55f3bd-tls-assets\") pod \"alertmanager-main-0\" (UID: \"25b26612-ef26-4352-adfd-7254bf55f3bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:24:23.057064 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:23.057023    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25b26612-ef26-4352-adfd-7254bf55f3bd-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"25b26612-ef26-4352-adfd-7254bf55f3bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:24:23.158077 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:23.158050    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/25b26612-ef26-4352-adfd-7254bf55f3bd-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"25b26612-ef26-4352-adfd-7254bf55f3bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:24:23.158203 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:23.158083    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/25b26612-ef26-4352-adfd-7254bf55f3bd-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"25b26612-ef26-4352-adfd-7254bf55f3bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:24:23.158203 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:23.158101    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msmxh\" (UniqueName: \"kubernetes.io/projected/25b26612-ef26-4352-adfd-7254bf55f3bd-kube-api-access-msmxh\") pod \"alertmanager-main-0\" (UID: \"25b26612-ef26-4352-adfd-7254bf55f3bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:24:23.158397 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:23.158375    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/25b26612-ef26-4352-adfd-7254bf55f3bd-config-out\") pod \"alertmanager-main-0\" (UID: \"25b26612-ef26-4352-adfd-7254bf55f3bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:24:23.158461 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:23.158430    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25b26612-ef26-4352-adfd-7254bf55f3bd-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"25b26612-ef26-4352-adfd-7254bf55f3bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:24:23.158493 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:23.158454    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/25b26612-ef26-4352-adfd-7254bf55f3bd-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"25b26612-ef26-4352-adfd-7254bf55f3bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:24:23.158493 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:23.158471    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/25b26612-ef26-4352-adfd-7254bf55f3bd-config-volume\") pod \"alertmanager-main-0\" (UID: \"25b26612-ef26-4352-adfd-7254bf55f3bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:24:23.158572 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:23.158511    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/25b26612-ef26-4352-adfd-7254bf55f3bd-tls-assets\") pod \"alertmanager-main-0\" (UID: \"25b26612-ef26-4352-adfd-7254bf55f3bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:24:23.158684 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:23.158655    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25b26612-ef26-4352-adfd-7254bf55f3bd-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"25b26612-ef26-4352-adfd-7254bf55f3bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:24:23.158834 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:23.158709    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/25b26612-ef26-4352-adfd-7254bf55f3bd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"25b26612-ef26-4352-adfd-7254bf55f3bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:24:23.158834 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:23.158757    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/25b26612-ef26-4352-adfd-7254bf55f3bd-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"25b26612-ef26-4352-adfd-7254bf55f3bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:24:23.158834 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:23.158789    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/25b26612-ef26-4352-adfd-7254bf55f3bd-web-config\") pod \"alertmanager-main-0\" (UID: \"25b26612-ef26-4352-adfd-7254bf55f3bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:24:23.159046 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:23.158832    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/25b26612-ef26-4352-adfd-7254bf55f3bd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"25b26612-ef26-4352-adfd-7254bf55f3bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:24:23.159046 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:23.158873    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/25b26612-ef26-4352-adfd-7254bf55f3bd-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"25b26612-ef26-4352-adfd-7254bf55f3bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:24:23.159046 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:24:23.158917    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/25b26612-ef26-4352-adfd-7254bf55f3bd-alertmanager-trusted-ca-bundle podName:25b26612-ef26-4352-adfd-7254bf55f3bd nodeName:}" failed. No retries permitted until 2026-07-06 14:24:23.658892594 +0000 UTC m=+66.837541631 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/25b26612-ef26-4352-adfd-7254bf55f3bd-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "25b26612-ef26-4352-adfd-7254bf55f3bd") : configmap references non-existent config key: ca-bundle.crt
Jul 06 14:24:23.159645 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:23.159168    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25b26612-ef26-4352-adfd-7254bf55f3bd-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"25b26612-ef26-4352-adfd-7254bf55f3bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:24:23.160201 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:23.159935    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fbtwb\""
Jul 06 14:24:23.161127 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:23.161083    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/25b26612-ef26-4352-adfd-7254bf55f3bd-config-out\") pod \"alertmanager-main-0\" (UID: \"25b26612-ef26-4352-adfd-7254bf55f3bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:24:23.161606 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:23.161565    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/25b26612-ef26-4352-adfd-7254bf55f3bd-config-volume\") pod \"alertmanager-main-0\" (UID: \"25b26612-ef26-4352-adfd-7254bf55f3bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:24:23.161606 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:23.161576    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/25b26612-ef26-4352-adfd-7254bf55f3bd-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"25b26612-ef26-4352-adfd-7254bf55f3bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:24:23.161901 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:23.161876    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/25b26612-ef26-4352-adfd-7254bf55f3bd-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"25b26612-ef26-4352-adfd-7254bf55f3bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:24:23.161978 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:23.161935    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/25b26612-ef26-4352-adfd-7254bf55f3bd-tls-assets\") pod \"alertmanager-main-0\" (UID: \"25b26612-ef26-4352-adfd-7254bf55f3bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:24:23.161978 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:23.161966    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/25b26612-ef26-4352-adfd-7254bf55f3bd-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"25b26612-ef26-4352-adfd-7254bf55f3bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:24:23.162537 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:23.162515    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/25b26612-ef26-4352-adfd-7254bf55f3bd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"25b26612-ef26-4352-adfd-7254bf55f3bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:24:23.162759 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:23.162744    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/25b26612-ef26-4352-adfd-7254bf55f3bd-web-config\") pod \"alertmanager-main-0\" (UID: \"25b26612-ef26-4352-adfd-7254bf55f3bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:24:23.162819 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:23.162803    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/25b26612-ef26-4352-adfd-7254bf55f3bd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"25b26612-ef26-4352-adfd-7254bf55f3bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:24:23.167234 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:23.167218    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfsgm"
Jul 06 14:24:23.170997 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:23.170977    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-msmxh\" (UniqueName: \"kubernetes.io/projected/25b26612-ef26-4352-adfd-7254bf55f3bd-kube-api-access-msmxh\") pod \"alertmanager-main-0\" (UID: \"25b26612-ef26-4352-adfd-7254bf55f3bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:24:23.271560 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:23.271539    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-n95sc"
Jul 06 14:24:23.288899 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:23.288871    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dfsgm"]
Jul 06 14:24:23.291974 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:24:23.291948    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17707cd3_41ff_4805_a140_934dd45b5547.slice/crio-c4d30c00fe711c86120a84fdc81c284c703c0491730e58ab0204aa557da086af WatchSource:0}: Error finding container c4d30c00fe711c86120a84fdc81c284c703c0491730e58ab0204aa557da086af: Status 404 returned error can't find the container with id c4d30c00fe711c86120a84fdc81c284c703c0491730e58ab0204aa557da086af
Jul 06 14:24:23.314737 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:23.314704    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dfsgm" event={"ID":"17707cd3-41ff-4805-a140-934dd45b5547","Type":"ContainerStarted","Data":"c4d30c00fe711c86120a84fdc81c284c703c0491730e58ab0204aa557da086af"}
Jul 06 14:24:23.315924 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:23.315901    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dsmqp" event={"ID":"493ba4e0-525e-469c-8734-6f95bed71371","Type":"ContainerStarted","Data":"14e3bfe230438436913d343ca61d24d0d2b81a088543a387eb8c3b73b34f9a11"}
Jul 06 14:24:23.317152 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:23.317133    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gsgv7" event={"ID":"c9f1193d-c182-4701-a021-4bc4f2d8b344","Type":"ContainerStarted","Data":"42c6eefa12745f0e9a0bc5ba1b61feeaa93322308a58f4ee140e6af2f9d4df30"}
Jul 06 14:24:23.318366 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:23.318327    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ppp6z" event={"ID":"1c66051e-7f90-46b6-9189-1842d9f84426","Type":"ContainerStarted","Data":"4ec85d2332d3d6b326b7845b9710570ba61937f7be8c3d963aae6fa297371a98"}
Jul 06 14:24:23.319516 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:23.319488    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bgtbf" event={"ID":"a6c6da04-8e16-45a3-b8bc-e6dfa6ede872","Type":"ContainerStarted","Data":"1b975aaf9141cbbc3d62c264f1f306cd67b51c824b5aeae34f64765c5a554d94"}
Jul 06 14:24:23.321331 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:23.321310    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-tfwrt" event={"ID":"680e4718-1d23-4146-b8b2-bf8970690dfd","Type":"ContainerStarted","Data":"ff21a75e3a7543a97882d05e745651ce3bd6b74e3b62b1f6d99c230ceca5bef2"}
Jul 06 14:24:23.321446 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:23.321367    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-tfwrt" event={"ID":"680e4718-1d23-4146-b8b2-bf8970690dfd","Type":"ContainerStarted","Data":"4b4620c5e84e1c4eeb878c988b6d14bdf6d93670c7b0613baee666ce7cb90719"}
Jul 06 14:24:23.321446 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:23.321395    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-tfwrt" event={"ID":"680e4718-1d23-4146-b8b2-bf8970690dfd","Type":"ContainerStarted","Data":"473911fa1ea4225c9dfe0e832bd79b11cde6e5c12bb5156b90ccd57241419968"}
Jul 06 14:24:23.463091 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:23.463001    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-78859cf567-429pl"
Jul 06 14:24:23.463091 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:23.463052    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78859cf567-429pl"
Jul 06 14:24:23.467661 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:23.467638    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-78859cf567-429pl"
Jul 06 14:24:23.665380 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:23.665307    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25b26612-ef26-4352-adfd-7254bf55f3bd-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"25b26612-ef26-4352-adfd-7254bf55f3bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:24:23.665970 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:23.665949    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25b26612-ef26-4352-adfd-7254bf55f3bd-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"25b26612-ef26-4352-adfd-7254bf55f3bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:24:23.849464 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:23.849377    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:24:24.018924 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:24.018819    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 14:24:24.334701 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:24.334491    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-78859cf567-429pl"
Jul 06 14:24:24.752047 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:24:24.752004    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25b26612_ef26_4352_adfd_7254bf55f3bd.slice/crio-65b135e7ba1ca1316b99561f1d980fa51524efb422985240cefcfb513eab1ba2 WatchSource:0}: Error finding container 65b135e7ba1ca1316b99561f1d980fa51524efb422985240cefcfb513eab1ba2: Status 404 returned error can't find the container with id 65b135e7ba1ca1316b99561f1d980fa51524efb422985240cefcfb513eab1ba2
Jul 06 14:24:24.939884 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:24.939850    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-64f8bfddbc-gvc4g"]
Jul 06 14:24:24.944149 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:24.944082    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-64f8bfddbc-gvc4g"
Jul 06 14:24:24.946521 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:24.946309    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 06 14:24:24.946978 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:24.946956    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 06 14:24:24.947903 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:24.947231    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 06 14:24:24.947903 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:24.947276    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-33c816m2jtt81\""
Jul 06 14:24:24.947903 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:24.947439    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-4bmcd\""
Jul 06 14:24:24.947903 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:24.947541    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 06 14:24:24.947903 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:24.947229    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 06 14:24:24.956137 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:24.955996    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-64f8bfddbc-gvc4g"]
Jul 06 14:24:25.078175 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:25.078099    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c986fb5f-f4bc-4c56-a960-823736801496-metrics-client-ca\") pod \"thanos-querier-64f8bfddbc-gvc4g\" (UID: \"c986fb5f-f4bc-4c56-a960-823736801496\") " pod="openshift-monitoring/thanos-querier-64f8bfddbc-gvc4g"
Jul 06 14:24:25.078175 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:25.078155    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c986fb5f-f4bc-4c56-a960-823736801496-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-64f8bfddbc-gvc4g\" (UID: \"c986fb5f-f4bc-4c56-a960-823736801496\") " pod="openshift-monitoring/thanos-querier-64f8bfddbc-gvc4g"
Jul 06 14:24:25.078407 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:25.078193    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t58f8\" (UniqueName: \"kubernetes.io/projected/c986fb5f-f4bc-4c56-a960-823736801496-kube-api-access-t58f8\") pod \"thanos-querier-64f8bfddbc-gvc4g\" (UID: \"c986fb5f-f4bc-4c56-a960-823736801496\") " pod="openshift-monitoring/thanos-querier-64f8bfddbc-gvc4g"
Jul 06 14:24:25.078407 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:25.078241    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c986fb5f-f4bc-4c56-a960-823736801496-secret-thanos-querier-tls\") pod \"thanos-querier-64f8bfddbc-gvc4g\" (UID: \"c986fb5f-f4bc-4c56-a960-823736801496\") " pod="openshift-monitoring/thanos-querier-64f8bfddbc-gvc4g"
Jul 06 14:24:25.078407 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:25.078329    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c986fb5f-f4bc-4c56-a960-823736801496-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-64f8bfddbc-gvc4g\" (UID: \"c986fb5f-f4bc-4c56-a960-823736801496\") " pod="openshift-monitoring/thanos-querier-64f8bfddbc-gvc4g"
Jul 06 14:24:25.078559 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:25.078410    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c986fb5f-f4bc-4c56-a960-823736801496-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-64f8bfddbc-gvc4g\" (UID: \"c986fb5f-f4bc-4c56-a960-823736801496\") " pod="openshift-monitoring/thanos-querier-64f8bfddbc-gvc4g"
Jul 06 14:24:25.078559 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:25.078448    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c986fb5f-f4bc-4c56-a960-823736801496-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-64f8bfddbc-gvc4g\" (UID: \"c986fb5f-f4bc-4c56-a960-823736801496\") " pod="openshift-monitoring/thanos-querier-64f8bfddbc-gvc4g"
Jul 06 14:24:25.078559 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:25.078464    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c986fb5f-f4bc-4c56-a960-823736801496-secret-grpc-tls\") pod \"thanos-querier-64f8bfddbc-gvc4g\" (UID: \"c986fb5f-f4bc-4c56-a960-823736801496\") " pod="openshift-monitoring/thanos-querier-64f8bfddbc-gvc4g"
Jul 06 14:24:25.180650 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:25.179649    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c986fb5f-f4bc-4c56-a960-823736801496-metrics-client-ca\") pod \"thanos-querier-64f8bfddbc-gvc4g\" (UID: \"c986fb5f-f4bc-4c56-a960-823736801496\") " pod="openshift-monitoring/thanos-querier-64f8bfddbc-gvc4g"
Jul 06 14:24:25.180650 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:25.179706    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c986fb5f-f4bc-4c56-a960-823736801496-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-64f8bfddbc-gvc4g\" (UID: \"c986fb5f-f4bc-4c56-a960-823736801496\") " pod="openshift-monitoring/thanos-querier-64f8bfddbc-gvc4g"
Jul 06 14:24:25.180650 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:25.179745    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t58f8\" (UniqueName: \"kubernetes.io/projected/c986fb5f-f4bc-4c56-a960-823736801496-kube-api-access-t58f8\") pod \"thanos-querier-64f8bfddbc-gvc4g\" (UID: \"c986fb5f-f4bc-4c56-a960-823736801496\") " pod="openshift-monitoring/thanos-querier-64f8bfddbc-gvc4g"
Jul 06 14:24:25.180650 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:25.179794    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c986fb5f-f4bc-4c56-a960-823736801496-secret-thanos-querier-tls\") pod \"thanos-querier-64f8bfddbc-gvc4g\" (UID: \"c986fb5f-f4bc-4c56-a960-823736801496\") " pod="openshift-monitoring/thanos-querier-64f8bfddbc-gvc4g"
Jul 06 14:24:25.180650 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:25.179840    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c986fb5f-f4bc-4c56-a960-823736801496-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-64f8bfddbc-gvc4g\" (UID: \"c986fb5f-f4bc-4c56-a960-823736801496\") " pod="openshift-monitoring/thanos-querier-64f8bfddbc-gvc4g"
Jul 06 14:24:25.180650 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:25.179888    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c986fb5f-f4bc-4c56-a960-823736801496-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-64f8bfddbc-gvc4g\" (UID: \"c986fb5f-f4bc-4c56-a960-823736801496\") " pod="openshift-monitoring/thanos-querier-64f8bfddbc-gvc4g"
Jul 06 14:24:25.180650 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:25.179925    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c986fb5f-f4bc-4c56-a960-823736801496-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-64f8bfddbc-gvc4g\" (UID: \"c986fb5f-f4bc-4c56-a960-823736801496\") " pod="openshift-monitoring/thanos-querier-64f8bfddbc-gvc4g"
Jul 06 14:24:25.180650 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:25.179950    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c986fb5f-f4bc-4c56-a960-823736801496-secret-grpc-tls\") pod \"thanos-querier-64f8bfddbc-gvc4g\" (UID: \"c986fb5f-f4bc-4c56-a960-823736801496\") " pod="openshift-monitoring/thanos-querier-64f8bfddbc-gvc4g"
Jul 06 14:24:25.182076 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:25.181607    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c986fb5f-f4bc-4c56-a960-823736801496-metrics-client-ca\") pod \"thanos-querier-64f8bfddbc-gvc4g\" (UID: \"c986fb5f-f4bc-4c56-a960-823736801496\") " pod="openshift-monitoring/thanos-querier-64f8bfddbc-gvc4g"
Jul 06 14:24:25.186397 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:25.186304    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c986fb5f-f4bc-4c56-a960-823736801496-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-64f8bfddbc-gvc4g\" (UID: \"c986fb5f-f4bc-4c56-a960-823736801496\") " pod="openshift-monitoring/thanos-querier-64f8bfddbc-gvc4g"
Jul 06 14:24:25.186568 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:25.186537    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c986fb5f-f4bc-4c56-a960-823736801496-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-64f8bfddbc-gvc4g\" (UID: \"c986fb5f-f4bc-4c56-a960-823736801496\") " pod="openshift-monitoring/thanos-querier-64f8bfddbc-gvc4g"
Jul 06 14:24:25.187570 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:25.187075    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c986fb5f-f4bc-4c56-a960-823736801496-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-64f8bfddbc-gvc4g\" (UID: \"c986fb5f-f4bc-4c56-a960-823736801496\") " pod="openshift-monitoring/thanos-querier-64f8bfddbc-gvc4g"
Jul 06 14:24:25.187570 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:25.187534    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c986fb5f-f4bc-4c56-a960-823736801496-secret-grpc-tls\") pod \"thanos-querier-64f8bfddbc-gvc4g\" (UID: \"c986fb5f-f4bc-4c56-a960-823736801496\") " pod="openshift-monitoring/thanos-querier-64f8bfddbc-gvc4g"
Jul 06 14:24:25.187847 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:25.187827    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c986fb5f-f4bc-4c56-a960-823736801496-secret-thanos-querier-tls\") pod \"thanos-querier-64f8bfddbc-gvc4g\" (UID: \"c986fb5f-f4bc-4c56-a960-823736801496\") " pod="openshift-monitoring/thanos-querier-64f8bfddbc-gvc4g"
Jul 06 14:24:25.188451 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:25.188427    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c986fb5f-f4bc-4c56-a960-823736801496-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-64f8bfddbc-gvc4g\" (UID: \"c986fb5f-f4bc-4c56-a960-823736801496\") " pod="openshift-monitoring/thanos-querier-64f8bfddbc-gvc4g"
Jul 06 14:24:25.190801 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:25.190762    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t58f8\" (UniqueName: \"kubernetes.io/projected/c986fb5f-f4bc-4c56-a960-823736801496-kube-api-access-t58f8\") pod \"thanos-querier-64f8bfddbc-gvc4g\" (UID: \"c986fb5f-f4bc-4c56-a960-823736801496\") " pod="openshift-monitoring/thanos-querier-64f8bfddbc-gvc4g"
Jul 06 14:24:25.257465 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:25.257430    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-64f8bfddbc-gvc4g"
Jul 06 14:24:25.332967 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:25.332847    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"25b26612-ef26-4352-adfd-7254bf55f3bd","Type":"ContainerStarted","Data":"65b135e7ba1ca1316b99561f1d980fa51524efb422985240cefcfb513eab1ba2"}
Jul 06 14:24:25.706155 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:25.706059    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-64f8bfddbc-gvc4g"]
Jul 06 14:24:25.725467 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:24:25.725424    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc986fb5f_f4bc_4c56_a960_823736801496.slice/crio-05d11e6822cf7fd436b360170e95f8105002cb49e34c03b14df815b93067b535 WatchSource:0}: Error finding container 05d11e6822cf7fd436b360170e95f8105002cb49e34c03b14df815b93067b535: Status 404 returned error can't find the container with id 05d11e6822cf7fd436b360170e95f8105002cb49e34c03b14df815b93067b535
Jul 06 14:24:26.119225 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:26.119135    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6d9f795f4-4xmd4"]
Jul 06 14:24:26.123154 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:26.123128    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6d9f795f4-4xmd4"
Jul 06 14:24:26.125700 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:26.125416    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 06 14:24:26.134538 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:26.131477    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 06 14:24:26.134538 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:26.131772    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 06 14:24:26.134538 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:26.132725    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-fh81s5nj4r53b\""
Jul 06 14:24:26.134538 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:26.132961    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-9p58g\""
Jul 06 14:24:26.143858 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:26.134838    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 06 14:24:26.144990 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:26.144888    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6d9f795f4-4xmd4"]
Jul 06 14:24:26.190073 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:26.190037    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/af9ca10d-2cae-467d-b45d-f605eeadbfda-secret-metrics-server-client-certs\") pod \"metrics-server-6d9f795f4-4xmd4\" (UID: \"af9ca10d-2cae-467d-b45d-f605eeadbfda\") " pod="openshift-monitoring/metrics-server-6d9f795f4-4xmd4"
Jul 06 14:24:26.190251 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:26.190095    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/af9ca10d-2cae-467d-b45d-f605eeadbfda-audit-log\") pod \"metrics-server-6d9f795f4-4xmd4\" (UID: \"af9ca10d-2cae-467d-b45d-f605eeadbfda\") " pod="openshift-monitoring/metrics-server-6d9f795f4-4xmd4"
Jul 06 14:24:26.190251 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:26.190191    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/af9ca10d-2cae-467d-b45d-f605eeadbfda-client-ca-bundle\") pod \"metrics-server-6d9f795f4-4xmd4\" (UID: \"af9ca10d-2cae-467d-b45d-f605eeadbfda\") " pod="openshift-monitoring/metrics-server-6d9f795f4-4xmd4"
Jul 06 14:24:26.190251 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:26.190220    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/af9ca10d-2cae-467d-b45d-f605eeadbfda-metrics-server-audit-profiles\") pod \"metrics-server-6d9f795f4-4xmd4\" (UID: \"af9ca10d-2cae-467d-b45d-f605eeadbfda\") " pod="openshift-monitoring/metrics-server-6d9f795f4-4xmd4"
Jul 06 14:24:26.190453 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:26.190271    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtzp7\" (UniqueName: \"kubernetes.io/projected/af9ca10d-2cae-467d-b45d-f605eeadbfda-kube-api-access-qtzp7\") pod \"metrics-server-6d9f795f4-4xmd4\" (UID: \"af9ca10d-2cae-467d-b45d-f605eeadbfda\") " pod="openshift-monitoring/metrics-server-6d9f795f4-4xmd4"
Jul 06 14:24:26.190453 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:26.190308    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af9ca10d-2cae-467d-b45d-f605eeadbfda-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6d9f795f4-4xmd4\" (UID: \"af9ca10d-2cae-467d-b45d-f605eeadbfda\") " pod="openshift-monitoring/metrics-server-6d9f795f4-4xmd4"
Jul 06 14:24:26.190556 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:26.190481    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/af9ca10d-2cae-467d-b45d-f605eeadbfda-secret-metrics-server-tls\") pod \"metrics-server-6d9f795f4-4xmd4\" (UID: \"af9ca10d-2cae-467d-b45d-f605eeadbfda\") " pod="openshift-monitoring/metrics-server-6d9f795f4-4xmd4"
Jul 06 14:24:26.291823 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:26.291367    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/af9ca10d-2cae-467d-b45d-f605eeadbfda-client-ca-bundle\") pod \"metrics-server-6d9f795f4-4xmd4\" (UID: \"af9ca10d-2cae-467d-b45d-f605eeadbfda\") " pod="openshift-monitoring/metrics-server-6d9f795f4-4xmd4"
Jul 06 14:24:26.291823 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:26.291422    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/af9ca10d-2cae-467d-b45d-f605eeadbfda-metrics-server-audit-profiles\") pod \"metrics-server-6d9f795f4-4xmd4\" (UID: \"af9ca10d-2cae-467d-b45d-f605eeadbfda\") " pod="openshift-monitoring/metrics-server-6d9f795f4-4xmd4"
Jul 06 14:24:26.291823 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:26.291475    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtzp7\" (UniqueName: \"kubernetes.io/projected/af9ca10d-2cae-467d-b45d-f605eeadbfda-kube-api-access-qtzp7\") pod \"metrics-server-6d9f795f4-4xmd4\" (UID: \"af9ca10d-2cae-467d-b45d-f605eeadbfda\") " pod="openshift-monitoring/metrics-server-6d9f795f4-4xmd4"
Jul 06 14:24:26.291823 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:26.291539    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af9ca10d-2cae-467d-b45d-f605eeadbfda-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6d9f795f4-4xmd4\" (UID: \"af9ca10d-2cae-467d-b45d-f605eeadbfda\") " pod="openshift-monitoring/metrics-server-6d9f795f4-4xmd4"
Jul 06 14:24:26.291823 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:26.291607    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/af9ca10d-2cae-467d-b45d-f605eeadbfda-secret-metrics-server-tls\") pod \"metrics-server-6d9f795f4-4xmd4\" (UID: \"af9ca10d-2cae-467d-b45d-f605eeadbfda\") " pod="openshift-monitoring/metrics-server-6d9f795f4-4xmd4"
Jul 06 14:24:26.291823 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:26.291636    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/af9ca10d-2cae-467d-b45d-f605eeadbfda-secret-metrics-server-client-certs\") pod \"metrics-server-6d9f795f4-4xmd4\" (UID: \"af9ca10d-2cae-467d-b45d-f605eeadbfda\") " pod="openshift-monitoring/metrics-server-6d9f795f4-4xmd4"
Jul 06 14:24:26.291823 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:26.291670    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/af9ca10d-2cae-467d-b45d-f605eeadbfda-audit-log\") pod \"metrics-server-6d9f795f4-4xmd4\" (UID: \"af9ca10d-2cae-467d-b45d-f605eeadbfda\") " pod="openshift-monitoring/metrics-server-6d9f795f4-4xmd4"
Jul 06 14:24:26.292997 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:26.292966    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/af9ca10d-2cae-467d-b45d-f605eeadbfda-metrics-server-audit-profiles\") pod \"metrics-server-6d9f795f4-4xmd4\" (UID: \"af9ca10d-2cae-467d-b45d-f605eeadbfda\") " pod="openshift-monitoring/metrics-server-6d9f795f4-4xmd4"
Jul 06 14:24:26.293494 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:26.293451    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/af9ca10d-2cae-467d-b45d-f605eeadbfda-audit-log\") pod \"metrics-server-6d9f795f4-4xmd4\" (UID: \"af9ca10d-2cae-467d-b45d-f605eeadbfda\") " pod="openshift-monitoring/metrics-server-6d9f795f4-4xmd4"
Jul 06 14:24:26.293662 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:26.293611    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af9ca10d-2cae-467d-b45d-f605eeadbfda-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6d9f795f4-4xmd4\" (UID: \"af9ca10d-2cae-467d-b45d-f605eeadbfda\") " pod="openshift-monitoring/metrics-server-6d9f795f4-4xmd4"
Jul 06 14:24:26.295057 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:26.294998    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/af9ca10d-2cae-467d-b45d-f605eeadbfda-client-ca-bundle\") pod \"metrics-server-6d9f795f4-4xmd4\" (UID: \"af9ca10d-2cae-467d-b45d-f605eeadbfda\") " pod="openshift-monitoring/metrics-server-6d9f795f4-4xmd4"
Jul 06 14:24:26.296136 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:26.296107    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/af9ca10d-2cae-467d-b45d-f605eeadbfda-secret-metrics-server-client-certs\") pod \"metrics-server-6d9f795f4-4xmd4\" (UID: \"af9ca10d-2cae-467d-b45d-f605eeadbfda\") " pod="openshift-monitoring/metrics-server-6d9f795f4-4xmd4"
Jul 06 14:24:26.296687 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:26.296663    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/af9ca10d-2cae-467d-b45d-f605eeadbfda-secret-metrics-server-tls\") pod \"metrics-server-6d9f795f4-4xmd4\" (UID: \"af9ca10d-2cae-467d-b45d-f605eeadbfda\") " pod="openshift-monitoring/metrics-server-6d9f795f4-4xmd4"
Jul 06 14:24:26.301489 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:26.301439    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtzp7\" (UniqueName: \"kubernetes.io/projected/af9ca10d-2cae-467d-b45d-f605eeadbfda-kube-api-access-qtzp7\") pod \"metrics-server-6d9f795f4-4xmd4\" (UID: \"af9ca10d-2cae-467d-b45d-f605eeadbfda\") " pod="openshift-monitoring/metrics-server-6d9f795f4-4xmd4"
Jul 06 14:24:26.340781 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:26.340669    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dsmqp" event={"ID":"493ba4e0-525e-469c-8734-6f95bed71371","Type":"ContainerStarted","Data":"89e1c49d8a80a000abf015a342ceff04690a4099d41209e3c47f05005cefa756"}
Jul 06 14:24:26.340781 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:26.340747    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dsmqp" event={"ID":"493ba4e0-525e-469c-8734-6f95bed71371","Type":"ContainerStarted","Data":"45a064233d4d0e51cd70ef9c697fd24eef2c12298194b9c69298062a6be699be"}
Jul 06 14:24:26.340781 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:26.340784    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dsmqp" event={"ID":"493ba4e0-525e-469c-8734-6f95bed71371","Type":"ContainerStarted","Data":"607386634ed3e54f5fa620453fce7d21b901fc2fc61f9fcc47b220456d18adfa"}
Jul 06 14:24:26.342947 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:26.342825    2565 generic.go:356] "Generic (PLEG): container finished" podID="c9f1193d-c182-4701-a021-4bc4f2d8b344" containerID="0405f9156dd3b761a94debafa5ee452b1fb30370eb0a443e972f18f2626c9ef2" exitCode=0
Jul 06 14:24:26.342947 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:26.342928    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gsgv7" event={"ID":"c9f1193d-c182-4701-a021-4bc4f2d8b344","Type":"ContainerDied","Data":"0405f9156dd3b761a94debafa5ee452b1fb30370eb0a443e972f18f2626c9ef2"}
Jul 06 14:24:26.345483 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:26.345453    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ppp6z" event={"ID":"1c66051e-7f90-46b6-9189-1842d9f84426","Type":"ContainerStarted","Data":"21c1c4d187529098302c5f7c60589044be8f1b53c62e461beb23d0633ae041f8"}
Jul 06 14:24:26.345594 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:26.345506    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ppp6z" event={"ID":"1c66051e-7f90-46b6-9189-1842d9f84426","Type":"ContainerStarted","Data":"dff57c5c77e66ada35ede31df482467f5e2002b1e63ff7b2384c0be97d6a4301"}
Jul 06 14:24:26.348397 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:26.348362    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-tfwrt" event={"ID":"680e4718-1d23-4146-b8b2-bf8970690dfd","Type":"ContainerStarted","Data":"3aef6ff24c6b187c9bc9a19c57d18ca11f8768f7cf98f22c9bcd0cb159948054"}
Jul 06 14:24:26.350468 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:26.350047    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64f8bfddbc-gvc4g" event={"ID":"c986fb5f-f4bc-4c56-a960-823736801496","Type":"ContainerStarted","Data":"05d11e6822cf7fd436b360170e95f8105002cb49e34c03b14df815b93067b535"}
Jul 06 14:24:26.363560 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:26.363418    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dsmqp" podStartSLOduration=2.7727611850000002 podStartE2EDuration="5.363399921s" totalImagesPullingTime="2.590638736s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:24:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:24:26.361534355 +0000 UTC m=+69.540183402" watchObservedRunningTime="2026-07-06 14:24:26.363399921 +0000 UTC m=+69.542048968"
Jul 06 14:24:26.380129 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:26.380046    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ppp6z" podStartSLOduration=65.932831086 podStartE2EDuration="1m8.380029702s" totalImagesPullingTime="2.447198616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:23:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:24:26.378767601 +0000 UTC m=+69.557416646" watchObservedRunningTime="2026-07-06 14:24:26.380029702 +0000 UTC m=+69.558678748"
Jul 06 14:24:26.423309 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:26.423236    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-tfwrt" podStartSLOduration=2.954179068 podStartE2EDuration="5.42321386s" totalImagesPullingTime="2.469034792s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:24:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:24:26.421718386 +0000 UTC m=+69.600367445" watchObservedRunningTime="2026-07-06 14:24:26.42321386 +0000 UTC m=+69.601862907"
Jul 06 14:24:26.455071 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:26.455039    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6d9f795f4-4xmd4"
Jul 06 14:24:26.594329 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:26.594270    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-nqv2w"]
Jul 06 14:24:26.598227 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:26.597842    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-nqv2w"
Jul 06 14:24:26.600172 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:26.599855    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-tzfhl\""
Jul 06 14:24:26.600172 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:26.600132    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 06 14:24:26.606356 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:26.606285    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-nqv2w"]
Jul 06 14:24:26.696416 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:26.696357    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrs74\" (UniqueName: \"kubernetes.io/projected/77876daa-2753-4e1a-884c-6eaa8f8ba59e-kube-api-access-vrs74\") pod \"monitoring-plugin-d5dcff7cf-nqv2w\" (UID: \"77876daa-2753-4e1a-884c-6eaa8f8ba59e\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-nqv2w"
Jul 06 14:24:26.696887 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:26.696815    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/77876daa-2753-4e1a-884c-6eaa8f8ba59e-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-nqv2w\" (UID: \"77876daa-2753-4e1a-884c-6eaa8f8ba59e\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-nqv2w"
Jul 06 14:24:26.798441 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:26.797872    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/77876daa-2753-4e1a-884c-6eaa8f8ba59e-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-nqv2w\" (UID: \"77876daa-2753-4e1a-884c-6eaa8f8ba59e\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-nqv2w"
Jul 06 14:24:26.798441 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:26.797948    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrs74\" (UniqueName: \"kubernetes.io/projected/77876daa-2753-4e1a-884c-6eaa8f8ba59e-kube-api-access-vrs74\") pod \"monitoring-plugin-d5dcff7cf-nqv2w\" (UID: \"77876daa-2753-4e1a-884c-6eaa8f8ba59e\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-nqv2w"
Jul 06 14:24:26.798441 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:24:26.798122    2565 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 06 14:24:26.798441 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:24:26.798199    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77876daa-2753-4e1a-884c-6eaa8f8ba59e-monitoring-plugin-cert podName:77876daa-2753-4e1a-884c-6eaa8f8ba59e nodeName:}" failed. No retries permitted until 2026-07-06 14:24:27.298176265 +0000 UTC m=+70.476825301 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/77876daa-2753-4e1a-884c-6eaa8f8ba59e-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-nqv2w" (UID: "77876daa-2753-4e1a-884c-6eaa8f8ba59e") : secret "monitoring-plugin-cert" not found
Jul 06 14:24:26.816927 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:26.816677    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrs74\" (UniqueName: \"kubernetes.io/projected/77876daa-2753-4e1a-884c-6eaa8f8ba59e-kube-api-access-vrs74\") pod \"monitoring-plugin-d5dcff7cf-nqv2w\" (UID: \"77876daa-2753-4e1a-884c-6eaa8f8ba59e\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-nqv2w"
Jul 06 14:24:26.844308 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:26.844231    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6d9f795f4-4xmd4"]
Jul 06 14:24:27.303393 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:27.303316    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/77876daa-2753-4e1a-884c-6eaa8f8ba59e-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-nqv2w\" (UID: \"77876daa-2753-4e1a-884c-6eaa8f8ba59e\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-nqv2w"
Jul 06 14:24:27.307356 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:27.307114    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/77876daa-2753-4e1a-884c-6eaa8f8ba59e-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-nqv2w\" (UID: \"77876daa-2753-4e1a-884c-6eaa8f8ba59e\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-nqv2w"
Jul 06 14:24:27.356780 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:27.356737    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gsgv7" event={"ID":"c9f1193d-c182-4701-a021-4bc4f2d8b344","Type":"ContainerStarted","Data":"5536d61055d5816223aed4b6cb0e89a194393d5c955280ceb3be0dadcba04c24"}
Jul 06 14:24:27.358987 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:27.358702    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"25b26612-ef26-4352-adfd-7254bf55f3bd","Type":"ContainerStarted","Data":"380753ef768407fa4ab5acfa0053a1197f7ec903d567293953d2ad956880a8b4"}
Jul 06 14:24:27.511124 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:27.511080    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-nqv2w"
Jul 06 14:24:27.744934 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:27.744899    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-846f7b859f-v929t"]
Jul 06 14:24:27.776498 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:27.776452    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59d5d646b-nblhm"]
Jul 06 14:24:27.782068 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:27.782040    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59d5d646b-nblhm"
Jul 06 14:24:27.789809 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:27.789781    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59d5d646b-nblhm"]
Jul 06 14:24:27.910007 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:27.909974    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/06bec2d8-6db5-414f-8a9a-d1af1273bccc-console-config\") pod \"console-59d5d646b-nblhm\" (UID: \"06bec2d8-6db5-414f-8a9a-d1af1273bccc\") " pod="openshift-console/console-59d5d646b-nblhm"
Jul 06 14:24:27.910193 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:27.910040    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/06bec2d8-6db5-414f-8a9a-d1af1273bccc-service-ca\") pod \"console-59d5d646b-nblhm\" (UID: \"06bec2d8-6db5-414f-8a9a-d1af1273bccc\") " pod="openshift-console/console-59d5d646b-nblhm"
Jul 06 14:24:27.910193 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:27.910134    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/06bec2d8-6db5-414f-8a9a-d1af1273bccc-console-oauth-config\") pod \"console-59d5d646b-nblhm\" (UID: \"06bec2d8-6db5-414f-8a9a-d1af1273bccc\") " pod="openshift-console/console-59d5d646b-nblhm"
Jul 06 14:24:27.910955 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:27.910748    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/06bec2d8-6db5-414f-8a9a-d1af1273bccc-console-serving-cert\") pod \"console-59d5d646b-nblhm\" (UID: \"06bec2d8-6db5-414f-8a9a-d1af1273bccc\") " pod="openshift-console/console-59d5d646b-nblhm"
Jul 06 14:24:27.910955 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:27.910786    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06bec2d8-6db5-414f-8a9a-d1af1273bccc-trusted-ca-bundle\") pod \"console-59d5d646b-nblhm\" (UID: \"06bec2d8-6db5-414f-8a9a-d1af1273bccc\") " pod="openshift-console/console-59d5d646b-nblhm"
Jul 06 14:24:27.910955 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:27.910810    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/06bec2d8-6db5-414f-8a9a-d1af1273bccc-oauth-serving-cert\") pod \"console-59d5d646b-nblhm\" (UID: \"06bec2d8-6db5-414f-8a9a-d1af1273bccc\") " pod="openshift-console/console-59d5d646b-nblhm"
Jul 06 14:24:27.910955 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:27.910854    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jg8jw\" (UniqueName: \"kubernetes.io/projected/06bec2d8-6db5-414f-8a9a-d1af1273bccc-kube-api-access-jg8jw\") pod \"console-59d5d646b-nblhm\" (UID: \"06bec2d8-6db5-414f-8a9a-d1af1273bccc\") " pod="openshift-console/console-59d5d646b-nblhm"
Jul 06 14:24:28.011406 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.011307    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/06bec2d8-6db5-414f-8a9a-d1af1273bccc-console-config\") pod \"console-59d5d646b-nblhm\" (UID: \"06bec2d8-6db5-414f-8a9a-d1af1273bccc\") " pod="openshift-console/console-59d5d646b-nblhm"
Jul 06 14:24:28.011406 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.011397    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/06bec2d8-6db5-414f-8a9a-d1af1273bccc-service-ca\") pod \"console-59d5d646b-nblhm\" (UID: \"06bec2d8-6db5-414f-8a9a-d1af1273bccc\") " pod="openshift-console/console-59d5d646b-nblhm"
Jul 06 14:24:28.011602 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.011443    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/06bec2d8-6db5-414f-8a9a-d1af1273bccc-console-oauth-config\") pod \"console-59d5d646b-nblhm\" (UID: \"06bec2d8-6db5-414f-8a9a-d1af1273bccc\") " pod="openshift-console/console-59d5d646b-nblhm"
Jul 06 14:24:28.011602 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.011468    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/06bec2d8-6db5-414f-8a9a-d1af1273bccc-console-serving-cert\") pod \"console-59d5d646b-nblhm\" (UID: \"06bec2d8-6db5-414f-8a9a-d1af1273bccc\") " pod="openshift-console/console-59d5d646b-nblhm"
Jul 06 14:24:28.011602 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.011492    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06bec2d8-6db5-414f-8a9a-d1af1273bccc-trusted-ca-bundle\") pod \"console-59d5d646b-nblhm\" (UID: \"06bec2d8-6db5-414f-8a9a-d1af1273bccc\") " pod="openshift-console/console-59d5d646b-nblhm"
Jul 06 14:24:28.011602 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.011517    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/06bec2d8-6db5-414f-8a9a-d1af1273bccc-oauth-serving-cert\") pod \"console-59d5d646b-nblhm\" (UID: \"06bec2d8-6db5-414f-8a9a-d1af1273bccc\") " pod="openshift-console/console-59d5d646b-nblhm"
Jul 06 14:24:28.011602 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.011560    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jg8jw\" (UniqueName: \"kubernetes.io/projected/06bec2d8-6db5-414f-8a9a-d1af1273bccc-kube-api-access-jg8jw\") pod \"console-59d5d646b-nblhm\" (UID: \"06bec2d8-6db5-414f-8a9a-d1af1273bccc\") " pod="openshift-console/console-59d5d646b-nblhm"
Jul 06 14:24:28.012487 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.012434    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/06bec2d8-6db5-414f-8a9a-d1af1273bccc-console-config\") pod \"console-59d5d646b-nblhm\" (UID: \"06bec2d8-6db5-414f-8a9a-d1af1273bccc\") " pod="openshift-console/console-59d5d646b-nblhm"
Jul 06 14:24:28.012487 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.012462    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/06bec2d8-6db5-414f-8a9a-d1af1273bccc-service-ca\") pod \"console-59d5d646b-nblhm\" (UID: \"06bec2d8-6db5-414f-8a9a-d1af1273bccc\") " pod="openshift-console/console-59d5d646b-nblhm"
Jul 06 14:24:28.013124 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.013085    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06bec2d8-6db5-414f-8a9a-d1af1273bccc-trusted-ca-bundle\") pod \"console-59d5d646b-nblhm\" (UID: \"06bec2d8-6db5-414f-8a9a-d1af1273bccc\") " pod="openshift-console/console-59d5d646b-nblhm"
Jul 06 14:24:28.013606 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.013563    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/06bec2d8-6db5-414f-8a9a-d1af1273bccc-oauth-serving-cert\") pod \"console-59d5d646b-nblhm\" (UID: \"06bec2d8-6db5-414f-8a9a-d1af1273bccc\") " pod="openshift-console/console-59d5d646b-nblhm"
Jul 06 14:24:28.014868 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.014835    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/06bec2d8-6db5-414f-8a9a-d1af1273bccc-console-serving-cert\") pod \"console-59d5d646b-nblhm\" (UID: \"06bec2d8-6db5-414f-8a9a-d1af1273bccc\") " pod="openshift-console/console-59d5d646b-nblhm"
Jul 06 14:24:28.015038 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.015008    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/06bec2d8-6db5-414f-8a9a-d1af1273bccc-console-oauth-config\") pod \"console-59d5d646b-nblhm\" (UID: \"06bec2d8-6db5-414f-8a9a-d1af1273bccc\") " pod="openshift-console/console-59d5d646b-nblhm"
Jul 06 14:24:28.019076 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.019057    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jg8jw\" (UniqueName: \"kubernetes.io/projected/06bec2d8-6db5-414f-8a9a-d1af1273bccc-kube-api-access-jg8jw\") pod \"console-59d5d646b-nblhm\" (UID: \"06bec2d8-6db5-414f-8a9a-d1af1273bccc\") " pod="openshift-console/console-59d5d646b-nblhm"
Jul 06 14:24:28.090901 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.090607    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 14:24:28.096893 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.096716    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59d5d646b-nblhm"
Jul 06 14:24:28.098070 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.098045    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.102135 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.101941    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 06 14:24:28.102135 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.101993    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 06 14:24:28.102135 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.102015    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 06 14:24:28.102135 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.102091    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 06 14:24:28.102135 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.102105    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 06 14:24:28.102135 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.102122    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 06 14:24:28.102740 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.102019    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 06 14:24:28.102852 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.102832    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 06 14:24:28.103690 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.102999    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 06 14:24:28.103690 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.103305    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 06 14:24:28.103690 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.103540    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 06 14:24:28.105483 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.104753    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 06 14:24:28.105483 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.104937    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-rhzmv\""
Jul 06 14:24:28.105483 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.104994    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7bd0umkvbh04r\""
Jul 06 14:24:28.105483 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.102744    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 06 14:24:28.106276 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.106257    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 06 14:24:28.113720 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.113683    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 14:24:28.213940 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.213908    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a01567d7-91cc-47a4-bcad-610a30e8012a-config-out\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.214150 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.213943    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a01567d7-91cc-47a4-bcad-610a30e8012a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.214150 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.213976    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a01567d7-91cc-47a4-bcad-610a30e8012a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.214150 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.214028    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a01567d7-91cc-47a4-bcad-610a30e8012a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.214150 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.214111    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a01567d7-91cc-47a4-bcad-610a30e8012a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.214317 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.214201    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a01567d7-91cc-47a4-bcad-610a30e8012a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.214317 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.214254    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a01567d7-91cc-47a4-bcad-610a30e8012a-web-config\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.214317 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.214277    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a01567d7-91cc-47a4-bcad-610a30e8012a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.214450 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.214320    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a01567d7-91cc-47a4-bcad-610a30e8012a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.214450 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.214375    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a01567d7-91cc-47a4-bcad-610a30e8012a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.214450 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.214426    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a01567d7-91cc-47a4-bcad-610a30e8012a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.214585 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.214469    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a01567d7-91cc-47a4-bcad-610a30e8012a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.214585 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.214538    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a01567d7-91cc-47a4-bcad-610a30e8012a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.214712 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.214579    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a01567d7-91cc-47a4-bcad-610a30e8012a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.214712 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.214627    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a01567d7-91cc-47a4-bcad-610a30e8012a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.214712 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.214667    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a01567d7-91cc-47a4-bcad-610a30e8012a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.214712 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.214698    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a01567d7-91cc-47a4-bcad-610a30e8012a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.214921 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.214726    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a01567d7-91cc-47a4-bcad-610a30e8012a-config\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.214921 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.214750    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a01567d7-91cc-47a4-bcad-610a30e8012a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.214921 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.214787    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5fll\" (UniqueName: \"kubernetes.io/projected/a01567d7-91cc-47a4-bcad-610a30e8012a-kube-api-access-j5fll\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.320917 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.316215    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a01567d7-91cc-47a4-bcad-610a30e8012a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.320917 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.316859    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a01567d7-91cc-47a4-bcad-610a30e8012a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.320917 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.316899    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a01567d7-91cc-47a4-bcad-610a30e8012a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.320917 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.316939    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a01567d7-91cc-47a4-bcad-610a30e8012a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.320917 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.316990    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a01567d7-91cc-47a4-bcad-610a30e8012a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.320917 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.317017    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a01567d7-91cc-47a4-bcad-610a30e8012a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.320917 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.317058    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a01567d7-91cc-47a4-bcad-610a30e8012a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.320917 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.317100    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a01567d7-91cc-47a4-bcad-610a30e8012a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.320917 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.317133    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a01567d7-91cc-47a4-bcad-610a30e8012a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.320917 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.317164    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a01567d7-91cc-47a4-bcad-610a30e8012a-config\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.320917 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.317188    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a01567d7-91cc-47a4-bcad-610a30e8012a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.320917 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.317232    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5fll\" (UniqueName: \"kubernetes.io/projected/a01567d7-91cc-47a4-bcad-610a30e8012a-kube-api-access-j5fll\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.320917 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.317282    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a01567d7-91cc-47a4-bcad-610a30e8012a-config-out\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.320917 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.317318    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a01567d7-91cc-47a4-bcad-610a30e8012a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.320917 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.317365    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a01567d7-91cc-47a4-bcad-610a30e8012a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.320917 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.317401    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a01567d7-91cc-47a4-bcad-610a30e8012a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.320917 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.317436    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a01567d7-91cc-47a4-bcad-610a30e8012a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.322142 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.317477    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a01567d7-91cc-47a4-bcad-610a30e8012a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.322142 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.317518    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a01567d7-91cc-47a4-bcad-610a30e8012a-web-config\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.322142 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.317542    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a01567d7-91cc-47a4-bcad-610a30e8012a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.322142 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.320672    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a01567d7-91cc-47a4-bcad-610a30e8012a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.322142 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.321293    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a01567d7-91cc-47a4-bcad-610a30e8012a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.322142 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.321546    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a01567d7-91cc-47a4-bcad-610a30e8012a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.324627 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.324604    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a01567d7-91cc-47a4-bcad-610a30e8012a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.325015 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.324990    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a01567d7-91cc-47a4-bcad-610a30e8012a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.325897 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.325867    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a01567d7-91cc-47a4-bcad-610a30e8012a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.326439 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.326403    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a01567d7-91cc-47a4-bcad-610a30e8012a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.327242 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.327195    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a01567d7-91cc-47a4-bcad-610a30e8012a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.327739 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.327704    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a01567d7-91cc-47a4-bcad-610a30e8012a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.328448 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.328426    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a01567d7-91cc-47a4-bcad-610a30e8012a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.329090 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.329069    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a01567d7-91cc-47a4-bcad-610a30e8012a-web-config\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.330984 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.330903    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a01567d7-91cc-47a4-bcad-610a30e8012a-config\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.331550 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.331527    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a01567d7-91cc-47a4-bcad-610a30e8012a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.331660 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.331557    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a01567d7-91cc-47a4-bcad-610a30e8012a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.331718 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.331702    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a01567d7-91cc-47a4-bcad-610a30e8012a-config-out\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.331856 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.331821    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a01567d7-91cc-47a4-bcad-610a30e8012a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.332158 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.332039    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a01567d7-91cc-47a4-bcad-610a30e8012a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.332158 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.332121    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5fll\" (UniqueName: \"kubernetes.io/projected/a01567d7-91cc-47a4-bcad-610a30e8012a-kube-api-access-j5fll\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.332488 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.332463    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a01567d7-91cc-47a4-bcad-610a30e8012a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.335510 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.335488    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a01567d7-91cc-47a4-bcad-610a30e8012a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:28.367880 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.367841    2565 generic.go:356] "Generic (PLEG): container finished" podID="25b26612-ef26-4352-adfd-7254bf55f3bd" containerID="380753ef768407fa4ab5acfa0053a1197f7ec903d567293953d2ad956880a8b4" exitCode=0
Jul 06 14:24:28.368051 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.367918    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"25b26612-ef26-4352-adfd-7254bf55f3bd","Type":"ContainerDied","Data":"380753ef768407fa4ab5acfa0053a1197f7ec903d567293953d2ad956880a8b4"}
Jul 06 14:24:28.412423 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:28.412392    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:29.409046 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:24:29.409016    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf9ca10d_2cae_467d_b45d_f605eeadbfda.slice/crio-00cc88ea231072539684229f00e39db3bc58661c0f7671dadb1f2dda69d68744 WatchSource:0}: Error finding container 00cc88ea231072539684229f00e39db3bc58661c0f7671dadb1f2dda69d68744: Status 404 returned error can't find the container with id 00cc88ea231072539684229f00e39db3bc58661c0f7671dadb1f2dda69d68744
Jul 06 14:24:30.191028 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:30.190946    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-nqv2w"]
Jul 06 14:24:30.196844 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:24:30.196789    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77876daa_2753_4e1a_884c_6eaa8f8ba59e.slice/crio-d6b99c30bc6a0236e4aaafb98c4936fcc7692fb5473d1b252ae96259c435b67c WatchSource:0}: Error finding container d6b99c30bc6a0236e4aaafb98c4936fcc7692fb5473d1b252ae96259c435b67c: Status 404 returned error can't find the container with id d6b99c30bc6a0236e4aaafb98c4936fcc7692fb5473d1b252ae96259c435b67c
Jul 06 14:24:30.379855 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:30.379774    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6d9f795f4-4xmd4" event={"ID":"af9ca10d-2cae-467d-b45d-f605eeadbfda","Type":"ContainerStarted","Data":"00cc88ea231072539684229f00e39db3bc58661c0f7671dadb1f2dda69d68744"}
Jul 06 14:24:30.382369 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:30.382309    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dfsgm" event={"ID":"17707cd3-41ff-4805-a140-934dd45b5547","Type":"ContainerStarted","Data":"c4901492adda0c62d56814bc2b29b80ddb48ce595b492a42dc166f612b5e9575"}
Jul 06 14:24:30.382625 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:30.382589    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dfsgm"
Jul 06 14:24:30.385404 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:30.385245    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gsgv7" event={"ID":"c9f1193d-c182-4701-a021-4bc4f2d8b344","Type":"ContainerStarted","Data":"847fdd4ae0f352305a4df432f06632d2ffcebe9b3adfbb7589b72060339c5ee3"}
Jul 06 14:24:30.388031 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:30.387997    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bgtbf" event={"ID":"a6c6da04-8e16-45a3-b8bc-e6dfa6ede872","Type":"ContainerStarted","Data":"13533abbec0e0ed25fa383ba0846b36a398f6e6bd2f73852d689fdc8ff16bd46"}
Jul 06 14:24:30.390811 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:30.390682    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64f8bfddbc-gvc4g" event={"ID":"c986fb5f-f4bc-4c56-a960-823736801496","Type":"ContainerStarted","Data":"31d8c5b868d12156f5eecede987b961118d878a07178968eddf0cb50020125ca"}
Jul 06 14:24:30.390811 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:30.390751    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64f8bfddbc-gvc4g" event={"ID":"c986fb5f-f4bc-4c56-a960-823736801496","Type":"ContainerStarted","Data":"ed5058509bc2408b013df1c8e3e0adf0b67047f6d7ebdb19d43e823bf1c35802"}
Jul 06 14:24:30.393035 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:30.393012    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-nqv2w" event={"ID":"77876daa-2753-4e1a-884c-6eaa8f8ba59e","Type":"ContainerStarted","Data":"d6b99c30bc6a0236e4aaafb98c4936fcc7692fb5473d1b252ae96259c435b67c"}
Jul 06 14:24:30.402209 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:30.402160    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dfsgm" podStartSLOduration=65.679551886 podStartE2EDuration="1m12.402143138s" totalImagesPullingTime="6.722591252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:23:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:24:30.398838871 +0000 UTC m=+73.577487918" watchObservedRunningTime="2026-07-06 14:24:30.402143138 +0000 UTC m=+73.580792185"
Jul 06 14:24:30.428868 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:30.428762    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-gsgv7" podStartSLOduration=6.511885057 podStartE2EDuration="9.428740243s" totalImagesPullingTime="2.746558381s" totalInitContainerRuntime="170.296805ms" isStatefulPod=true podCreationTimestamp="2026-07-06 14:24:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:24:30.427534272 +0000 UTC m=+73.606183318" watchObservedRunningTime="2026-07-06 14:24:30.428740243 +0000 UTC m=+73.607389291"
Jul 06 14:24:30.430185 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:30.430140    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bgtbf" podStartSLOduration=65.448601372 podStartE2EDuration="1m12.430129431s" totalImagesPullingTime="6.981528059s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:23:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:24:30.411468259 +0000 UTC m=+73.590117309" watchObservedRunningTime="2026-07-06 14:24:30.430129431 +0000 UTC m=+73.608778480"
Jul 06 14:24:30.441126 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:30.441012    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59d5d646b-nblhm"]
Jul 06 14:24:30.443361 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:24:30.442977    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06bec2d8_6db5_414f_8a9a_d1af1273bccc.slice/crio-310d8b0f964fa33c1a1ce74040c678eac1bcec76e010bf9ca09e1f92a1850a89 WatchSource:0}: Error finding container 310d8b0f964fa33c1a1ce74040c678eac1bcec76e010bf9ca09e1f92a1850a89: Status 404 returned error can't find the container with id 310d8b0f964fa33c1a1ce74040c678eac1bcec76e010bf9ca09e1f92a1850a89
Jul 06 14:24:30.454473 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:30.454241    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 14:24:30.458440 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:24:30.458418    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda01567d7_91cc_47a4_bcad_610a30e8012a.slice/crio-27fcbe763bae249756aeafa117b9b224c706a27dd8de671c1251004572c121fc WatchSource:0}: Error finding container 27fcbe763bae249756aeafa117b9b224c706a27dd8de671c1251004572c121fc: Status 404 returned error can't find the container with id 27fcbe763bae249756aeafa117b9b224c706a27dd8de671c1251004572c121fc
Jul 06 14:24:31.398307 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:31.398273    2565 generic.go:356] "Generic (PLEG): container finished" podID="a01567d7-91cc-47a4-bcad-610a30e8012a" containerID="d2df6f8febdc0007b8bfb3d295b7af691a529bc6175dbf85fcb257a93a737684" exitCode=0
Jul 06 14:24:31.398491 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:31.398369    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a01567d7-91cc-47a4-bcad-610a30e8012a","Type":"ContainerDied","Data":"d2df6f8febdc0007b8bfb3d295b7af691a529bc6175dbf85fcb257a93a737684"}
Jul 06 14:24:31.398491 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:31.398446    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a01567d7-91cc-47a4-bcad-610a30e8012a","Type":"ContainerStarted","Data":"27fcbe763bae249756aeafa117b9b224c706a27dd8de671c1251004572c121fc"}
Jul 06 14:24:31.400653 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:31.400614    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64f8bfddbc-gvc4g" event={"ID":"c986fb5f-f4bc-4c56-a960-823736801496","Type":"ContainerStarted","Data":"d47eb8b96d3a011ffc7a0c13b422f4ae53137e8a3cfdbc389e615befb273f639"}
Jul 06 14:24:31.402273 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:31.402191    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59d5d646b-nblhm" event={"ID":"06bec2d8-6db5-414f-8a9a-d1af1273bccc","Type":"ContainerStarted","Data":"031833d56c92d1b8dfdad324fa1c0a5ea1b64c783c1ba5874651329a87247354"}
Jul 06 14:24:31.402273 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:31.402237    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59d5d646b-nblhm" event={"ID":"06bec2d8-6db5-414f-8a9a-d1af1273bccc","Type":"ContainerStarted","Data":"310d8b0f964fa33c1a1ce74040c678eac1bcec76e010bf9ca09e1f92a1850a89"}
Jul 06 14:24:31.442079 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:31.442025    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59d5d646b-nblhm" podStartSLOduration=4.442004178 podStartE2EDuration="4.442004178s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:24:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:24:31.440985852 +0000 UTC m=+74.619634921" watchObservedRunningTime="2026-07-06 14:24:31.442004178 +0000 UTC m=+74.620653201"
Jul 06 14:24:31.853697 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:31.853606    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-846f7b859f-v929t"
Jul 06 14:24:32.412599 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:32.412470    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64f8bfddbc-gvc4g" event={"ID":"c986fb5f-f4bc-4c56-a960-823736801496","Type":"ContainerStarted","Data":"1077b8e966aa44c1da9a7810cb0e78c799d9d64281351d30733c28f99bb3280d"}
Jul 06 14:24:32.412599 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:32.412595    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64f8bfddbc-gvc4g" event={"ID":"c986fb5f-f4bc-4c56-a960-823736801496","Type":"ContainerStarted","Data":"26957bfabb0fa0d5d215f433b922f169fb511b76986565910ccb515f9c42991d"}
Jul 06 14:24:32.412843 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:32.412636    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64f8bfddbc-gvc4g" event={"ID":"c986fb5f-f4bc-4c56-a960-823736801496","Type":"ContainerStarted","Data":"e1c39ff72cfc6cd817c0459c1536e53c24eb637f1018083725aa1c4cf2c63e85"}
Jul 06 14:24:32.413078 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:32.412965    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-64f8bfddbc-gvc4g"
Jul 06 14:24:32.417850 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:32.417730    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"25b26612-ef26-4352-adfd-7254bf55f3bd","Type":"ContainerStarted","Data":"a18e6bfe25cfc8055d9a4be0996ae1464ec15f2e3aafda6bf0a5e0f6a3ad85a5"}
Jul 06 14:24:32.417850 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:32.417798    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"25b26612-ef26-4352-adfd-7254bf55f3bd","Type":"ContainerStarted","Data":"83eb0184066e6570977b123a44b4e1367e026f9d0a88a994364e77ff345254a0"}
Jul 06 14:24:32.417850 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:32.417838    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"25b26612-ef26-4352-adfd-7254bf55f3bd","Type":"ContainerStarted","Data":"b51e5e51d05f677b58661c15c0e056879a5362a7337e2f81dd2a10ee1f864429"}
Jul 06 14:24:32.418067 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:32.417876    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"25b26612-ef26-4352-adfd-7254bf55f3bd","Type":"ContainerStarted","Data":"d1c60c7d77cf85b7e838ea22eb608efa6658e3deef45551cd045df81a1140830"}
Jul 06 14:24:32.418067 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:32.417915    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"25b26612-ef26-4352-adfd-7254bf55f3bd","Type":"ContainerStarted","Data":"3fc61851ff7dc7ce1070d5b972a8dde48010cd02982178ed1293553b8a19ce37"}
Jul 06 14:24:32.418067 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:32.417951    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"25b26612-ef26-4352-adfd-7254bf55f3bd","Type":"ContainerStarted","Data":"aa429d0fce8121c9df438df75c626f6dea641975144c41add2cdf54164018545"}
Jul 06 14:24:32.420971 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:32.420927    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6d9f795f4-4xmd4" event={"ID":"af9ca10d-2cae-467d-b45d-f605eeadbfda","Type":"ContainerStarted","Data":"49e57b780546ff90373ff61a2c2df82e709d3e9215d9c56191357809cbc7b9c0"}
Jul 06 14:24:32.436720 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:32.435610    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-64f8bfddbc-gvc4g" podStartSLOduration=2.415026444 podStartE2EDuration="8.435589841s" totalImagesPullingTime="6.020563397s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:24:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:24:32.434606193 +0000 UTC m=+75.613255241" watchObservedRunningTime="2026-07-06 14:24:32.435589841 +0000 UTC m=+75.614238890"
Jul 06 14:24:32.462295 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:32.462242    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=5.058923112 podStartE2EDuration="10.462223908s" totalImagesPullingTime="5.381408444s" totalInitContainerRuntime="21.892352ms" isStatefulPod=false podCreationTimestamp="2026-07-06 14:24:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:24:32.459059127 +0000 UTC m=+75.637708173" watchObservedRunningTime="2026-07-06 14:24:32.462223908 +0000 UTC m=+75.640872955"
Jul 06 14:24:32.485381 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:32.485225    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6d9f795f4-4xmd4" podStartSLOduration=4.107060107 podStartE2EDuration="6.485205188s" totalImagesPullingTime="2.378145081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:24:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:24:32.483259502 +0000 UTC m=+75.661908590" watchObservedRunningTime="2026-07-06 14:24:32.485205188 +0000 UTC m=+75.663854247"
Jul 06 14:24:33.427754 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:33.427714    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-nqv2w" event={"ID":"77876daa-2753-4e1a-884c-6eaa8f8ba59e","Type":"ContainerStarted","Data":"ba4c32213256da81ad736b0a1746af4ec17af51c1dc5589d49855b2ab04b9202"}
Jul 06 14:24:33.428695 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:33.428667    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-nqv2w"
Jul 06 14:24:33.434387 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:33.434362    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-nqv2w"
Jul 06 14:24:33.445159 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:33.445110    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-nqv2w" podStartSLOduration=4.675765847 podStartE2EDuration="7.445096915s" totalImagesPullingTime="2.769331068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:24:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:24:33.443464124 +0000 UTC m=+76.622113183" watchObservedRunningTime="2026-07-06 14:24:33.445096915 +0000 UTC m=+76.623745962"
Jul 06 14:24:35.439738 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:35.439648    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a01567d7-91cc-47a4-bcad-610a30e8012a","Type":"ContainerStarted","Data":"56577f8e76b6ec0251837797d3fbd2a489a24fa2140d725337b89c098f76cb96"}
Jul 06 14:24:35.440089 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:35.439758    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a01567d7-91cc-47a4-bcad-610a30e8012a","Type":"ContainerStarted","Data":"291e5d4ee3e4246a15f01791c3bc3c4b6afe5d749dea8357c49997157822af32"}
Jul 06 14:24:35.440089 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:35.439788    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a01567d7-91cc-47a4-bcad-610a30e8012a","Type":"ContainerStarted","Data":"48703077cd2ce165bc3ffc59f865c172cd363db64439409d0203514b32cccded"}
Jul 06 14:24:35.440089 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:35.439817    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a01567d7-91cc-47a4-bcad-610a30e8012a","Type":"ContainerStarted","Data":"630dbe6e99ff12cb98157a74ea4122c943e4ed09c7e2b159be3b36f017b23f61"}
Jul 06 14:24:35.440089 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:35.439852    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a01567d7-91cc-47a4-bcad-610a30e8012a","Type":"ContainerStarted","Data":"0e836114cf68371efcfb0fb6b7d581580d5d3d87c4f317e66a974b3d579b53b1"}
Jul 06 14:24:35.440089 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:35.439876    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a01567d7-91cc-47a4-bcad-610a30e8012a","Type":"ContainerStarted","Data":"1f595de670daa90000c566ac0fcad776cab7a1ec3979ba6b447c172651dc4c2b"}
Jul 06 14:24:35.474712 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:35.474621    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.916241426 podStartE2EDuration="7.474600081s" totalImagesPullingTime="3.525886616s" totalInitContainerRuntime="32.472039ms" isStatefulPod=false podCreationTimestamp="2026-07-06 14:24:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:24:35.472647085 +0000 UTC m=+78.651296143" watchObservedRunningTime="2026-07-06 14:24:35.474600081 +0000 UTC m=+78.653249127"
Jul 06 14:24:38.097739 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:38.097705    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59d5d646b-nblhm"
Jul 06 14:24:38.098117 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:38.097763    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59d5d646b-nblhm"
Jul 06 14:24:38.102290 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:38.102268    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59d5d646b-nblhm"
Jul 06 14:24:38.413024 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:38.412994    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:38.434688 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:38.434666    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-64f8bfddbc-gvc4g"
Jul 06 14:24:38.455416 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:38.455365    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59d5d646b-nblhm"
Jul 06 14:24:38.528582 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:38.528557    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78859cf567-429pl"]
Jul 06 14:24:46.456246 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:46.456203    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6d9f795f4-4xmd4"
Jul 06 14:24:46.456684 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:46.456295    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6d9f795f4-4xmd4"
Jul 06 14:24:52.771083 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:52.771017    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-846f7b859f-v929t" podUID="3a428a99-c8d9-4d2e-bc55-6dbfc9575bda" containerName="console" containerID="cri-o://52be82ae2cc9302f149d1596cb633306375cdb20d4c7b9a12af36d15a90a11b4" gracePeriod=15
Jul 06 14:24:53.009576 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:53.009553    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-846f7b859f-v929t"
Jul 06 14:24:53.060442 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:53.060366    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3a428a99-c8d9-4d2e-bc55-6dbfc9575bda-service-ca\") pod \"3a428a99-c8d9-4d2e-bc55-6dbfc9575bda\" (UID: \"3a428a99-c8d9-4d2e-bc55-6dbfc9575bda\") "
Jul 06 14:24:53.060442 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:53.060399    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a428a99-c8d9-4d2e-bc55-6dbfc9575bda-console-serving-cert\") pod \"3a428a99-c8d9-4d2e-bc55-6dbfc9575bda\" (UID: \"3a428a99-c8d9-4d2e-bc55-6dbfc9575bda\") "
Jul 06 14:24:53.060442 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:53.060425    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3a428a99-c8d9-4d2e-bc55-6dbfc9575bda-oauth-serving-cert\") pod \"3a428a99-c8d9-4d2e-bc55-6dbfc9575bda\" (UID: \"3a428a99-c8d9-4d2e-bc55-6dbfc9575bda\") "
Jul 06 14:24:53.060700 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:53.060483    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3a428a99-c8d9-4d2e-bc55-6dbfc9575bda-console-oauth-config\") pod \"3a428a99-c8d9-4d2e-bc55-6dbfc9575bda\" (UID: \"3a428a99-c8d9-4d2e-bc55-6dbfc9575bda\") "
Jul 06 14:24:53.060700 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:53.060504    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a428a99-c8d9-4d2e-bc55-6dbfc9575bda-trusted-ca-bundle\") pod \"3a428a99-c8d9-4d2e-bc55-6dbfc9575bda\" (UID: \"3a428a99-c8d9-4d2e-bc55-6dbfc9575bda\") "
Jul 06 14:24:53.060700 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:53.060663    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3a428a99-c8d9-4d2e-bc55-6dbfc9575bda-console-config\") pod \"3a428a99-c8d9-4d2e-bc55-6dbfc9575bda\" (UID: \"3a428a99-c8d9-4d2e-bc55-6dbfc9575bda\") "
Jul 06 14:24:53.060849 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:53.060707    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x5t8d\" (UniqueName: \"kubernetes.io/projected/3a428a99-c8d9-4d2e-bc55-6dbfc9575bda-kube-api-access-x5t8d\") pod \"3a428a99-c8d9-4d2e-bc55-6dbfc9575bda\" (UID: \"3a428a99-c8d9-4d2e-bc55-6dbfc9575bda\") "
Jul 06 14:24:53.060849 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:53.060793    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a428a99-c8d9-4d2e-bc55-6dbfc9575bda-service-ca" (OuterVolumeSpecName: "service-ca") pod "3a428a99-c8d9-4d2e-bc55-6dbfc9575bda" (UID: "3a428a99-c8d9-4d2e-bc55-6dbfc9575bda"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:24:53.060984 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:53.060954    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a428a99-c8d9-4d2e-bc55-6dbfc9575bda-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3a428a99-c8d9-4d2e-bc55-6dbfc9575bda" (UID: "3a428a99-c8d9-4d2e-bc55-6dbfc9575bda"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:24:53.060984 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:53.060960    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a428a99-c8d9-4d2e-bc55-6dbfc9575bda-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3a428a99-c8d9-4d2e-bc55-6dbfc9575bda" (UID: "3a428a99-c8d9-4d2e-bc55-6dbfc9575bda"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:24:53.061081 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:53.061024    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a428a99-c8d9-4d2e-bc55-6dbfc9575bda-console-config" (OuterVolumeSpecName: "console-config") pod "3a428a99-c8d9-4d2e-bc55-6dbfc9575bda" (UID: "3a428a99-c8d9-4d2e-bc55-6dbfc9575bda"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:24:53.061081 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:53.061048    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3a428a99-c8d9-4d2e-bc55-6dbfc9575bda-service-ca\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:24:53.061081 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:53.061070    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3a428a99-c8d9-4d2e-bc55-6dbfc9575bda-oauth-serving-cert\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:24:53.061233 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:53.061086    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a428a99-c8d9-4d2e-bc55-6dbfc9575bda-trusted-ca-bundle\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:24:53.062897 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:53.062874    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a428a99-c8d9-4d2e-bc55-6dbfc9575bda-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3a428a99-c8d9-4d2e-bc55-6dbfc9575bda" (UID: "3a428a99-c8d9-4d2e-bc55-6dbfc9575bda"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:24:53.062996 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:53.062951    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a428a99-c8d9-4d2e-bc55-6dbfc9575bda-kube-api-access-x5t8d" (OuterVolumeSpecName: "kube-api-access-x5t8d") pod "3a428a99-c8d9-4d2e-bc55-6dbfc9575bda" (UID: "3a428a99-c8d9-4d2e-bc55-6dbfc9575bda"). InnerVolumeSpecName "kube-api-access-x5t8d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:24:53.062996 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:53.062958    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a428a99-c8d9-4d2e-bc55-6dbfc9575bda-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3a428a99-c8d9-4d2e-bc55-6dbfc9575bda" (UID: "3a428a99-c8d9-4d2e-bc55-6dbfc9575bda"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:24:53.162429 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:53.162398    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3a428a99-c8d9-4d2e-bc55-6dbfc9575bda-console-oauth-config\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:24:53.162429 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:53.162427    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3a428a99-c8d9-4d2e-bc55-6dbfc9575bda-console-config\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:24:53.162429 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:53.162436    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x5t8d\" (UniqueName: \"kubernetes.io/projected/3a428a99-c8d9-4d2e-bc55-6dbfc9575bda-kube-api-access-x5t8d\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:24:53.162646 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:53.162458    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a428a99-c8d9-4d2e-bc55-6dbfc9575bda-console-serving-cert\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:24:53.518378 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:53.518325    2565 generic.go:356] "Generic (PLEG): container finished" podID="3a428a99-c8d9-4d2e-bc55-6dbfc9575bda" containerID="52be82ae2cc9302f149d1596cb633306375cdb20d4c7b9a12af36d15a90a11b4" exitCode=0
Jul 06 14:24:53.518378 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:53.518382    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-846f7b859f-v929t"
Jul 06 14:24:53.518590 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:53.518412    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-846f7b859f-v929t" event={"ID":"3a428a99-c8d9-4d2e-bc55-6dbfc9575bda","Type":"ContainerDied","Data":"52be82ae2cc9302f149d1596cb633306375cdb20d4c7b9a12af36d15a90a11b4"}
Jul 06 14:24:53.518590 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:53.518472    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-846f7b859f-v929t" event={"ID":"3a428a99-c8d9-4d2e-bc55-6dbfc9575bda","Type":"ContainerDied","Data":"a725c9307a2358a250a96b79fe72b0d6c4846327a6a0afb55f40df6b884a78f0"}
Jul 06 14:24:53.518590 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:53.518514    2565 scope.go:117] "RemoveContainer" containerID="52be82ae2cc9302f149d1596cb633306375cdb20d4c7b9a12af36d15a90a11b4"
Jul 06 14:24:53.527881 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:53.527864    2565 scope.go:117] "RemoveContainer" containerID="52be82ae2cc9302f149d1596cb633306375cdb20d4c7b9a12af36d15a90a11b4"
Jul 06 14:24:53.528143 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:24:53.528124    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52be82ae2cc9302f149d1596cb633306375cdb20d4c7b9a12af36d15a90a11b4\": container with ID starting with 52be82ae2cc9302f149d1596cb633306375cdb20d4c7b9a12af36d15a90a11b4 not found: ID does not exist" containerID="52be82ae2cc9302f149d1596cb633306375cdb20d4c7b9a12af36d15a90a11b4"
Jul 06 14:24:53.528183 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:53.528152    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52be82ae2cc9302f149d1596cb633306375cdb20d4c7b9a12af36d15a90a11b4"} err="failed to get container status \"52be82ae2cc9302f149d1596cb633306375cdb20d4c7b9a12af36d15a90a11b4\": rpc error: code = NotFound desc = could not find container \"52be82ae2cc9302f149d1596cb633306375cdb20d4c7b9a12af36d15a90a11b4\": container with ID starting with 52be82ae2cc9302f149d1596cb633306375cdb20d4c7b9a12af36d15a90a11b4 not found: ID does not exist"
Jul 06 14:24:53.538933 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:53.538909    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-846f7b859f-v929t"]
Jul 06 14:24:53.540549 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:53.540527    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-846f7b859f-v929t"]
Jul 06 14:24:53.955598 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:24:53.955569    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a428a99-c8d9-4d2e-bc55-6dbfc9575bda" path="/var/lib/kubelet/pods/3a428a99-c8d9-4d2e-bc55-6dbfc9575bda/volumes"
Jul 06 14:25:01.404754 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:01.404722    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dfsgm"
Jul 06 14:25:03.549158 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:03.549083    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-78859cf567-429pl" podUID="07355b0b-792e-48d5-bc8b-3c52b0a9a155" containerName="console" containerID="cri-o://bb23edf153e62c8b1a9e9ccc80acb887642fd25e7c798d48a5eddea9bab3297a" gracePeriod=15
Jul 06 14:25:03.817525 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:03.817449    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78859cf567-429pl"
Jul 06 14:25:03.960278 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:03.960243    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/07355b0b-792e-48d5-bc8b-3c52b0a9a155-console-config\") pod \"07355b0b-792e-48d5-bc8b-3c52b0a9a155\" (UID: \"07355b0b-792e-48d5-bc8b-3c52b0a9a155\") "
Jul 06 14:25:03.960278 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:03.960279    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hlpnz\" (UniqueName: \"kubernetes.io/projected/07355b0b-792e-48d5-bc8b-3c52b0a9a155-kube-api-access-hlpnz\") pod \"07355b0b-792e-48d5-bc8b-3c52b0a9a155\" (UID: \"07355b0b-792e-48d5-bc8b-3c52b0a9a155\") "
Jul 06 14:25:03.960501 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:03.960319    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/07355b0b-792e-48d5-bc8b-3c52b0a9a155-oauth-serving-cert\") pod \"07355b0b-792e-48d5-bc8b-3c52b0a9a155\" (UID: \"07355b0b-792e-48d5-bc8b-3c52b0a9a155\") "
Jul 06 14:25:03.960501 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:03.960370    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/07355b0b-792e-48d5-bc8b-3c52b0a9a155-console-oauth-config\") pod \"07355b0b-792e-48d5-bc8b-3c52b0a9a155\" (UID: \"07355b0b-792e-48d5-bc8b-3c52b0a9a155\") "
Jul 06 14:25:03.960501 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:03.960418    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/07355b0b-792e-48d5-bc8b-3c52b0a9a155-service-ca\") pod \"07355b0b-792e-48d5-bc8b-3c52b0a9a155\" (UID: \"07355b0b-792e-48d5-bc8b-3c52b0a9a155\") "
Jul 06 14:25:03.960501 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:03.960439    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/07355b0b-792e-48d5-bc8b-3c52b0a9a155-console-serving-cert\") pod \"07355b0b-792e-48d5-bc8b-3c52b0a9a155\" (UID: \"07355b0b-792e-48d5-bc8b-3c52b0a9a155\") "
Jul 06 14:25:03.960797 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:03.960756    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07355b0b-792e-48d5-bc8b-3c52b0a9a155-console-config" (OuterVolumeSpecName: "console-config") pod "07355b0b-792e-48d5-bc8b-3c52b0a9a155" (UID: "07355b0b-792e-48d5-bc8b-3c52b0a9a155"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:25:03.960925 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:03.960800    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07355b0b-792e-48d5-bc8b-3c52b0a9a155-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "07355b0b-792e-48d5-bc8b-3c52b0a9a155" (UID: "07355b0b-792e-48d5-bc8b-3c52b0a9a155"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:25:03.960925 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:03.960881    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07355b0b-792e-48d5-bc8b-3c52b0a9a155-service-ca" (OuterVolumeSpecName: "service-ca") pod "07355b0b-792e-48d5-bc8b-3c52b0a9a155" (UID: "07355b0b-792e-48d5-bc8b-3c52b0a9a155"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:25:03.962551 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:03.962528    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07355b0b-792e-48d5-bc8b-3c52b0a9a155-kube-api-access-hlpnz" (OuterVolumeSpecName: "kube-api-access-hlpnz") pod "07355b0b-792e-48d5-bc8b-3c52b0a9a155" (UID: "07355b0b-792e-48d5-bc8b-3c52b0a9a155"). InnerVolumeSpecName "kube-api-access-hlpnz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:25:03.962663 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:03.962639    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07355b0b-792e-48d5-bc8b-3c52b0a9a155-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "07355b0b-792e-48d5-bc8b-3c52b0a9a155" (UID: "07355b0b-792e-48d5-bc8b-3c52b0a9a155"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:25:03.962738 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:03.962715    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07355b0b-792e-48d5-bc8b-3c52b0a9a155-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "07355b0b-792e-48d5-bc8b-3c52b0a9a155" (UID: "07355b0b-792e-48d5-bc8b-3c52b0a9a155"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:25:04.061848 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:04.061809    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/07355b0b-792e-48d5-bc8b-3c52b0a9a155-service-ca\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:25:04.061848 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:04.061840    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/07355b0b-792e-48d5-bc8b-3c52b0a9a155-console-serving-cert\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:25:04.061848 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:04.061851    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/07355b0b-792e-48d5-bc8b-3c52b0a9a155-console-config\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:25:04.061848 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:04.061861    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hlpnz\" (UniqueName: \"kubernetes.io/projected/07355b0b-792e-48d5-bc8b-3c52b0a9a155-kube-api-access-hlpnz\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:25:04.062105 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:04.061869    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/07355b0b-792e-48d5-bc8b-3c52b0a9a155-oauth-serving-cert\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:25:04.062105 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:04.061878    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/07355b0b-792e-48d5-bc8b-3c52b0a9a155-console-oauth-config\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:25:04.565900 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:04.565870    2565 generic.go:356] "Generic (PLEG): container finished" podID="07355b0b-792e-48d5-bc8b-3c52b0a9a155" containerID="bb23edf153e62c8b1a9e9ccc80acb887642fd25e7c798d48a5eddea9bab3297a" exitCode=0
Jul 06 14:25:04.566400 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:04.565915    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78859cf567-429pl"
Jul 06 14:25:04.566400 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:04.565928    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78859cf567-429pl" event={"ID":"07355b0b-792e-48d5-bc8b-3c52b0a9a155","Type":"ContainerDied","Data":"bb23edf153e62c8b1a9e9ccc80acb887642fd25e7c798d48a5eddea9bab3297a"}
Jul 06 14:25:04.566400 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:04.565966    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78859cf567-429pl" event={"ID":"07355b0b-792e-48d5-bc8b-3c52b0a9a155","Type":"ContainerDied","Data":"9db5dad8e8bfa436d1c859541e68c73ef99b12df0e96cea947bbb82edc2b77f2"}
Jul 06 14:25:04.566400 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:04.565985    2565 scope.go:117] "RemoveContainer" containerID="bb23edf153e62c8b1a9e9ccc80acb887642fd25e7c798d48a5eddea9bab3297a"
Jul 06 14:25:04.574731 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:04.574715    2565 scope.go:117] "RemoveContainer" containerID="bb23edf153e62c8b1a9e9ccc80acb887642fd25e7c798d48a5eddea9bab3297a"
Jul 06 14:25:04.575026 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:25:04.575004    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb23edf153e62c8b1a9e9ccc80acb887642fd25e7c798d48a5eddea9bab3297a\": container with ID starting with bb23edf153e62c8b1a9e9ccc80acb887642fd25e7c798d48a5eddea9bab3297a not found: ID does not exist" containerID="bb23edf153e62c8b1a9e9ccc80acb887642fd25e7c798d48a5eddea9bab3297a"
Jul 06 14:25:04.575079 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:04.575035    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb23edf153e62c8b1a9e9ccc80acb887642fd25e7c798d48a5eddea9bab3297a"} err="failed to get container status \"bb23edf153e62c8b1a9e9ccc80acb887642fd25e7c798d48a5eddea9bab3297a\": rpc error: code = NotFound desc = could not find container \"bb23edf153e62c8b1a9e9ccc80acb887642fd25e7c798d48a5eddea9bab3297a\": container with ID starting with bb23edf153e62c8b1a9e9ccc80acb887642fd25e7c798d48a5eddea9bab3297a not found: ID does not exist"
Jul 06 14:25:04.585915 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:04.585892    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78859cf567-429pl"]
Jul 06 14:25:04.589803 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:04.589783    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-78859cf567-429pl"]
Jul 06 14:25:05.953218 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:05.953180    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07355b0b-792e-48d5-bc8b-3c52b0a9a155" path="/var/lib/kubelet/pods/07355b0b-792e-48d5-bc8b-3c52b0a9a155/volumes"
Jul 06 14:25:06.460883 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:06.460853    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6d9f795f4-4xmd4"
Jul 06 14:25:06.464607 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:06.464588    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6d9f795f4-4xmd4"
Jul 06 14:25:28.412503 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:28.412471    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:28.431914 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:28.431881    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:28.683379 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:28.683293    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:42.137587 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:42.137546    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 14:25:42.138147 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:42.137880    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="25b26612-ef26-4352-adfd-7254bf55f3bd" containerName="kube-rbac-proxy" containerID="cri-o://b51e5e51d05f677b58661c15c0e056879a5362a7337e2f81dd2a10ee1f864429" gracePeriod=120
Jul 06 14:25:42.138147 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:42.137907    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="25b26612-ef26-4352-adfd-7254bf55f3bd" containerName="prom-label-proxy" containerID="cri-o://a18e6bfe25cfc8055d9a4be0996ae1464ec15f2e3aafda6bf0a5e0f6a3ad85a5" gracePeriod=120
Jul 06 14:25:42.138147 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:42.137963    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="25b26612-ef26-4352-adfd-7254bf55f3bd" containerName="kube-rbac-proxy-metric" containerID="cri-o://83eb0184066e6570977b123a44b4e1367e026f9d0a88a994364e77ff345254a0" gracePeriod=120
Jul 06 14:25:42.138147 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:42.138015    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="25b26612-ef26-4352-adfd-7254bf55f3bd" containerName="config-reloader" containerID="cri-o://3fc61851ff7dc7ce1070d5b972a8dde48010cd02982178ed1293553b8a19ce37" gracePeriod=120
Jul 06 14:25:42.138147 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:42.137926    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="25b26612-ef26-4352-adfd-7254bf55f3bd" containerName="kube-rbac-proxy-web" containerID="cri-o://d1c60c7d77cf85b7e838ea22eb608efa6658e3deef45551cd045df81a1140830" gracePeriod=120
Jul 06 14:25:42.138147 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:42.137862    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="25b26612-ef26-4352-adfd-7254bf55f3bd" containerName="alertmanager" containerID="cri-o://aa429d0fce8121c9df438df75c626f6dea641975144c41add2cdf54164018545" gracePeriod=120
Jul 06 14:25:42.726913 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:42.726880    2565 generic.go:356] "Generic (PLEG): container finished" podID="25b26612-ef26-4352-adfd-7254bf55f3bd" containerID="a18e6bfe25cfc8055d9a4be0996ae1464ec15f2e3aafda6bf0a5e0f6a3ad85a5" exitCode=0
Jul 06 14:25:42.726913 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:42.726905    2565 generic.go:356] "Generic (PLEG): container finished" podID="25b26612-ef26-4352-adfd-7254bf55f3bd" containerID="b51e5e51d05f677b58661c15c0e056879a5362a7337e2f81dd2a10ee1f864429" exitCode=0
Jul 06 14:25:42.726913 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:42.726911    2565 generic.go:356] "Generic (PLEG): container finished" podID="25b26612-ef26-4352-adfd-7254bf55f3bd" containerID="3fc61851ff7dc7ce1070d5b972a8dde48010cd02982178ed1293553b8a19ce37" exitCode=0
Jul 06 14:25:42.726913 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:42.726916    2565 generic.go:356] "Generic (PLEG): container finished" podID="25b26612-ef26-4352-adfd-7254bf55f3bd" containerID="aa429d0fce8121c9df438df75c626f6dea641975144c41add2cdf54164018545" exitCode=0
Jul 06 14:25:42.727169 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:42.726955    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"25b26612-ef26-4352-adfd-7254bf55f3bd","Type":"ContainerDied","Data":"a18e6bfe25cfc8055d9a4be0996ae1464ec15f2e3aafda6bf0a5e0f6a3ad85a5"}
Jul 06 14:25:42.727169 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:42.727019    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"25b26612-ef26-4352-adfd-7254bf55f3bd","Type":"ContainerDied","Data":"b51e5e51d05f677b58661c15c0e056879a5362a7337e2f81dd2a10ee1f864429"}
Jul 06 14:25:42.727169 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:42.727045    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"25b26612-ef26-4352-adfd-7254bf55f3bd","Type":"ContainerDied","Data":"3fc61851ff7dc7ce1070d5b972a8dde48010cd02982178ed1293553b8a19ce37"}
Jul 06 14:25:42.727169 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:42.727068    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"25b26612-ef26-4352-adfd-7254bf55f3bd","Type":"ContainerDied","Data":"aa429d0fce8121c9df438df75c626f6dea641975144c41add2cdf54164018545"}
Jul 06 14:25:43.380628 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.380603    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:25:43.511040 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.510939    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/25b26612-ef26-4352-adfd-7254bf55f3bd-secret-alertmanager-main-tls\") pod \"25b26612-ef26-4352-adfd-7254bf55f3bd\" (UID: \"25b26612-ef26-4352-adfd-7254bf55f3bd\") "
Jul 06 14:25:43.511040 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.510990    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/25b26612-ef26-4352-adfd-7254bf55f3bd-alertmanager-main-db\") pod \"25b26612-ef26-4352-adfd-7254bf55f3bd\" (UID: \"25b26612-ef26-4352-adfd-7254bf55f3bd\") "
Jul 06 14:25:43.511040 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.511013    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/25b26612-ef26-4352-adfd-7254bf55f3bd-tls-assets\") pod \"25b26612-ef26-4352-adfd-7254bf55f3bd\" (UID: \"25b26612-ef26-4352-adfd-7254bf55f3bd\") "
Jul 06 14:25:43.511310 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.511041    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-msmxh\" (UniqueName: \"kubernetes.io/projected/25b26612-ef26-4352-adfd-7254bf55f3bd-kube-api-access-msmxh\") pod \"25b26612-ef26-4352-adfd-7254bf55f3bd\" (UID: \"25b26612-ef26-4352-adfd-7254bf55f3bd\") "
Jul 06 14:25:43.511310 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.511070    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25b26612-ef26-4352-adfd-7254bf55f3bd-metrics-client-ca\") pod \"25b26612-ef26-4352-adfd-7254bf55f3bd\" (UID: \"25b26612-ef26-4352-adfd-7254bf55f3bd\") "
Jul 06 14:25:43.511310 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.511096    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/25b26612-ef26-4352-adfd-7254bf55f3bd-secret-alertmanager-kube-rbac-proxy\") pod \"25b26612-ef26-4352-adfd-7254bf55f3bd\" (UID: \"25b26612-ef26-4352-adfd-7254bf55f3bd\") "
Jul 06 14:25:43.511310 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.511118    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25b26612-ef26-4352-adfd-7254bf55f3bd-alertmanager-trusted-ca-bundle\") pod \"25b26612-ef26-4352-adfd-7254bf55f3bd\" (UID: \"25b26612-ef26-4352-adfd-7254bf55f3bd\") "
Jul 06 14:25:43.511310 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.511166    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/25b26612-ef26-4352-adfd-7254bf55f3bd-config-volume\") pod \"25b26612-ef26-4352-adfd-7254bf55f3bd\" (UID: \"25b26612-ef26-4352-adfd-7254bf55f3bd\") "
Jul 06 14:25:43.511310 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.511214    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/25b26612-ef26-4352-adfd-7254bf55f3bd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"25b26612-ef26-4352-adfd-7254bf55f3bd\" (UID: \"25b26612-ef26-4352-adfd-7254bf55f3bd\") "
Jul 06 14:25:43.511310 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.511259    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/25b26612-ef26-4352-adfd-7254bf55f3bd-cluster-tls-config\") pod \"25b26612-ef26-4352-adfd-7254bf55f3bd\" (UID: \"25b26612-ef26-4352-adfd-7254bf55f3bd\") "
Jul 06 14:25:43.511310 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.511300    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/25b26612-ef26-4352-adfd-7254bf55f3bd-secret-alertmanager-kube-rbac-proxy-web\") pod \"25b26612-ef26-4352-adfd-7254bf55f3bd\" (UID: \"25b26612-ef26-4352-adfd-7254bf55f3bd\") "
Jul 06 14:25:43.511756 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.511322    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25b26612-ef26-4352-adfd-7254bf55f3bd-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "25b26612-ef26-4352-adfd-7254bf55f3bd" (UID: "25b26612-ef26-4352-adfd-7254bf55f3bd"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:25:43.511756 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.511401    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/25b26612-ef26-4352-adfd-7254bf55f3bd-web-config\") pod \"25b26612-ef26-4352-adfd-7254bf55f3bd\" (UID: \"25b26612-ef26-4352-adfd-7254bf55f3bd\") "
Jul 06 14:25:43.511756 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.511502    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/25b26612-ef26-4352-adfd-7254bf55f3bd-config-out\") pod \"25b26612-ef26-4352-adfd-7254bf55f3bd\" (UID: \"25b26612-ef26-4352-adfd-7254bf55f3bd\") "
Jul 06 14:25:43.511756 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.511618    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25b26612-ef26-4352-adfd-7254bf55f3bd-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "25b26612-ef26-4352-adfd-7254bf55f3bd" (UID: "25b26612-ef26-4352-adfd-7254bf55f3bd"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:25:43.511756 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.511671    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25b26612-ef26-4352-adfd-7254bf55f3bd-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "25b26612-ef26-4352-adfd-7254bf55f3bd" (UID: "25b26612-ef26-4352-adfd-7254bf55f3bd"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:25:43.512011 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.511829    2565 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/25b26612-ef26-4352-adfd-7254bf55f3bd-alertmanager-main-db\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:25:43.512011 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.511847    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25b26612-ef26-4352-adfd-7254bf55f3bd-metrics-client-ca\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:25:43.512011 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.511866    2565 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25b26612-ef26-4352-adfd-7254bf55f3bd-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:25:43.514239 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.514201    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25b26612-ef26-4352-adfd-7254bf55f3bd-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "25b26612-ef26-4352-adfd-7254bf55f3bd" (UID: "25b26612-ef26-4352-adfd-7254bf55f3bd"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:25:43.514681 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.514642    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25b26612-ef26-4352-adfd-7254bf55f3bd-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "25b26612-ef26-4352-adfd-7254bf55f3bd" (UID: "25b26612-ef26-4352-adfd-7254bf55f3bd"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:25:43.514793 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.514691    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25b26612-ef26-4352-adfd-7254bf55f3bd-kube-api-access-msmxh" (OuterVolumeSpecName: "kube-api-access-msmxh") pod "25b26612-ef26-4352-adfd-7254bf55f3bd" (UID: "25b26612-ef26-4352-adfd-7254bf55f3bd"). InnerVolumeSpecName "kube-api-access-msmxh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:25:43.514859 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.514819    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25b26612-ef26-4352-adfd-7254bf55f3bd-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "25b26612-ef26-4352-adfd-7254bf55f3bd" (UID: "25b26612-ef26-4352-adfd-7254bf55f3bd"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:25:43.514974 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.514939    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25b26612-ef26-4352-adfd-7254bf55f3bd-config-out" (OuterVolumeSpecName: "config-out") pod "25b26612-ef26-4352-adfd-7254bf55f3bd" (UID: "25b26612-ef26-4352-adfd-7254bf55f3bd"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:25:43.515357 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.515312    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25b26612-ef26-4352-adfd-7254bf55f3bd-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "25b26612-ef26-4352-adfd-7254bf55f3bd" (UID: "25b26612-ef26-4352-adfd-7254bf55f3bd"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:25:43.515473 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.515455    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25b26612-ef26-4352-adfd-7254bf55f3bd-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "25b26612-ef26-4352-adfd-7254bf55f3bd" (UID: "25b26612-ef26-4352-adfd-7254bf55f3bd"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:25:43.515701 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.515682    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25b26612-ef26-4352-adfd-7254bf55f3bd-config-volume" (OuterVolumeSpecName: "config-volume") pod "25b26612-ef26-4352-adfd-7254bf55f3bd" (UID: "25b26612-ef26-4352-adfd-7254bf55f3bd"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:25:43.518741 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.518715    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25b26612-ef26-4352-adfd-7254bf55f3bd-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "25b26612-ef26-4352-adfd-7254bf55f3bd" (UID: "25b26612-ef26-4352-adfd-7254bf55f3bd"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:25:43.525513 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.525481    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25b26612-ef26-4352-adfd-7254bf55f3bd-web-config" (OuterVolumeSpecName: "web-config") pod "25b26612-ef26-4352-adfd-7254bf55f3bd" (UID: "25b26612-ef26-4352-adfd-7254bf55f3bd"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:25:43.613026 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.612998    2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/25b26612-ef26-4352-adfd-7254bf55f3bd-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:25:43.613026 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.613025    2565 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/25b26612-ef26-4352-adfd-7254bf55f3bd-config-volume\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:25:43.613179 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.613037    2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/25b26612-ef26-4352-adfd-7254bf55f3bd-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:25:43.613179 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.613047    2565 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/25b26612-ef26-4352-adfd-7254bf55f3bd-cluster-tls-config\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:25:43.613179 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.613057    2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/25b26612-ef26-4352-adfd-7254bf55f3bd-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:25:43.613179 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.613067    2565 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/25b26612-ef26-4352-adfd-7254bf55f3bd-web-config\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:25:43.613179 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.613078    2565 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/25b26612-ef26-4352-adfd-7254bf55f3bd-config-out\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:25:43.613179 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.613086    2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/25b26612-ef26-4352-adfd-7254bf55f3bd-secret-alertmanager-main-tls\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:25:43.613179 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.613095    2565 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/25b26612-ef26-4352-adfd-7254bf55f3bd-tls-assets\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:25:43.613179 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.613103    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-msmxh\" (UniqueName: \"kubernetes.io/projected/25b26612-ef26-4352-adfd-7254bf55f3bd-kube-api-access-msmxh\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:25:43.734078 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.734041    2565 generic.go:356] "Generic (PLEG): container finished" podID="25b26612-ef26-4352-adfd-7254bf55f3bd" containerID="83eb0184066e6570977b123a44b4e1367e026f9d0a88a994364e77ff345254a0" exitCode=0
Jul 06 14:25:43.734078 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.734066    2565 generic.go:356] "Generic (PLEG): container finished" podID="25b26612-ef26-4352-adfd-7254bf55f3bd" containerID="d1c60c7d77cf85b7e838ea22eb608efa6658e3deef45551cd045df81a1140830" exitCode=0
Jul 06 14:25:43.734306 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.734116    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"25b26612-ef26-4352-adfd-7254bf55f3bd","Type":"ContainerDied","Data":"83eb0184066e6570977b123a44b4e1367e026f9d0a88a994364e77ff345254a0"}
Jul 06 14:25:43.734306 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.734181    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"25b26612-ef26-4352-adfd-7254bf55f3bd","Type":"ContainerDied","Data":"d1c60c7d77cf85b7e838ea22eb608efa6658e3deef45551cd045df81a1140830"}
Jul 06 14:25:43.734306 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.734127    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:25:43.734306 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.734210    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"25b26612-ef26-4352-adfd-7254bf55f3bd","Type":"ContainerDied","Data":"65b135e7ba1ca1316b99561f1d980fa51524efb422985240cefcfb513eab1ba2"}
Jul 06 14:25:43.734306 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.734242    2565 scope.go:117] "RemoveContainer" containerID="a18e6bfe25cfc8055d9a4be0996ae1464ec15f2e3aafda6bf0a5e0f6a3ad85a5"
Jul 06 14:25:43.744449 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.744425    2565 scope.go:117] "RemoveContainer" containerID="83eb0184066e6570977b123a44b4e1367e026f9d0a88a994364e77ff345254a0"
Jul 06 14:25:43.751406 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.751384    2565 scope.go:117] "RemoveContainer" containerID="b51e5e51d05f677b58661c15c0e056879a5362a7337e2f81dd2a10ee1f864429"
Jul 06 14:25:43.757879 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.757863    2565 scope.go:117] "RemoveContainer" containerID="d1c60c7d77cf85b7e838ea22eb608efa6658e3deef45551cd045df81a1140830"
Jul 06 14:25:43.760548 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.760124    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 14:25:43.764825 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.764780    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 14:25:43.766991 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.766964    2565 scope.go:117] "RemoveContainer" containerID="3fc61851ff7dc7ce1070d5b972a8dde48010cd02982178ed1293553b8a19ce37"
Jul 06 14:25:43.773684 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.773669    2565 scope.go:117] "RemoveContainer" containerID="aa429d0fce8121c9df438df75c626f6dea641975144c41add2cdf54164018545"
Jul 06 14:25:43.780316 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.780300    2565 scope.go:117] "RemoveContainer" containerID="380753ef768407fa4ab5acfa0053a1197f7ec903d567293953d2ad956880a8b4"
Jul 06 14:25:43.787171 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.787156    2565 scope.go:117] "RemoveContainer" containerID="a18e6bfe25cfc8055d9a4be0996ae1464ec15f2e3aafda6bf0a5e0f6a3ad85a5"
Jul 06 14:25:43.787455 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:25:43.787437    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a18e6bfe25cfc8055d9a4be0996ae1464ec15f2e3aafda6bf0a5e0f6a3ad85a5\": container with ID starting with a18e6bfe25cfc8055d9a4be0996ae1464ec15f2e3aafda6bf0a5e0f6a3ad85a5 not found: ID does not exist" containerID="a18e6bfe25cfc8055d9a4be0996ae1464ec15f2e3aafda6bf0a5e0f6a3ad85a5"
Jul 06 14:25:43.787513 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.787463    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a18e6bfe25cfc8055d9a4be0996ae1464ec15f2e3aafda6bf0a5e0f6a3ad85a5"} err="failed to get container status \"a18e6bfe25cfc8055d9a4be0996ae1464ec15f2e3aafda6bf0a5e0f6a3ad85a5\": rpc error: code = NotFound desc = could not find container \"a18e6bfe25cfc8055d9a4be0996ae1464ec15f2e3aafda6bf0a5e0f6a3ad85a5\": container with ID starting with a18e6bfe25cfc8055d9a4be0996ae1464ec15f2e3aafda6bf0a5e0f6a3ad85a5 not found: ID does not exist"
Jul 06 14:25:43.787513 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.787481    2565 scope.go:117] "RemoveContainer" containerID="83eb0184066e6570977b123a44b4e1367e026f9d0a88a994364e77ff345254a0"
Jul 06 14:25:43.787735 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:25:43.787717    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83eb0184066e6570977b123a44b4e1367e026f9d0a88a994364e77ff345254a0\": container with ID starting with 83eb0184066e6570977b123a44b4e1367e026f9d0a88a994364e77ff345254a0 not found: ID does not exist" containerID="83eb0184066e6570977b123a44b4e1367e026f9d0a88a994364e77ff345254a0"
Jul 06 14:25:43.787797 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.787745    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83eb0184066e6570977b123a44b4e1367e026f9d0a88a994364e77ff345254a0"} err="failed to get container status \"83eb0184066e6570977b123a44b4e1367e026f9d0a88a994364e77ff345254a0\": rpc error: code = NotFound desc = could not find container \"83eb0184066e6570977b123a44b4e1367e026f9d0a88a994364e77ff345254a0\": container with ID starting with 83eb0184066e6570977b123a44b4e1367e026f9d0a88a994364e77ff345254a0 not found: ID does not exist"
Jul 06 14:25:43.787797 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.787772    2565 scope.go:117] "RemoveContainer" containerID="b51e5e51d05f677b58661c15c0e056879a5362a7337e2f81dd2a10ee1f864429"
Jul 06 14:25:43.788012 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:25:43.787992    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b51e5e51d05f677b58661c15c0e056879a5362a7337e2f81dd2a10ee1f864429\": container with ID starting with b51e5e51d05f677b58661c15c0e056879a5362a7337e2f81dd2a10ee1f864429 not found: ID does not exist" containerID="b51e5e51d05f677b58661c15c0e056879a5362a7337e2f81dd2a10ee1f864429"
Jul 06 14:25:43.788089 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.788013    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b51e5e51d05f677b58661c15c0e056879a5362a7337e2f81dd2a10ee1f864429"} err="failed to get container status \"b51e5e51d05f677b58661c15c0e056879a5362a7337e2f81dd2a10ee1f864429\": rpc error: code = NotFound desc = could not find container \"b51e5e51d05f677b58661c15c0e056879a5362a7337e2f81dd2a10ee1f864429\": container with ID starting with b51e5e51d05f677b58661c15c0e056879a5362a7337e2f81dd2a10ee1f864429 not found: ID does not exist"
Jul 06 14:25:43.788089 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.788030    2565 scope.go:117] "RemoveContainer" containerID="d1c60c7d77cf85b7e838ea22eb608efa6658e3deef45551cd045df81a1140830"
Jul 06 14:25:43.788232 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:25:43.788214    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1c60c7d77cf85b7e838ea22eb608efa6658e3deef45551cd045df81a1140830\": container with ID starting with d1c60c7d77cf85b7e838ea22eb608efa6658e3deef45551cd045df81a1140830 not found: ID does not exist" containerID="d1c60c7d77cf85b7e838ea22eb608efa6658e3deef45551cd045df81a1140830"
Jul 06 14:25:43.788279 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.788243    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1c60c7d77cf85b7e838ea22eb608efa6658e3deef45551cd045df81a1140830"} err="failed to get container status \"d1c60c7d77cf85b7e838ea22eb608efa6658e3deef45551cd045df81a1140830\": rpc error: code = NotFound desc = could not find container \"d1c60c7d77cf85b7e838ea22eb608efa6658e3deef45551cd045df81a1140830\": container with ID starting with d1c60c7d77cf85b7e838ea22eb608efa6658e3deef45551cd045df81a1140830 not found: ID does not exist"
Jul 06 14:25:43.788279 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.788268    2565 scope.go:117] "RemoveContainer" containerID="3fc61851ff7dc7ce1070d5b972a8dde48010cd02982178ed1293553b8a19ce37"
Jul 06 14:25:43.788539 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:25:43.788520    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fc61851ff7dc7ce1070d5b972a8dde48010cd02982178ed1293553b8a19ce37\": container with ID starting with 3fc61851ff7dc7ce1070d5b972a8dde48010cd02982178ed1293553b8a19ce37 not found: ID does not exist" containerID="3fc61851ff7dc7ce1070d5b972a8dde48010cd02982178ed1293553b8a19ce37"
Jul 06 14:25:43.788593 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.788547    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fc61851ff7dc7ce1070d5b972a8dde48010cd02982178ed1293553b8a19ce37"} err="failed to get container status \"3fc61851ff7dc7ce1070d5b972a8dde48010cd02982178ed1293553b8a19ce37\": rpc error: code = NotFound desc = could not find container \"3fc61851ff7dc7ce1070d5b972a8dde48010cd02982178ed1293553b8a19ce37\": container with ID starting with 3fc61851ff7dc7ce1070d5b972a8dde48010cd02982178ed1293553b8a19ce37 not found: ID does not exist"
Jul 06 14:25:43.788593 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.788564    2565 scope.go:117] "RemoveContainer" containerID="aa429d0fce8121c9df438df75c626f6dea641975144c41add2cdf54164018545"
Jul 06 14:25:43.788806 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:25:43.788789    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa429d0fce8121c9df438df75c626f6dea641975144c41add2cdf54164018545\": container with ID starting with aa429d0fce8121c9df438df75c626f6dea641975144c41add2cdf54164018545 not found: ID does not exist" containerID="aa429d0fce8121c9df438df75c626f6dea641975144c41add2cdf54164018545"
Jul 06 14:25:43.788841 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.788811    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa429d0fce8121c9df438df75c626f6dea641975144c41add2cdf54164018545"} err="failed to get container status \"aa429d0fce8121c9df438df75c626f6dea641975144c41add2cdf54164018545\": rpc error: code = NotFound desc = could not find container \"aa429d0fce8121c9df438df75c626f6dea641975144c41add2cdf54164018545\": container with ID starting with aa429d0fce8121c9df438df75c626f6dea641975144c41add2cdf54164018545 not found: ID does not exist"
Jul 06 14:25:43.788841 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.788834    2565 scope.go:117] "RemoveContainer" containerID="380753ef768407fa4ab5acfa0053a1197f7ec903d567293953d2ad956880a8b4"
Jul 06 14:25:43.789059 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:25:43.789043    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"380753ef768407fa4ab5acfa0053a1197f7ec903d567293953d2ad956880a8b4\": container with ID starting with 380753ef768407fa4ab5acfa0053a1197f7ec903d567293953d2ad956880a8b4 not found: ID does not exist" containerID="380753ef768407fa4ab5acfa0053a1197f7ec903d567293953d2ad956880a8b4"
Jul 06 14:25:43.789098 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.789065    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"380753ef768407fa4ab5acfa0053a1197f7ec903d567293953d2ad956880a8b4"} err="failed to get container status \"380753ef768407fa4ab5acfa0053a1197f7ec903d567293953d2ad956880a8b4\": rpc error: code = NotFound desc = could not find container \"380753ef768407fa4ab5acfa0053a1197f7ec903d567293953d2ad956880a8b4\": container with ID starting with 380753ef768407fa4ab5acfa0053a1197f7ec903d567293953d2ad956880a8b4 not found: ID does not exist"
Jul 06 14:25:43.789098 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.789078    2565 scope.go:117] "RemoveContainer" containerID="a18e6bfe25cfc8055d9a4be0996ae1464ec15f2e3aafda6bf0a5e0f6a3ad85a5"
Jul 06 14:25:43.789298 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.789267    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a18e6bfe25cfc8055d9a4be0996ae1464ec15f2e3aafda6bf0a5e0f6a3ad85a5"} err="failed to get container status \"a18e6bfe25cfc8055d9a4be0996ae1464ec15f2e3aafda6bf0a5e0f6a3ad85a5\": rpc error: code = NotFound desc = could not find container \"a18e6bfe25cfc8055d9a4be0996ae1464ec15f2e3aafda6bf0a5e0f6a3ad85a5\": container with ID starting with a18e6bfe25cfc8055d9a4be0996ae1464ec15f2e3aafda6bf0a5e0f6a3ad85a5 not found: ID does not exist"
Jul 06 14:25:43.789362 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.789300    2565 scope.go:117] "RemoveContainer" containerID="83eb0184066e6570977b123a44b4e1367e026f9d0a88a994364e77ff345254a0"
Jul 06 14:25:43.789562 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.789546    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83eb0184066e6570977b123a44b4e1367e026f9d0a88a994364e77ff345254a0"} err="failed to get container status \"83eb0184066e6570977b123a44b4e1367e026f9d0a88a994364e77ff345254a0\": rpc error: code = NotFound desc = could not find container \"83eb0184066e6570977b123a44b4e1367e026f9d0a88a994364e77ff345254a0\": container with ID starting with 83eb0184066e6570977b123a44b4e1367e026f9d0a88a994364e77ff345254a0 not found: ID does not exist"
Jul 06 14:25:43.789627 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.789562    2565 scope.go:117] "RemoveContainer" containerID="b51e5e51d05f677b58661c15c0e056879a5362a7337e2f81dd2a10ee1f864429"
Jul 06 14:25:43.789790 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.789768    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b51e5e51d05f677b58661c15c0e056879a5362a7337e2f81dd2a10ee1f864429"} err="failed to get container status \"b51e5e51d05f677b58661c15c0e056879a5362a7337e2f81dd2a10ee1f864429\": rpc error: code = NotFound desc = could not find container \"b51e5e51d05f677b58661c15c0e056879a5362a7337e2f81dd2a10ee1f864429\": container with ID starting with b51e5e51d05f677b58661c15c0e056879a5362a7337e2f81dd2a10ee1f864429 not found: ID does not exist"
Jul 06 14:25:43.789870 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.789793    2565 scope.go:117] "RemoveContainer" containerID="d1c60c7d77cf85b7e838ea22eb608efa6658e3deef45551cd045df81a1140830"
Jul 06 14:25:43.790037 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.790019    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1c60c7d77cf85b7e838ea22eb608efa6658e3deef45551cd045df81a1140830"} err="failed to get container status \"d1c60c7d77cf85b7e838ea22eb608efa6658e3deef45551cd045df81a1140830\": rpc error: code = NotFound desc = could not find container \"d1c60c7d77cf85b7e838ea22eb608efa6658e3deef45551cd045df81a1140830\": container with ID starting with d1c60c7d77cf85b7e838ea22eb608efa6658e3deef45551cd045df81a1140830 not found: ID does not exist"
Jul 06 14:25:43.790095 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.790038    2565 scope.go:117] "RemoveContainer" containerID="3fc61851ff7dc7ce1070d5b972a8dde48010cd02982178ed1293553b8a19ce37"
Jul 06 14:25:43.790258 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.790240    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fc61851ff7dc7ce1070d5b972a8dde48010cd02982178ed1293553b8a19ce37"} err="failed to get container status \"3fc61851ff7dc7ce1070d5b972a8dde48010cd02982178ed1293553b8a19ce37\": rpc error: code = NotFound desc = could not find container \"3fc61851ff7dc7ce1070d5b972a8dde48010cd02982178ed1293553b8a19ce37\": container with ID starting with 3fc61851ff7dc7ce1070d5b972a8dde48010cd02982178ed1293553b8a19ce37 not found: ID does not exist"
Jul 06 14:25:43.790299 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.790260    2565 scope.go:117] "RemoveContainer" containerID="aa429d0fce8121c9df438df75c626f6dea641975144c41add2cdf54164018545"
Jul 06 14:25:43.790540 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.790519    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa429d0fce8121c9df438df75c626f6dea641975144c41add2cdf54164018545"} err="failed to get container status \"aa429d0fce8121c9df438df75c626f6dea641975144c41add2cdf54164018545\": rpc error: code = NotFound desc = could not find container \"aa429d0fce8121c9df438df75c626f6dea641975144c41add2cdf54164018545\": container with ID starting with aa429d0fce8121c9df438df75c626f6dea641975144c41add2cdf54164018545 not found: ID does not exist"
Jul 06 14:25:43.790540 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.790539    2565 scope.go:117] "RemoveContainer" containerID="380753ef768407fa4ab5acfa0053a1197f7ec903d567293953d2ad956880a8b4"
Jul 06 14:25:43.790735 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.790718    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"380753ef768407fa4ab5acfa0053a1197f7ec903d567293953d2ad956880a8b4"} err="failed to get container status \"380753ef768407fa4ab5acfa0053a1197f7ec903d567293953d2ad956880a8b4\": rpc error: code = NotFound desc = could not find container \"380753ef768407fa4ab5acfa0053a1197f7ec903d567293953d2ad956880a8b4\": container with ID starting with 380753ef768407fa4ab5acfa0053a1197f7ec903d567293953d2ad956880a8b4 not found: ID does not exist"
Jul 06 14:25:43.796151 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.796130    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 14:25:43.796459 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.796446    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25b26612-ef26-4352-adfd-7254bf55f3bd" containerName="kube-rbac-proxy-web"
Jul 06 14:25:43.796507 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.796461    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="25b26612-ef26-4352-adfd-7254bf55f3bd" containerName="kube-rbac-proxy-web"
Jul 06 14:25:43.796507 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.796471    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25b26612-ef26-4352-adfd-7254bf55f3bd" containerName="config-reloader"
Jul 06 14:25:43.796507 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.796481    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="25b26612-ef26-4352-adfd-7254bf55f3bd" containerName="config-reloader"
Jul 06 14:25:43.796507 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.796491    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25b26612-ef26-4352-adfd-7254bf55f3bd" containerName="kube-rbac-proxy"
Jul 06 14:25:43.796507 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.796496    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="25b26612-ef26-4352-adfd-7254bf55f3bd" containerName="kube-rbac-proxy"
Jul 06 14:25:43.796650 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.796509    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25b26612-ef26-4352-adfd-7254bf55f3bd" containerName="init-config-reloader"
Jul 06 14:25:43.796650 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.796515    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="25b26612-ef26-4352-adfd-7254bf55f3bd" containerName="init-config-reloader"
Jul 06 14:25:43.796650 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.796523    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a428a99-c8d9-4d2e-bc55-6dbfc9575bda" containerName="console"
Jul 06 14:25:43.796650 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.796528    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a428a99-c8d9-4d2e-bc55-6dbfc9575bda" containerName="console"
Jul 06 14:25:43.796650 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.796535    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07355b0b-792e-48d5-bc8b-3c52b0a9a155" containerName="console"
Jul 06 14:25:43.796650 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.796540    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="07355b0b-792e-48d5-bc8b-3c52b0a9a155" containerName="console"
Jul 06 14:25:43.796650 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.796548    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25b26612-ef26-4352-adfd-7254bf55f3bd" containerName="kube-rbac-proxy-metric"
Jul 06 14:25:43.796650 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.796557    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="25b26612-ef26-4352-adfd-7254bf55f3bd" containerName="kube-rbac-proxy-metric"
Jul 06 14:25:43.796650 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.796566    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25b26612-ef26-4352-adfd-7254bf55f3bd" containerName="prom-label-proxy"
Jul 06 14:25:43.796650 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.796571    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="25b26612-ef26-4352-adfd-7254bf55f3bd" containerName="prom-label-proxy"
Jul 06 14:25:43.796650 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.796578    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25b26612-ef26-4352-adfd-7254bf55f3bd" containerName="alertmanager"
Jul 06 14:25:43.796650 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.796583    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="25b26612-ef26-4352-adfd-7254bf55f3bd" containerName="alertmanager"
Jul 06 14:25:43.796650 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.796644    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="25b26612-ef26-4352-adfd-7254bf55f3bd" containerName="kube-rbac-proxy"
Jul 06 14:25:43.796650 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.796654    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a428a99-c8d9-4d2e-bc55-6dbfc9575bda" containerName="console"
Jul 06 14:25:43.797026 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.796660    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="25b26612-ef26-4352-adfd-7254bf55f3bd" containerName="kube-rbac-proxy-web"
Jul 06 14:25:43.797026 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.796666    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="25b26612-ef26-4352-adfd-7254bf55f3bd" containerName="config-reloader"
Jul 06 14:25:43.797026 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.796672    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="25b26612-ef26-4352-adfd-7254bf55f3bd" containerName="prom-label-proxy"
Jul 06 14:25:43.797026 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.796678    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="25b26612-ef26-4352-adfd-7254bf55f3bd" containerName="kube-rbac-proxy-metric"
Jul 06 14:25:43.797026 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.796684    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="25b26612-ef26-4352-adfd-7254bf55f3bd" containerName="alertmanager"
Jul 06 14:25:43.797026 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.796690    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="07355b0b-792e-48d5-bc8b-3c52b0a9a155" containerName="console"
Jul 06 14:25:43.800386 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.800322    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:25:43.802715 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.802479    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 06 14:25:43.802715 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.802492    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 06 14:25:43.802715 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.802531    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 06 14:25:43.802715 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.802540    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 06 14:25:43.802715 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.802590    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-q5ffs\""
Jul 06 14:25:43.802715 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.802642    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 06 14:25:43.802715 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.802678    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 06 14:25:43.803310 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.803215    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 06 14:25:43.805224 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.805065    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 06 14:25:43.808811 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.808772    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 06 14:25:43.816187 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.816165    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 14:25:43.915397 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.915363    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c70001e2-0301-4442-a512-157dbc801d78-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c70001e2-0301-4442-a512-157dbc801d78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:25:43.915576 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.915405    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c70001e2-0301-4442-a512-157dbc801d78-config-out\") pod \"alertmanager-main-0\" (UID: \"c70001e2-0301-4442-a512-157dbc801d78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:25:43.915576 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.915432    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c70001e2-0301-4442-a512-157dbc801d78-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c70001e2-0301-4442-a512-157dbc801d78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:25:43.915576 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.915450    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c70001e2-0301-4442-a512-157dbc801d78-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c70001e2-0301-4442-a512-157dbc801d78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:25:43.915576 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.915468    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c70001e2-0301-4442-a512-157dbc801d78-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c70001e2-0301-4442-a512-157dbc801d78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:25:43.915576 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.915575    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c70001e2-0301-4442-a512-157dbc801d78-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c70001e2-0301-4442-a512-157dbc801d78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:25:43.915769 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.915600    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c70001e2-0301-4442-a512-157dbc801d78-config-volume\") pod \"alertmanager-main-0\" (UID: \"c70001e2-0301-4442-a512-157dbc801d78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:25:43.915769 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.915617    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c70001e2-0301-4442-a512-157dbc801d78-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c70001e2-0301-4442-a512-157dbc801d78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:25:43.915769 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.915666    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c70001e2-0301-4442-a512-157dbc801d78-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c70001e2-0301-4442-a512-157dbc801d78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:25:43.915769 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.915707    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c70001e2-0301-4442-a512-157dbc801d78-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c70001e2-0301-4442-a512-157dbc801d78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:25:43.915769 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.915731    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c70001e2-0301-4442-a512-157dbc801d78-web-config\") pod \"alertmanager-main-0\" (UID: \"c70001e2-0301-4442-a512-157dbc801d78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:25:43.915769 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.915756    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c70001e2-0301-4442-a512-157dbc801d78-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c70001e2-0301-4442-a512-157dbc801d78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:25:43.915955 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.915784    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmzxz\" (UniqueName: \"kubernetes.io/projected/c70001e2-0301-4442-a512-157dbc801d78-kube-api-access-zmzxz\") pod \"alertmanager-main-0\" (UID: \"c70001e2-0301-4442-a512-157dbc801d78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:25:43.953230 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:43.953198    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25b26612-ef26-4352-adfd-7254bf55f3bd" path="/var/lib/kubelet/pods/25b26612-ef26-4352-adfd-7254bf55f3bd/volumes"
Jul 06 14:25:44.016854 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:44.016770    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c70001e2-0301-4442-a512-157dbc801d78-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c70001e2-0301-4442-a512-157dbc801d78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:25:44.016854 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:44.016810    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c70001e2-0301-4442-a512-157dbc801d78-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c70001e2-0301-4442-a512-157dbc801d78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:25:44.016854 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:44.016830    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c70001e2-0301-4442-a512-157dbc801d78-web-config\") pod \"alertmanager-main-0\" (UID: \"c70001e2-0301-4442-a512-157dbc801d78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:25:44.016854 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:44.016852    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c70001e2-0301-4442-a512-157dbc801d78-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c70001e2-0301-4442-a512-157dbc801d78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:25:44.017139 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:44.016877    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmzxz\" (UniqueName: \"kubernetes.io/projected/c70001e2-0301-4442-a512-157dbc801d78-kube-api-access-zmzxz\") pod \"alertmanager-main-0\" (UID: \"c70001e2-0301-4442-a512-157dbc801d78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:25:44.017139 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:44.016921    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c70001e2-0301-4442-a512-157dbc801d78-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c70001e2-0301-4442-a512-157dbc801d78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:25:44.017139 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:44.016950    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c70001e2-0301-4442-a512-157dbc801d78-config-out\") pod \"alertmanager-main-0\" (UID: \"c70001e2-0301-4442-a512-157dbc801d78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:25:44.017267 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:44.017150    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c70001e2-0301-4442-a512-157dbc801d78-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c70001e2-0301-4442-a512-157dbc801d78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:25:44.017267 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:44.017194    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c70001e2-0301-4442-a512-157dbc801d78-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c70001e2-0301-4442-a512-157dbc801d78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:25:44.017267 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:44.017219    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c70001e2-0301-4442-a512-157dbc801d78-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c70001e2-0301-4442-a512-157dbc801d78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:25:44.017453 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:44.017272    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c70001e2-0301-4442-a512-157dbc801d78-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c70001e2-0301-4442-a512-157dbc801d78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:25:44.017453 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:44.017315    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c70001e2-0301-4442-a512-157dbc801d78-config-volume\") pod \"alertmanager-main-0\" (UID: \"c70001e2-0301-4442-a512-157dbc801d78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:25:44.017453 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:44.017369    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c70001e2-0301-4442-a512-157dbc801d78-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c70001e2-0301-4442-a512-157dbc801d78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:25:44.020204 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:44.019992    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c70001e2-0301-4442-a512-157dbc801d78-web-config\") pod \"alertmanager-main-0\" (UID: \"c70001e2-0301-4442-a512-157dbc801d78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:25:44.020204 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:44.020031    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c70001e2-0301-4442-a512-157dbc801d78-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c70001e2-0301-4442-a512-157dbc801d78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:25:44.020204 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:44.020115    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c70001e2-0301-4442-a512-157dbc801d78-config-out\") pod \"alertmanager-main-0\" (UID: \"c70001e2-0301-4442-a512-157dbc801d78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:25:44.020204 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:44.020130    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c70001e2-0301-4442-a512-157dbc801d78-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c70001e2-0301-4442-a512-157dbc801d78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:25:44.020204 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:44.019992    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c70001e2-0301-4442-a512-157dbc801d78-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c70001e2-0301-4442-a512-157dbc801d78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:25:44.020204 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:44.020171    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c70001e2-0301-4442-a512-157dbc801d78-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c70001e2-0301-4442-a512-157dbc801d78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:25:44.020500 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:44.020223    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c70001e2-0301-4442-a512-157dbc801d78-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c70001e2-0301-4442-a512-157dbc801d78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:25:44.020500 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:44.020246    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c70001e2-0301-4442-a512-157dbc801d78-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c70001e2-0301-4442-a512-157dbc801d78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:25:44.020500 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:44.020388    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c70001e2-0301-4442-a512-157dbc801d78-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c70001e2-0301-4442-a512-157dbc801d78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:25:44.020692 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:44.020669    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c70001e2-0301-4442-a512-157dbc801d78-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c70001e2-0301-4442-a512-157dbc801d78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:25:44.020750 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:44.020735    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c70001e2-0301-4442-a512-157dbc801d78-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c70001e2-0301-4442-a512-157dbc801d78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:25:44.021833 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:44.021811    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c70001e2-0301-4442-a512-157dbc801d78-config-volume\") pod \"alertmanager-main-0\" (UID: \"c70001e2-0301-4442-a512-157dbc801d78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:25:44.023777 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:44.023758    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmzxz\" (UniqueName: \"kubernetes.io/projected/c70001e2-0301-4442-a512-157dbc801d78-kube-api-access-zmzxz\") pod \"alertmanager-main-0\" (UID: \"c70001e2-0301-4442-a512-157dbc801d78\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:25:44.110870 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:44.110835    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:25:44.246544 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:44.246498    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 14:25:44.250324 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:25:44.250293    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc70001e2_0301_4442_a512_157dbc801d78.slice/crio-67bc42556bf84b685fe72a7843159b42d3fd0b5ebebb470f46ec594023d06e06 WatchSource:0}: Error finding container 67bc42556bf84b685fe72a7843159b42d3fd0b5ebebb470f46ec594023d06e06: Status 404 returned error can't find the container with id 67bc42556bf84b685fe72a7843159b42d3fd0b5ebebb470f46ec594023d06e06
Jul 06 14:25:44.739608 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:44.739572    2565 generic.go:356] "Generic (PLEG): container finished" podID="c70001e2-0301-4442-a512-157dbc801d78" containerID="141aa6478eb5ba02788ffba6906cc9bb1f849bbf47d9ebc3fe25f35778cd446a" exitCode=0
Jul 06 14:25:44.740039 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:44.739662    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c70001e2-0301-4442-a512-157dbc801d78","Type":"ContainerDied","Data":"141aa6478eb5ba02788ffba6906cc9bb1f849bbf47d9ebc3fe25f35778cd446a"}
Jul 06 14:25:44.740039 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:44.739729    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c70001e2-0301-4442-a512-157dbc801d78","Type":"ContainerStarted","Data":"67bc42556bf84b685fe72a7843159b42d3fd0b5ebebb470f46ec594023d06e06"}
Jul 06 14:25:45.747553 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:45.747518    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c70001e2-0301-4442-a512-157dbc801d78","Type":"ContainerStarted","Data":"13ec73b8e0c7bbb21ffed393da784b36bdc997022da50b0c2184f63d862952e3"}
Jul 06 14:25:45.747896 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:45.747608    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c70001e2-0301-4442-a512-157dbc801d78","Type":"ContainerStarted","Data":"2a8e0e7f98c15cbdd1a819dcc10b5d8563f8114d2982cc7ac49a1092bee16cfa"}
Jul 06 14:25:45.747896 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:45.747636    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c70001e2-0301-4442-a512-157dbc801d78","Type":"ContainerStarted","Data":"9bc6ca08c799c62260a0310fd57bf836ce00b2c9e695633a0013be89903a7a89"}
Jul 06 14:25:45.747896 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:45.747659    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c70001e2-0301-4442-a512-157dbc801d78","Type":"ContainerStarted","Data":"beb61236ae63fadb3b169bde4408f68e6f02ff61cee41ce0c226d39c30694238"}
Jul 06 14:25:45.747896 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:45.747683    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c70001e2-0301-4442-a512-157dbc801d78","Type":"ContainerStarted","Data":"c811afd5a9769e5ad9e454f50aa10102d17aaab79bdd4fb251077825a1074641"}
Jul 06 14:25:45.747896 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:45.747705    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c70001e2-0301-4442-a512-157dbc801d78","Type":"ContainerStarted","Data":"eca022b569047b33439d3dbfe0192fca572f85dc06df10ebb70a606e91154e83"}
Jul 06 14:25:45.796134 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:45.796085    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.780545924 podStartE2EDuration="2.796068361s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.522437ms" isStatefulPod=false podCreationTimestamp="2026-07-06 14:25:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:25:45.794776264 +0000 UTC m=+148.973425320" watchObservedRunningTime="2026-07-06 14:25:45.796068361 +0000 UTC m=+148.974717406"
Jul 06 14:25:46.171633 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:46.170667    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-56674667cd-4rr65"]
Jul 06 14:25:46.176640 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:46.176605    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-56674667cd-4rr65"
Jul 06 14:25:46.178787 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:46.178758    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 06 14:25:46.178935 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:46.178770    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 06 14:25:46.179147 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:46.179116    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 06 14:25:46.179429 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:46.179411    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 06 14:25:46.179574 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:46.179558    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 06 14:25:46.179751 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:46.179631    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-pfr2t\""
Jul 06 14:25:46.185697 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:46.185674    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 06 14:25:46.191387 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:46.191361    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-56674667cd-4rr65"]
Jul 06 14:25:46.339017 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:46.338982    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99mjz\" (UniqueName: \"kubernetes.io/projected/a92c4838-38b6-4666-a40b-f7ac40aa1d0a-kube-api-access-99mjz\") pod \"telemeter-client-56674667cd-4rr65\" (UID: \"a92c4838-38b6-4666-a40b-f7ac40aa1d0a\") " pod="openshift-monitoring/telemeter-client-56674667cd-4rr65"
Jul 06 14:25:46.339017 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:46.339020    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a92c4838-38b6-4666-a40b-f7ac40aa1d0a-serving-certs-ca-bundle\") pod \"telemeter-client-56674667cd-4rr65\" (UID: \"a92c4838-38b6-4666-a40b-f7ac40aa1d0a\") " pod="openshift-monitoring/telemeter-client-56674667cd-4rr65"
Jul 06 14:25:46.339216 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:46.339046    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a92c4838-38b6-4666-a40b-f7ac40aa1d0a-metrics-client-ca\") pod \"telemeter-client-56674667cd-4rr65\" (UID: \"a92c4838-38b6-4666-a40b-f7ac40aa1d0a\") " pod="openshift-monitoring/telemeter-client-56674667cd-4rr65"
Jul 06 14:25:46.339216 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:46.339116    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a92c4838-38b6-4666-a40b-f7ac40aa1d0a-telemeter-client-tls\") pod \"telemeter-client-56674667cd-4rr65\" (UID: \"a92c4838-38b6-4666-a40b-f7ac40aa1d0a\") " pod="openshift-monitoring/telemeter-client-56674667cd-4rr65"
Jul 06 14:25:46.339216 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:46.339180    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a92c4838-38b6-4666-a40b-f7ac40aa1d0a-secret-telemeter-client\") pod \"telemeter-client-56674667cd-4rr65\" (UID: \"a92c4838-38b6-4666-a40b-f7ac40aa1d0a\") " pod="openshift-monitoring/telemeter-client-56674667cd-4rr65"
Jul 06 14:25:46.339309 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:46.339223    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a92c4838-38b6-4666-a40b-f7ac40aa1d0a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-56674667cd-4rr65\" (UID: \"a92c4838-38b6-4666-a40b-f7ac40aa1d0a\") " pod="openshift-monitoring/telemeter-client-56674667cd-4rr65"
Jul 06 14:25:46.339309 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:46.339243    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a92c4838-38b6-4666-a40b-f7ac40aa1d0a-federate-client-tls\") pod \"telemeter-client-56674667cd-4rr65\" (UID: \"a92c4838-38b6-4666-a40b-f7ac40aa1d0a\") " pod="openshift-monitoring/telemeter-client-56674667cd-4rr65"
Jul 06 14:25:46.339309 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:46.339259    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a92c4838-38b6-4666-a40b-f7ac40aa1d0a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-56674667cd-4rr65\" (UID: \"a92c4838-38b6-4666-a40b-f7ac40aa1d0a\") " pod="openshift-monitoring/telemeter-client-56674667cd-4rr65"
Jul 06 14:25:46.440069 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:46.439979    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99mjz\" (UniqueName: \"kubernetes.io/projected/a92c4838-38b6-4666-a40b-f7ac40aa1d0a-kube-api-access-99mjz\") pod \"telemeter-client-56674667cd-4rr65\" (UID: \"a92c4838-38b6-4666-a40b-f7ac40aa1d0a\") " pod="openshift-monitoring/telemeter-client-56674667cd-4rr65"
Jul 06 14:25:46.440069 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:46.440020    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a92c4838-38b6-4666-a40b-f7ac40aa1d0a-serving-certs-ca-bundle\") pod \"telemeter-client-56674667cd-4rr65\" (UID: \"a92c4838-38b6-4666-a40b-f7ac40aa1d0a\") " pod="openshift-monitoring/telemeter-client-56674667cd-4rr65"
Jul 06 14:25:46.440069 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:46.440045    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a92c4838-38b6-4666-a40b-f7ac40aa1d0a-metrics-client-ca\") pod \"telemeter-client-56674667cd-4rr65\" (UID: \"a92c4838-38b6-4666-a40b-f7ac40aa1d0a\") " pod="openshift-monitoring/telemeter-client-56674667cd-4rr65"
Jul 06 14:25:46.440369 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:46.440071    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a92c4838-38b6-4666-a40b-f7ac40aa1d0a-telemeter-client-tls\") pod \"telemeter-client-56674667cd-4rr65\" (UID: \"a92c4838-38b6-4666-a40b-f7ac40aa1d0a\") " pod="openshift-monitoring/telemeter-client-56674667cd-4rr65"
Jul 06 14:25:46.440369 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:46.440114    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a92c4838-38b6-4666-a40b-f7ac40aa1d0a-secret-telemeter-client\") pod \"telemeter-client-56674667cd-4rr65\" (UID: \"a92c4838-38b6-4666-a40b-f7ac40aa1d0a\") " pod="openshift-monitoring/telemeter-client-56674667cd-4rr65"
Jul 06 14:25:46.440369 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:46.440168    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a92c4838-38b6-4666-a40b-f7ac40aa1d0a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-56674667cd-4rr65\" (UID: \"a92c4838-38b6-4666-a40b-f7ac40aa1d0a\") " pod="openshift-monitoring/telemeter-client-56674667cd-4rr65"
Jul 06 14:25:46.440548 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:46.440369    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a92c4838-38b6-4666-a40b-f7ac40aa1d0a-federate-client-tls\") pod \"telemeter-client-56674667cd-4rr65\" (UID: \"a92c4838-38b6-4666-a40b-f7ac40aa1d0a\") " pod="openshift-monitoring/telemeter-client-56674667cd-4rr65"
Jul 06 14:25:46.440548 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:46.440412    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a92c4838-38b6-4666-a40b-f7ac40aa1d0a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-56674667cd-4rr65\" (UID: \"a92c4838-38b6-4666-a40b-f7ac40aa1d0a\") " pod="openshift-monitoring/telemeter-client-56674667cd-4rr65"
Jul 06 14:25:46.440907 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:46.440878    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a92c4838-38b6-4666-a40b-f7ac40aa1d0a-metrics-client-ca\") pod \"telemeter-client-56674667cd-4rr65\" (UID: \"a92c4838-38b6-4666-a40b-f7ac40aa1d0a\") " pod="openshift-monitoring/telemeter-client-56674667cd-4rr65"
Jul 06 14:25:46.441061 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:46.440893    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a92c4838-38b6-4666-a40b-f7ac40aa1d0a-serving-certs-ca-bundle\") pod \"telemeter-client-56674667cd-4rr65\" (UID: \"a92c4838-38b6-4666-a40b-f7ac40aa1d0a\") " pod="openshift-monitoring/telemeter-client-56674667cd-4rr65"
Jul 06 14:25:46.441260 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:46.441235    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a92c4838-38b6-4666-a40b-f7ac40aa1d0a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-56674667cd-4rr65\" (UID: \"a92c4838-38b6-4666-a40b-f7ac40aa1d0a\") " pod="openshift-monitoring/telemeter-client-56674667cd-4rr65"
Jul 06 14:25:46.442675 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:46.442652    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a92c4838-38b6-4666-a40b-f7ac40aa1d0a-telemeter-client-tls\") pod \"telemeter-client-56674667cd-4rr65\" (UID: \"a92c4838-38b6-4666-a40b-f7ac40aa1d0a\") " pod="openshift-monitoring/telemeter-client-56674667cd-4rr65"
Jul 06 14:25:46.442755 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:46.442711    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a92c4838-38b6-4666-a40b-f7ac40aa1d0a-secret-telemeter-client\") pod \"telemeter-client-56674667cd-4rr65\" (UID: \"a92c4838-38b6-4666-a40b-f7ac40aa1d0a\") " pod="openshift-monitoring/telemeter-client-56674667cd-4rr65"
Jul 06 14:25:46.443033 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:46.443015    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a92c4838-38b6-4666-a40b-f7ac40aa1d0a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-56674667cd-4rr65\" (UID: \"a92c4838-38b6-4666-a40b-f7ac40aa1d0a\") " pod="openshift-monitoring/telemeter-client-56674667cd-4rr65"
Jul 06 14:25:46.443127 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:46.443111    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a92c4838-38b6-4666-a40b-f7ac40aa1d0a-federate-client-tls\") pod \"telemeter-client-56674667cd-4rr65\" (UID: \"a92c4838-38b6-4666-a40b-f7ac40aa1d0a\") " pod="openshift-monitoring/telemeter-client-56674667cd-4rr65"
Jul 06 14:25:46.446874 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:46.446854    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99mjz\" (UniqueName: \"kubernetes.io/projected/a92c4838-38b6-4666-a40b-f7ac40aa1d0a-kube-api-access-99mjz\") pod \"telemeter-client-56674667cd-4rr65\" (UID: \"a92c4838-38b6-4666-a40b-f7ac40aa1d0a\") " pod="openshift-monitoring/telemeter-client-56674667cd-4rr65"
Jul 06 14:25:46.488550 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:46.488519    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-56674667cd-4rr65"
Jul 06 14:25:46.496225 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:46.496194    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 14:25:46.496678 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:46.496647    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a01567d7-91cc-47a4-bcad-610a30e8012a" containerName="prometheus" containerID="cri-o://1f595de670daa90000c566ac0fcad776cab7a1ec3979ba6b447c172651dc4c2b" gracePeriod=600
Jul 06 14:25:46.496883 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:46.496647    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a01567d7-91cc-47a4-bcad-610a30e8012a" containerName="config-reloader" containerID="cri-o://0e836114cf68371efcfb0fb6b7d581580d5d3d87c4f317e66a974b3d579b53b1" gracePeriod=600
Jul 06 14:25:46.496978 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:46.496632    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a01567d7-91cc-47a4-bcad-610a30e8012a" containerName="kube-rbac-proxy-web" containerID="cri-o://48703077cd2ce165bc3ffc59f865c172cd363db64439409d0203514b32cccded" gracePeriod=600
Jul 06 14:25:46.497026 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:46.496675    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a01567d7-91cc-47a4-bcad-610a30e8012a" containerName="kube-rbac-proxy" containerID="cri-o://291e5d4ee3e4246a15f01791c3bc3c4b6afe5d749dea8357c49997157822af32" gracePeriod=600
Jul 06 14:25:46.497078 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:46.496689    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a01567d7-91cc-47a4-bcad-610a30e8012a" containerName="kube-rbac-proxy-thanos" containerID="cri-o://56577f8e76b6ec0251837797d3fbd2a489a24fa2140d725337b89c098f76cb96" gracePeriod=600
Jul 06 14:25:46.497134 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:46.496699    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a01567d7-91cc-47a4-bcad-610a30e8012a" containerName="thanos-sidecar" containerID="cri-o://630dbe6e99ff12cb98157a74ea4122c943e4ed09c7e2b159be3b36f017b23f61" gracePeriod=600
Jul 06 14:25:46.664372 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:46.664321    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-56674667cd-4rr65"]
Jul 06 14:25:46.668205 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:25:46.668176    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda92c4838_38b6_4666_a40b_f7ac40aa1d0a.slice/crio-f7b20b2a57877b2e04b56b683730bd86d2170462194402ac9126217a029b0abd WatchSource:0}: Error finding container f7b20b2a57877b2e04b56b683730bd86d2170462194402ac9126217a029b0abd: Status 404 returned error can't find the container with id f7b20b2a57877b2e04b56b683730bd86d2170462194402ac9126217a029b0abd
Jul 06 14:25:46.756549 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:46.756460    2565 generic.go:356] "Generic (PLEG): container finished" podID="a01567d7-91cc-47a4-bcad-610a30e8012a" containerID="56577f8e76b6ec0251837797d3fbd2a489a24fa2140d725337b89c098f76cb96" exitCode=0
Jul 06 14:25:46.756549 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:46.756495    2565 generic.go:356] "Generic (PLEG): container finished" podID="a01567d7-91cc-47a4-bcad-610a30e8012a" containerID="291e5d4ee3e4246a15f01791c3bc3c4b6afe5d749dea8357c49997157822af32" exitCode=0
Jul 06 14:25:46.756549 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:46.756504    2565 generic.go:356] "Generic (PLEG): container finished" podID="a01567d7-91cc-47a4-bcad-610a30e8012a" containerID="630dbe6e99ff12cb98157a74ea4122c943e4ed09c7e2b159be3b36f017b23f61" exitCode=0
Jul 06 14:25:46.756549 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:46.756513    2565 generic.go:356] "Generic (PLEG): container finished" podID="a01567d7-91cc-47a4-bcad-610a30e8012a" containerID="0e836114cf68371efcfb0fb6b7d581580d5d3d87c4f317e66a974b3d579b53b1" exitCode=0
Jul 06 14:25:46.756549 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:46.756523    2565 generic.go:356] "Generic (PLEG): container finished" podID="a01567d7-91cc-47a4-bcad-610a30e8012a" containerID="1f595de670daa90000c566ac0fcad776cab7a1ec3979ba6b447c172651dc4c2b" exitCode=0
Jul 06 14:25:46.756549 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:46.756535    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a01567d7-91cc-47a4-bcad-610a30e8012a","Type":"ContainerDied","Data":"56577f8e76b6ec0251837797d3fbd2a489a24fa2140d725337b89c098f76cb96"}
Jul 06 14:25:46.757184 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:46.756618    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a01567d7-91cc-47a4-bcad-610a30e8012a","Type":"ContainerDied","Data":"291e5d4ee3e4246a15f01791c3bc3c4b6afe5d749dea8357c49997157822af32"}
Jul 06 14:25:46.757184 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:46.756659    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a01567d7-91cc-47a4-bcad-610a30e8012a","Type":"ContainerDied","Data":"630dbe6e99ff12cb98157a74ea4122c943e4ed09c7e2b159be3b36f017b23f61"}
Jul 06 14:25:46.757184 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:46.756714    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a01567d7-91cc-47a4-bcad-610a30e8012a","Type":"ContainerDied","Data":"0e836114cf68371efcfb0fb6b7d581580d5d3d87c4f317e66a974b3d579b53b1"}
Jul 06 14:25:46.757184 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:46.756758    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a01567d7-91cc-47a4-bcad-610a30e8012a","Type":"ContainerDied","Data":"1f595de670daa90000c566ac0fcad776cab7a1ec3979ba6b447c172651dc4c2b"}
Jul 06 14:25:46.757952 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:46.757927    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-56674667cd-4rr65" event={"ID":"a92c4838-38b6-4666-a40b-f7ac40aa1d0a","Type":"ContainerStarted","Data":"f7b20b2a57877b2e04b56b683730bd86d2170462194402ac9126217a029b0abd"}
Jul 06 14:25:47.756057 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.756031    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:47.766659 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.766633    2565 generic.go:356] "Generic (PLEG): container finished" podID="a01567d7-91cc-47a4-bcad-610a30e8012a" containerID="48703077cd2ce165bc3ffc59f865c172cd363db64439409d0203514b32cccded" exitCode=0
Jul 06 14:25:47.767066 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.766699    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a01567d7-91cc-47a4-bcad-610a30e8012a","Type":"ContainerDied","Data":"48703077cd2ce165bc3ffc59f865c172cd363db64439409d0203514b32cccded"}
Jul 06 14:25:47.767066 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.766729    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:47.767066 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.766815    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a01567d7-91cc-47a4-bcad-610a30e8012a","Type":"ContainerDied","Data":"27fcbe763bae249756aeafa117b9b224c706a27dd8de671c1251004572c121fc"}
Jul 06 14:25:47.767066 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.766872    2565 scope.go:117] "RemoveContainer" containerID="56577f8e76b6ec0251837797d3fbd2a489a24fa2140d725337b89c098f76cb96"
Jul 06 14:25:47.775197 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.775180    2565 scope.go:117] "RemoveContainer" containerID="291e5d4ee3e4246a15f01791c3bc3c4b6afe5d749dea8357c49997157822af32"
Jul 06 14:25:47.783603 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.783584    2565 scope.go:117] "RemoveContainer" containerID="48703077cd2ce165bc3ffc59f865c172cd363db64439409d0203514b32cccded"
Jul 06 14:25:47.792909 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.792887    2565 scope.go:117] "RemoveContainer" containerID="630dbe6e99ff12cb98157a74ea4122c943e4ed09c7e2b159be3b36f017b23f61"
Jul 06 14:25:47.805053 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.804999    2565 scope.go:117] "RemoveContainer" containerID="0e836114cf68371efcfb0fb6b7d581580d5d3d87c4f317e66a974b3d579b53b1"
Jul 06 14:25:47.815620 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.815596    2565 scope.go:117] "RemoveContainer" containerID="1f595de670daa90000c566ac0fcad776cab7a1ec3979ba6b447c172651dc4c2b"
Jul 06 14:25:47.823675 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.823652    2565 scope.go:117] "RemoveContainer" containerID="d2df6f8febdc0007b8bfb3d295b7af691a529bc6175dbf85fcb257a93a737684"
Jul 06 14:25:47.831004 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.830977    2565 scope.go:117] "RemoveContainer" containerID="56577f8e76b6ec0251837797d3fbd2a489a24fa2140d725337b89c098f76cb96"
Jul 06 14:25:47.831317 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:25:47.831288    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56577f8e76b6ec0251837797d3fbd2a489a24fa2140d725337b89c098f76cb96\": container with ID starting with 56577f8e76b6ec0251837797d3fbd2a489a24fa2140d725337b89c098f76cb96 not found: ID does not exist" containerID="56577f8e76b6ec0251837797d3fbd2a489a24fa2140d725337b89c098f76cb96"
Jul 06 14:25:47.831423 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.831326    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56577f8e76b6ec0251837797d3fbd2a489a24fa2140d725337b89c098f76cb96"} err="failed to get container status \"56577f8e76b6ec0251837797d3fbd2a489a24fa2140d725337b89c098f76cb96\": rpc error: code = NotFound desc = could not find container \"56577f8e76b6ec0251837797d3fbd2a489a24fa2140d725337b89c098f76cb96\": container with ID starting with 56577f8e76b6ec0251837797d3fbd2a489a24fa2140d725337b89c098f76cb96 not found: ID does not exist"
Jul 06 14:25:47.831423 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.831364    2565 scope.go:117] "RemoveContainer" containerID="291e5d4ee3e4246a15f01791c3bc3c4b6afe5d749dea8357c49997157822af32"
Jul 06 14:25:47.831657 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:25:47.831639    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"291e5d4ee3e4246a15f01791c3bc3c4b6afe5d749dea8357c49997157822af32\": container with ID starting with 291e5d4ee3e4246a15f01791c3bc3c4b6afe5d749dea8357c49997157822af32 not found: ID does not exist" containerID="291e5d4ee3e4246a15f01791c3bc3c4b6afe5d749dea8357c49997157822af32"
Jul 06 14:25:47.831717 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.831665    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"291e5d4ee3e4246a15f01791c3bc3c4b6afe5d749dea8357c49997157822af32"} err="failed to get container status \"291e5d4ee3e4246a15f01791c3bc3c4b6afe5d749dea8357c49997157822af32\": rpc error: code = NotFound desc = could not find container \"291e5d4ee3e4246a15f01791c3bc3c4b6afe5d749dea8357c49997157822af32\": container with ID starting with 291e5d4ee3e4246a15f01791c3bc3c4b6afe5d749dea8357c49997157822af32 not found: ID does not exist"
Jul 06 14:25:47.831717 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.831683    2565 scope.go:117] "RemoveContainer" containerID="48703077cd2ce165bc3ffc59f865c172cd363db64439409d0203514b32cccded"
Jul 06 14:25:47.831923 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:25:47.831907    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48703077cd2ce165bc3ffc59f865c172cd363db64439409d0203514b32cccded\": container with ID starting with 48703077cd2ce165bc3ffc59f865c172cd363db64439409d0203514b32cccded not found: ID does not exist" containerID="48703077cd2ce165bc3ffc59f865c172cd363db64439409d0203514b32cccded"
Jul 06 14:25:47.831975 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.831926    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48703077cd2ce165bc3ffc59f865c172cd363db64439409d0203514b32cccded"} err="failed to get container status \"48703077cd2ce165bc3ffc59f865c172cd363db64439409d0203514b32cccded\": rpc error: code = NotFound desc = could not find container \"48703077cd2ce165bc3ffc59f865c172cd363db64439409d0203514b32cccded\": container with ID starting with 48703077cd2ce165bc3ffc59f865c172cd363db64439409d0203514b32cccded not found: ID does not exist"
Jul 06 14:25:47.831975 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.831939    2565 scope.go:117] "RemoveContainer" containerID="630dbe6e99ff12cb98157a74ea4122c943e4ed09c7e2b159be3b36f017b23f61"
Jul 06 14:25:47.832161 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:25:47.832148    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"630dbe6e99ff12cb98157a74ea4122c943e4ed09c7e2b159be3b36f017b23f61\": container with ID starting with 630dbe6e99ff12cb98157a74ea4122c943e4ed09c7e2b159be3b36f017b23f61 not found: ID does not exist" containerID="630dbe6e99ff12cb98157a74ea4122c943e4ed09c7e2b159be3b36f017b23f61"
Jul 06 14:25:47.832221 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.832165    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"630dbe6e99ff12cb98157a74ea4122c943e4ed09c7e2b159be3b36f017b23f61"} err="failed to get container status \"630dbe6e99ff12cb98157a74ea4122c943e4ed09c7e2b159be3b36f017b23f61\": rpc error: code = NotFound desc = could not find container \"630dbe6e99ff12cb98157a74ea4122c943e4ed09c7e2b159be3b36f017b23f61\": container with ID starting with 630dbe6e99ff12cb98157a74ea4122c943e4ed09c7e2b159be3b36f017b23f61 not found: ID does not exist"
Jul 06 14:25:47.832221 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.832176    2565 scope.go:117] "RemoveContainer" containerID="0e836114cf68371efcfb0fb6b7d581580d5d3d87c4f317e66a974b3d579b53b1"
Jul 06 14:25:47.832485 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:25:47.832463    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e836114cf68371efcfb0fb6b7d581580d5d3d87c4f317e66a974b3d579b53b1\": container with ID starting with 0e836114cf68371efcfb0fb6b7d581580d5d3d87c4f317e66a974b3d579b53b1 not found: ID does not exist" containerID="0e836114cf68371efcfb0fb6b7d581580d5d3d87c4f317e66a974b3d579b53b1"
Jul 06 14:25:47.832562 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.832492    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e836114cf68371efcfb0fb6b7d581580d5d3d87c4f317e66a974b3d579b53b1"} err="failed to get container status \"0e836114cf68371efcfb0fb6b7d581580d5d3d87c4f317e66a974b3d579b53b1\": rpc error: code = NotFound desc = could not find container \"0e836114cf68371efcfb0fb6b7d581580d5d3d87c4f317e66a974b3d579b53b1\": container with ID starting with 0e836114cf68371efcfb0fb6b7d581580d5d3d87c4f317e66a974b3d579b53b1 not found: ID does not exist"
Jul 06 14:25:47.832562 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.832511    2565 scope.go:117] "RemoveContainer" containerID="1f595de670daa90000c566ac0fcad776cab7a1ec3979ba6b447c172651dc4c2b"
Jul 06 14:25:47.832783 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:25:47.832760    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f595de670daa90000c566ac0fcad776cab7a1ec3979ba6b447c172651dc4c2b\": container with ID starting with 1f595de670daa90000c566ac0fcad776cab7a1ec3979ba6b447c172651dc4c2b not found: ID does not exist" containerID="1f595de670daa90000c566ac0fcad776cab7a1ec3979ba6b447c172651dc4c2b"
Jul 06 14:25:47.832836 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.832790    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f595de670daa90000c566ac0fcad776cab7a1ec3979ba6b447c172651dc4c2b"} err="failed to get container status \"1f595de670daa90000c566ac0fcad776cab7a1ec3979ba6b447c172651dc4c2b\": rpc error: code = NotFound desc = could not find container \"1f595de670daa90000c566ac0fcad776cab7a1ec3979ba6b447c172651dc4c2b\": container with ID starting with 1f595de670daa90000c566ac0fcad776cab7a1ec3979ba6b447c172651dc4c2b not found: ID does not exist"
Jul 06 14:25:47.832836 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.832811    2565 scope.go:117] "RemoveContainer" containerID="d2df6f8febdc0007b8bfb3d295b7af691a529bc6175dbf85fcb257a93a737684"
Jul 06 14:25:47.833063 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:25:47.833046    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2df6f8febdc0007b8bfb3d295b7af691a529bc6175dbf85fcb257a93a737684\": container with ID starting with d2df6f8febdc0007b8bfb3d295b7af691a529bc6175dbf85fcb257a93a737684 not found: ID does not exist" containerID="d2df6f8febdc0007b8bfb3d295b7af691a529bc6175dbf85fcb257a93a737684"
Jul 06 14:25:47.833118 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.833068    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2df6f8febdc0007b8bfb3d295b7af691a529bc6175dbf85fcb257a93a737684"} err="failed to get container status \"d2df6f8febdc0007b8bfb3d295b7af691a529bc6175dbf85fcb257a93a737684\": rpc error: code = NotFound desc = could not find container \"d2df6f8febdc0007b8bfb3d295b7af691a529bc6175dbf85fcb257a93a737684\": container with ID starting with d2df6f8febdc0007b8bfb3d295b7af691a529bc6175dbf85fcb257a93a737684 not found: ID does not exist"
Jul 06 14:25:47.853841 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.853815    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a01567d7-91cc-47a4-bcad-610a30e8012a-secret-metrics-client-certs\") pod \"a01567d7-91cc-47a4-bcad-610a30e8012a\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") "
Jul 06 14:25:47.853988 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.853856    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a01567d7-91cc-47a4-bcad-610a30e8012a-secret-prometheus-k8s-tls\") pod \"a01567d7-91cc-47a4-bcad-610a30e8012a\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") "
Jul 06 14:25:47.853988 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.853891    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a01567d7-91cc-47a4-bcad-610a30e8012a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"a01567d7-91cc-47a4-bcad-610a30e8012a\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") "
Jul 06 14:25:47.853988 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.853917    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a01567d7-91cc-47a4-bcad-610a30e8012a-prometheus-k8s-rulefiles-0\") pod \"a01567d7-91cc-47a4-bcad-610a30e8012a\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") "
Jul 06 14:25:47.853988 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.853950    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a01567d7-91cc-47a4-bcad-610a30e8012a-prometheus-k8s-db\") pod \"a01567d7-91cc-47a4-bcad-610a30e8012a\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") "
Jul 06 14:25:47.853988 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.853975    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a01567d7-91cc-47a4-bcad-610a30e8012a-configmap-serving-certs-ca-bundle\") pod \"a01567d7-91cc-47a4-bcad-610a30e8012a\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") "
Jul 06 14:25:47.854248 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.854005    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a01567d7-91cc-47a4-bcad-610a30e8012a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"a01567d7-91cc-47a4-bcad-610a30e8012a\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") "
Jul 06 14:25:47.854248 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.854031    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j5fll\" (UniqueName: \"kubernetes.io/projected/a01567d7-91cc-47a4-bcad-610a30e8012a-kube-api-access-j5fll\") pod \"a01567d7-91cc-47a4-bcad-610a30e8012a\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") "
Jul 06 14:25:47.854248 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.854070    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a01567d7-91cc-47a4-bcad-610a30e8012a-secret-kube-rbac-proxy\") pod \"a01567d7-91cc-47a4-bcad-610a30e8012a\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") "
Jul 06 14:25:47.854248 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.854131    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a01567d7-91cc-47a4-bcad-610a30e8012a-config-out\") pod \"a01567d7-91cc-47a4-bcad-610a30e8012a\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") "
Jul 06 14:25:47.854248 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.854160    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a01567d7-91cc-47a4-bcad-610a30e8012a-web-config\") pod \"a01567d7-91cc-47a4-bcad-610a30e8012a\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") "
Jul 06 14:25:47.854248 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.854187    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a01567d7-91cc-47a4-bcad-610a30e8012a-configmap-kubelet-serving-ca-bundle\") pod \"a01567d7-91cc-47a4-bcad-610a30e8012a\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") "
Jul 06 14:25:47.854248 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.854225    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a01567d7-91cc-47a4-bcad-610a30e8012a-secret-grpc-tls\") pod \"a01567d7-91cc-47a4-bcad-610a30e8012a\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") "
Jul 06 14:25:47.854596 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.854331    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a01567d7-91cc-47a4-bcad-610a30e8012a-prometheus-trusted-ca-bundle\") pod \"a01567d7-91cc-47a4-bcad-610a30e8012a\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") "
Jul 06 14:25:47.854596 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.854396    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a01567d7-91cc-47a4-bcad-610a30e8012a-configmap-metrics-client-ca\") pod \"a01567d7-91cc-47a4-bcad-610a30e8012a\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") "
Jul 06 14:25:47.854596 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.854456    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a01567d7-91cc-47a4-bcad-610a30e8012a-prometheus-k8s-rulefiles-2\") pod \"a01567d7-91cc-47a4-bcad-610a30e8012a\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") "
Jul 06 14:25:47.854596 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.854485    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a01567d7-91cc-47a4-bcad-610a30e8012a-thanos-prometheus-http-client-file\") pod \"a01567d7-91cc-47a4-bcad-610a30e8012a\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") "
Jul 06 14:25:47.854596 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.854522    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a01567d7-91cc-47a4-bcad-610a30e8012a-prometheus-k8s-rulefiles-1\") pod \"a01567d7-91cc-47a4-bcad-610a30e8012a\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") "
Jul 06 14:25:47.854596 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.854548    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a01567d7-91cc-47a4-bcad-610a30e8012a-config\") pod \"a01567d7-91cc-47a4-bcad-610a30e8012a\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") "
Jul 06 14:25:47.854596 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.854558    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a01567d7-91cc-47a4-bcad-610a30e8012a-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "a01567d7-91cc-47a4-bcad-610a30e8012a" (UID: "a01567d7-91cc-47a4-bcad-610a30e8012a"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:25:47.854596 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.854577    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a01567d7-91cc-47a4-bcad-610a30e8012a-tls-assets\") pod \"a01567d7-91cc-47a4-bcad-610a30e8012a\" (UID: \"a01567d7-91cc-47a4-bcad-610a30e8012a\") "
Jul 06 14:25:47.854962 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.854928    2565 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a01567d7-91cc-47a4-bcad-610a30e8012a-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:25:47.855351 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.855296    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a01567d7-91cc-47a4-bcad-610a30e8012a-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "a01567d7-91cc-47a4-bcad-610a30e8012a" (UID: "a01567d7-91cc-47a4-bcad-610a30e8012a"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:25:47.855494 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.855465    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a01567d7-91cc-47a4-bcad-610a30e8012a-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "a01567d7-91cc-47a4-bcad-610a30e8012a" (UID: "a01567d7-91cc-47a4-bcad-610a30e8012a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:25:47.856661 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.856628    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a01567d7-91cc-47a4-bcad-610a30e8012a-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "a01567d7-91cc-47a4-bcad-610a30e8012a" (UID: "a01567d7-91cc-47a4-bcad-610a30e8012a"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:25:47.856799 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.856777    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a01567d7-91cc-47a4-bcad-610a30e8012a-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "a01567d7-91cc-47a4-bcad-610a30e8012a" (UID: "a01567d7-91cc-47a4-bcad-610a30e8012a"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:25:47.857048 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.857023    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a01567d7-91cc-47a4-bcad-610a30e8012a-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "a01567d7-91cc-47a4-bcad-610a30e8012a" (UID: "a01567d7-91cc-47a4-bcad-610a30e8012a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:25:47.857163 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.857117    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a01567d7-91cc-47a4-bcad-610a30e8012a-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "a01567d7-91cc-47a4-bcad-610a30e8012a" (UID: "a01567d7-91cc-47a4-bcad-610a30e8012a"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:25:47.857476 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.857454    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a01567d7-91cc-47a4-bcad-610a30e8012a-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "a01567d7-91cc-47a4-bcad-610a30e8012a" (UID: "a01567d7-91cc-47a4-bcad-610a30e8012a"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:25:47.857593 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.857571    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a01567d7-91cc-47a4-bcad-610a30e8012a-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "a01567d7-91cc-47a4-bcad-610a30e8012a" (UID: "a01567d7-91cc-47a4-bcad-610a30e8012a"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:25:47.857940 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.857915    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a01567d7-91cc-47a4-bcad-610a30e8012a-config-out" (OuterVolumeSpecName: "config-out") pod "a01567d7-91cc-47a4-bcad-610a30e8012a" (UID: "a01567d7-91cc-47a4-bcad-610a30e8012a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:25:47.858023 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.857927    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a01567d7-91cc-47a4-bcad-610a30e8012a-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "a01567d7-91cc-47a4-bcad-610a30e8012a" (UID: "a01567d7-91cc-47a4-bcad-610a30e8012a"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:25:47.858304 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.858271    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a01567d7-91cc-47a4-bcad-610a30e8012a-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "a01567d7-91cc-47a4-bcad-610a30e8012a" (UID: "a01567d7-91cc-47a4-bcad-610a30e8012a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:25:47.858985 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.858947    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a01567d7-91cc-47a4-bcad-610a30e8012a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "a01567d7-91cc-47a4-bcad-610a30e8012a" (UID: "a01567d7-91cc-47a4-bcad-610a30e8012a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:25:47.859070 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.858993    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a01567d7-91cc-47a4-bcad-610a30e8012a-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "a01567d7-91cc-47a4-bcad-610a30e8012a" (UID: "a01567d7-91cc-47a4-bcad-610a30e8012a"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:25:47.859246 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.859212    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a01567d7-91cc-47a4-bcad-610a30e8012a-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "a01567d7-91cc-47a4-bcad-610a30e8012a" (UID: "a01567d7-91cc-47a4-bcad-610a30e8012a"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:25:47.859822 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.859796    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a01567d7-91cc-47a4-bcad-610a30e8012a-kube-api-access-j5fll" (OuterVolumeSpecName: "kube-api-access-j5fll") pod "a01567d7-91cc-47a4-bcad-610a30e8012a" (UID: "a01567d7-91cc-47a4-bcad-610a30e8012a"). InnerVolumeSpecName "kube-api-access-j5fll". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:25:47.860318 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.860276    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a01567d7-91cc-47a4-bcad-610a30e8012a-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "a01567d7-91cc-47a4-bcad-610a30e8012a" (UID: "a01567d7-91cc-47a4-bcad-610a30e8012a"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:25:47.860501 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.860461    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a01567d7-91cc-47a4-bcad-610a30e8012a-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "a01567d7-91cc-47a4-bcad-610a30e8012a" (UID: "a01567d7-91cc-47a4-bcad-610a30e8012a"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:25:47.861072 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.861048    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a01567d7-91cc-47a4-bcad-610a30e8012a-config" (OuterVolumeSpecName: "config") pod "a01567d7-91cc-47a4-bcad-610a30e8012a" (UID: "a01567d7-91cc-47a4-bcad-610a30e8012a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:25:47.872389 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.872365    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a01567d7-91cc-47a4-bcad-610a30e8012a-web-config" (OuterVolumeSpecName: "web-config") pod "a01567d7-91cc-47a4-bcad-610a30e8012a" (UID: "a01567d7-91cc-47a4-bcad-610a30e8012a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:25:47.956157 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.956120    2565 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a01567d7-91cc-47a4-bcad-610a30e8012a-secret-metrics-client-certs\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:25:47.956157 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.956146    2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a01567d7-91cc-47a4-bcad-610a30e8012a-secret-prometheus-k8s-tls\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:25:47.956157 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.956162    2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a01567d7-91cc-47a4-bcad-610a30e8012a-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:25:47.956451 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.956173    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a01567d7-91cc-47a4-bcad-610a30e8012a-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:25:47.956451 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.956183    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a01567d7-91cc-47a4-bcad-610a30e8012a-prometheus-k8s-db\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:25:47.956451 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.956191    2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a01567d7-91cc-47a4-bcad-610a30e8012a-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:25:47.956451 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.956200    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j5fll\" (UniqueName: \"kubernetes.io/projected/a01567d7-91cc-47a4-bcad-610a30e8012a-kube-api-access-j5fll\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:25:47.956451 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.956207    2565 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a01567d7-91cc-47a4-bcad-610a30e8012a-secret-kube-rbac-proxy\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:25:47.956451 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.956215    2565 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a01567d7-91cc-47a4-bcad-610a30e8012a-config-out\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:25:47.956451 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.956225    2565 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a01567d7-91cc-47a4-bcad-610a30e8012a-web-config\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:25:47.956451 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.956237    2565 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a01567d7-91cc-47a4-bcad-610a30e8012a-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:25:47.956451 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.956250    2565 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a01567d7-91cc-47a4-bcad-610a30e8012a-secret-grpc-tls\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:25:47.956451 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.956258    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a01567d7-91cc-47a4-bcad-610a30e8012a-prometheus-trusted-ca-bundle\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:25:47.956451 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.956266    2565 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a01567d7-91cc-47a4-bcad-610a30e8012a-configmap-metrics-client-ca\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:25:47.956451 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.956275    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a01567d7-91cc-47a4-bcad-610a30e8012a-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:25:47.956451 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.956283    2565 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a01567d7-91cc-47a4-bcad-610a30e8012a-thanos-prometheus-http-client-file\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:25:47.956451 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.956292    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a01567d7-91cc-47a4-bcad-610a30e8012a-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:25:47.956451 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.956299    2565 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/a01567d7-91cc-47a4-bcad-610a30e8012a-config\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:25:47.956451 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:47.956308    2565 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a01567d7-91cc-47a4-bcad-610a30e8012a-tls-assets\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:25:48.085665 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.085586    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 14:25:48.090631 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.090602    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 14:25:48.118542 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.118512    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 14:25:48.118867 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.118850    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a01567d7-91cc-47a4-bcad-610a30e8012a" containerName="init-config-reloader"
Jul 06 14:25:48.118867 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.118867    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a01567d7-91cc-47a4-bcad-610a30e8012a" containerName="init-config-reloader"
Jul 06 14:25:48.118976 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.118878    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a01567d7-91cc-47a4-bcad-610a30e8012a" containerName="prometheus"
Jul 06 14:25:48.118976 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.118888    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a01567d7-91cc-47a4-bcad-610a30e8012a" containerName="prometheus"
Jul 06 14:25:48.118976 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.118900    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a01567d7-91cc-47a4-bcad-610a30e8012a" containerName="config-reloader"
Jul 06 14:25:48.118976 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.118905    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a01567d7-91cc-47a4-bcad-610a30e8012a" containerName="config-reloader"
Jul 06 14:25:48.118976 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.118915    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a01567d7-91cc-47a4-bcad-610a30e8012a" containerName="kube-rbac-proxy-thanos"
Jul 06 14:25:48.118976 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.118920    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a01567d7-91cc-47a4-bcad-610a30e8012a" containerName="kube-rbac-proxy-thanos"
Jul 06 14:25:48.118976 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.118936    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a01567d7-91cc-47a4-bcad-610a30e8012a" containerName="thanos-sidecar"
Jul 06 14:25:48.118976 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.118941    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a01567d7-91cc-47a4-bcad-610a30e8012a" containerName="thanos-sidecar"
Jul 06 14:25:48.118976 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.118946    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a01567d7-91cc-47a4-bcad-610a30e8012a" containerName="kube-rbac-proxy-web"
Jul 06 14:25:48.118976 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.118952    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a01567d7-91cc-47a4-bcad-610a30e8012a" containerName="kube-rbac-proxy-web"
Jul 06 14:25:48.118976 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.118962    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a01567d7-91cc-47a4-bcad-610a30e8012a" containerName="kube-rbac-proxy"
Jul 06 14:25:48.118976 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.118970    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a01567d7-91cc-47a4-bcad-610a30e8012a" containerName="kube-rbac-proxy"
Jul 06 14:25:48.119466 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.119032    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a01567d7-91cc-47a4-bcad-610a30e8012a" containerName="config-reloader"
Jul 06 14:25:48.119466 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.119040    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a01567d7-91cc-47a4-bcad-610a30e8012a" containerName="kube-rbac-proxy-web"
Jul 06 14:25:48.119466 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.119046    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a01567d7-91cc-47a4-bcad-610a30e8012a" containerName="kube-rbac-proxy-thanos"
Jul 06 14:25:48.119466 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.119059    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a01567d7-91cc-47a4-bcad-610a30e8012a" containerName="prometheus"
Jul 06 14:25:48.119466 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.119067    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a01567d7-91cc-47a4-bcad-610a30e8012a" containerName="thanos-sidecar"
Jul 06 14:25:48.119466 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.119072    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a01567d7-91cc-47a4-bcad-610a30e8012a" containerName="kube-rbac-proxy"
Jul 06 14:25:48.123793 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.123771    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.125822 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.125760    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 06 14:25:48.126040 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.126018    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 06 14:25:48.127498 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.127468    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 06 14:25:48.127655 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.127618    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 06 14:25:48.127856 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.127837    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 06 14:25:48.128708 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.128050    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 06 14:25:48.128994 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.128976    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 06 14:25:48.129117 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.129085    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7bd0umkvbh04r\""
Jul 06 14:25:48.129169 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.129125    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 06 14:25:48.129280 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.129262    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 06 14:25:48.129391 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.129373    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 06 14:25:48.129470 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.129452    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 06 14:25:48.129597 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.129571    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 06 14:25:48.129781 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.129708    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-rhzmv\""
Jul 06 14:25:48.132898 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.132872    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 06 14:25:48.135878 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.135815    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 06 14:25:48.139852 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.139643    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 14:25:48.258670 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.258630    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1dfd4274-1208-423f-a366-46495dab9e02-config-out\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.258828 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.258691    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1dfd4274-1208-423f-a366-46495dab9e02-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.258828 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.258723    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1dfd4274-1208-423f-a366-46495dab9e02-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.258935 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.258850    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dfd4274-1208-423f-a366-46495dab9e02-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.258935 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.258893    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dfd4274-1208-423f-a366-46495dab9e02-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.258935 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.258923    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1dfd4274-1208-423f-a366-46495dab9e02-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.259056 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.258948    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1dfd4274-1208-423f-a366-46495dab9e02-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.259056 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.258979    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1dfd4274-1208-423f-a366-46495dab9e02-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.259056 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.259005    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntswb\" (UniqueName: \"kubernetes.io/projected/1dfd4274-1208-423f-a366-46495dab9e02-kube-api-access-ntswb\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.259171 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.259094    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1dfd4274-1208-423f-a366-46495dab9e02-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.259171 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.259119    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1dfd4274-1208-423f-a366-46495dab9e02-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.259171 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.259152    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1dfd4274-1208-423f-a366-46495dab9e02-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.259293 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.259176    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1dfd4274-1208-423f-a366-46495dab9e02-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.259293 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.259204    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1dfd4274-1208-423f-a366-46495dab9e02-web-config\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.259421 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.259316    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1dfd4274-1208-423f-a366-46495dab9e02-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.259421 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.259389    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1dfd4274-1208-423f-a366-46495dab9e02-config\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.259515 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.259419    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1dfd4274-1208-423f-a366-46495dab9e02-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.259515 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.259449    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dfd4274-1208-423f-a366-46495dab9e02-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.259515 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.259478    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1dfd4274-1208-423f-a366-46495dab9e02-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.259650 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.259517    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1dfd4274-1208-423f-a366-46495dab9e02-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.360823 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.360741    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1dfd4274-1208-423f-a366-46495dab9e02-config\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.360823 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.360784    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1dfd4274-1208-423f-a366-46495dab9e02-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.360823 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.360806    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dfd4274-1208-423f-a366-46495dab9e02-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.361096 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.360934    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1dfd4274-1208-423f-a366-46495dab9e02-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.361096 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.360973    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1dfd4274-1208-423f-a366-46495dab9e02-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.361096 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.361014    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1dfd4274-1208-423f-a366-46495dab9e02-config-out\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.362311 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.361294    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1dfd4274-1208-423f-a366-46495dab9e02-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.362311 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.361361    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1dfd4274-1208-423f-a366-46495dab9e02-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.362311 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.361404    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dfd4274-1208-423f-a366-46495dab9e02-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.362311 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.361428    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dfd4274-1208-423f-a366-46495dab9e02-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.362311 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.361452    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1dfd4274-1208-423f-a366-46495dab9e02-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.362311 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.361475    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1dfd4274-1208-423f-a366-46495dab9e02-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.362311 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.361498    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1dfd4274-1208-423f-a366-46495dab9e02-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.362311 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.361513    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntswb\" (UniqueName: \"kubernetes.io/projected/1dfd4274-1208-423f-a366-46495dab9e02-kube-api-access-ntswb\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.362311 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.361566    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1dfd4274-1208-423f-a366-46495dab9e02-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.362311 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.361587    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1dfd4274-1208-423f-a366-46495dab9e02-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.362311 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.361615    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1dfd4274-1208-423f-a366-46495dab9e02-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.362311 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.361633    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1dfd4274-1208-423f-a366-46495dab9e02-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.362311 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.361656    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1dfd4274-1208-423f-a366-46495dab9e02-web-config\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.362311 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.361680    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1dfd4274-1208-423f-a366-46495dab9e02-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.362311 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.361693    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1dfd4274-1208-423f-a366-46495dab9e02-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.362311 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.361821    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dfd4274-1208-423f-a366-46495dab9e02-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.362311 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.362026    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1dfd4274-1208-423f-a366-46495dab9e02-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.363230 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.362478    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dfd4274-1208-423f-a366-46495dab9e02-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.363230 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.362674    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dfd4274-1208-423f-a366-46495dab9e02-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.364018 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.363617    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1dfd4274-1208-423f-a366-46495dab9e02-config-out\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.364018 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.363959    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1dfd4274-1208-423f-a366-46495dab9e02-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.364415 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.364285    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1dfd4274-1208-423f-a366-46495dab9e02-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.365172 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.364967    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1dfd4274-1208-423f-a366-46495dab9e02-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.365172 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.365006    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1dfd4274-1208-423f-a366-46495dab9e02-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.365829 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.365520    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1dfd4274-1208-423f-a366-46495dab9e02-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.365829 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.365779    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/1dfd4274-1208-423f-a366-46495dab9e02-config\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.365975 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.365953    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1dfd4274-1208-423f-a366-46495dab9e02-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.365975 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.365960    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1dfd4274-1208-423f-a366-46495dab9e02-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.366484 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.366464    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1dfd4274-1208-423f-a366-46495dab9e02-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.366766 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.366747    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1dfd4274-1208-423f-a366-46495dab9e02-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.367556 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.367530    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1dfd4274-1208-423f-a366-46495dab9e02-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.367823 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.367803    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1dfd4274-1208-423f-a366-46495dab9e02-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.367987 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.367972    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1dfd4274-1208-423f-a366-46495dab9e02-web-config\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.371478 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.371459    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntswb\" (UniqueName: \"kubernetes.io/projected/1dfd4274-1208-423f-a366-46495dab9e02-kube-api-access-ntswb\") pod \"prometheus-k8s-0\" (UID: \"1dfd4274-1208-423f-a366-46495dab9e02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:48.439449 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:48.439420    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:25:49.003524 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:49.003503    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 14:25:49.008151 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:25:49.008126    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dfd4274_1208_423f_a366_46495dab9e02.slice/crio-523cfdddb4366142eba7269741046d0c21179f450723e805907794283e3bac1e WatchSource:0}: Error finding container 523cfdddb4366142eba7269741046d0c21179f450723e805907794283e3bac1e: Status 404 returned error can't find the container with id 523cfdddb4366142eba7269741046d0c21179f450723e805907794283e3bac1e
Jul 06 14:25:49.777961 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:49.777929    2565 generic.go:356] "Generic (PLEG): container finished" podID="1dfd4274-1208-423f-a366-46495dab9e02" containerID="2bad733e7be9a458906fe206bb7123baa14eb4718d63b7e3a27bbf13ce3ab294" exitCode=0
Jul 06 14:25:49.778124 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:49.778017    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1dfd4274-1208-423f-a366-46495dab9e02","Type":"ContainerDied","Data":"2bad733e7be9a458906fe206bb7123baa14eb4718d63b7e3a27bbf13ce3ab294"}
Jul 06 14:25:49.778124 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:49.778101    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1dfd4274-1208-423f-a366-46495dab9e02","Type":"ContainerStarted","Data":"523cfdddb4366142eba7269741046d0c21179f450723e805907794283e3bac1e"}
Jul 06 14:25:49.780193 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:49.780170    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-56674667cd-4rr65" event={"ID":"a92c4838-38b6-4666-a40b-f7ac40aa1d0a","Type":"ContainerStarted","Data":"b1acbabcd2119962959940d2b8ca93b4049a061269d71fca602774b301b956d7"}
Jul 06 14:25:49.780297 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:49.780215    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-56674667cd-4rr65" event={"ID":"a92c4838-38b6-4666-a40b-f7ac40aa1d0a","Type":"ContainerStarted","Data":"e38751a4a0c5189b16e5080358ade34f7464675b043fe1e0d12b27ddc6bf5699"}
Jul 06 14:25:49.780297 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:49.780236    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-56674667cd-4rr65" event={"ID":"a92c4838-38b6-4666-a40b-f7ac40aa1d0a","Type":"ContainerStarted","Data":"c3ca169425d22382d3151a71477f4f6f5b8c4b747a5818ce2e5c2a0fcdc4c27b"}
Jul 06 14:25:49.821808 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:49.821356    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-56674667cd-4rr65" podStartSLOduration=1.591312573 podStartE2EDuration="3.821320674s" totalImagesPullingTime="2.230008101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:25:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:25:49.819823879 +0000 UTC m=+152.998472925" watchObservedRunningTime="2026-07-06 14:25:49.821320674 +0000 UTC m=+152.999969721"
Jul 06 14:25:49.959618 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:49.957277    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a01567d7-91cc-47a4-bcad-610a30e8012a" path="/var/lib/kubelet/pods/a01567d7-91cc-47a4-bcad-610a30e8012a/volumes"
Jul 06 14:25:50.522152 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:50.522109    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f96668979-bwzxk"]
Jul 06 14:25:50.525124 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:50.525099    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f96668979-bwzxk"
Jul 06 14:25:50.536522 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:50.536492    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f96668979-bwzxk"]
Jul 06 14:25:50.684032 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:50.683996    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c5b8fcb-0726-4329-a059-33b0a582aeff-trusted-ca-bundle\") pod \"console-6f96668979-bwzxk\" (UID: \"1c5b8fcb-0726-4329-a059-33b0a582aeff\") " pod="openshift-console/console-6f96668979-bwzxk"
Jul 06 14:25:50.684202 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:50.684044    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsf4j\" (UniqueName: \"kubernetes.io/projected/1c5b8fcb-0726-4329-a059-33b0a582aeff-kube-api-access-rsf4j\") pod \"console-6f96668979-bwzxk\" (UID: \"1c5b8fcb-0726-4329-a059-33b0a582aeff\") " pod="openshift-console/console-6f96668979-bwzxk"
Jul 06 14:25:50.684202 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:50.684124    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c5b8fcb-0726-4329-a059-33b0a582aeff-console-serving-cert\") pod \"console-6f96668979-bwzxk\" (UID: \"1c5b8fcb-0726-4329-a059-33b0a582aeff\") " pod="openshift-console/console-6f96668979-bwzxk"
Jul 06 14:25:50.684202 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:50.684156    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1c5b8fcb-0726-4329-a059-33b0a582aeff-console-oauth-config\") pod \"console-6f96668979-bwzxk\" (UID: \"1c5b8fcb-0726-4329-a059-33b0a582aeff\") " pod="openshift-console/console-6f96668979-bwzxk"
Jul 06 14:25:50.684202 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:50.684199    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1c5b8fcb-0726-4329-a059-33b0a582aeff-oauth-serving-cert\") pod \"console-6f96668979-bwzxk\" (UID: \"1c5b8fcb-0726-4329-a059-33b0a582aeff\") " pod="openshift-console/console-6f96668979-bwzxk"
Jul 06 14:25:50.684411 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:50.684231    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1c5b8fcb-0726-4329-a059-33b0a582aeff-console-config\") pod \"console-6f96668979-bwzxk\" (UID: \"1c5b8fcb-0726-4329-a059-33b0a582aeff\") " pod="openshift-console/console-6f96668979-bwzxk"
Jul 06 14:25:50.684411 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:50.684252    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1c5b8fcb-0726-4329-a059-33b0a582aeff-service-ca\") pod \"console-6f96668979-bwzxk\" (UID: \"1c5b8fcb-0726-4329-a059-33b0a582aeff\") " pod="openshift-console/console-6f96668979-bwzxk"
Jul 06 14:25:50.785645 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:50.785550    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1c5b8fcb-0726-4329-a059-33b0a582aeff-console-config\") pod \"console-6f96668979-bwzxk\" (UID: \"1c5b8fcb-0726-4329-a059-33b0a582aeff\") " pod="openshift-console/console-6f96668979-bwzxk"
Jul 06 14:25:50.785645 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:50.785585    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1c5b8fcb-0726-4329-a059-33b0a582aeff-service-ca\") pod \"console-6f96668979-bwzxk\" (UID: \"1c5b8fcb-0726-4329-a059-33b0a582aeff\") " pod="openshift-console/console-6f96668979-bwzxk"
Jul 06 14:25:50.785645 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:50.785612    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c5b8fcb-0726-4329-a059-33b0a582aeff-trusted-ca-bundle\") pod \"console-6f96668979-bwzxk\" (UID: \"1c5b8fcb-0726-4329-a059-33b0a582aeff\") " pod="openshift-console/console-6f96668979-bwzxk"
Jul 06 14:25:50.785645 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:50.785637    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsf4j\" (UniqueName: \"kubernetes.io/projected/1c5b8fcb-0726-4329-a059-33b0a582aeff-kube-api-access-rsf4j\") pod \"console-6f96668979-bwzxk\" (UID: \"1c5b8fcb-0726-4329-a059-33b0a582aeff\") " pod="openshift-console/console-6f96668979-bwzxk"
Jul 06 14:25:50.785975 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:50.785825    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c5b8fcb-0726-4329-a059-33b0a582aeff-console-serving-cert\") pod \"console-6f96668979-bwzxk\" (UID: \"1c5b8fcb-0726-4329-a059-33b0a582aeff\") " pod="openshift-console/console-6f96668979-bwzxk"
Jul 06 14:25:50.785975 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:50.785875    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1c5b8fcb-0726-4329-a059-33b0a582aeff-console-oauth-config\") pod \"console-6f96668979-bwzxk\" (UID: \"1c5b8fcb-0726-4329-a059-33b0a582aeff\") " pod="openshift-console/console-6f96668979-bwzxk"
Jul 06 14:25:50.785975 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:50.785941    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1c5b8fcb-0726-4329-a059-33b0a582aeff-oauth-serving-cert\") pod \"console-6f96668979-bwzxk\" (UID: \"1c5b8fcb-0726-4329-a059-33b0a582aeff\") " pod="openshift-console/console-6f96668979-bwzxk"
Jul 06 14:25:50.786422 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:50.786400    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1c5b8fcb-0726-4329-a059-33b0a582aeff-console-config\") pod \"console-6f96668979-bwzxk\" (UID: \"1c5b8fcb-0726-4329-a059-33b0a582aeff\") " pod="openshift-console/console-6f96668979-bwzxk"
Jul 06 14:25:50.786580 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:50.786417    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1c5b8fcb-0726-4329-a059-33b0a582aeff-service-ca\") pod \"console-6f96668979-bwzxk\" (UID: \"1c5b8fcb-0726-4329-a059-33b0a582aeff\") " pod="openshift-console/console-6f96668979-bwzxk"
Jul 06 14:25:50.786656 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:50.786640    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c5b8fcb-0726-4329-a059-33b0a582aeff-trusted-ca-bundle\") pod \"console-6f96668979-bwzxk\" (UID: \"1c5b8fcb-0726-4329-a059-33b0a582aeff\") " pod="openshift-console/console-6f96668979-bwzxk"
Jul 06 14:25:50.786753 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:50.786732    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1c5b8fcb-0726-4329-a059-33b0a582aeff-oauth-serving-cert\") pod \"console-6f96668979-bwzxk\" (UID: \"1c5b8fcb-0726-4329-a059-33b0a582aeff\") " pod="openshift-console/console-6f96668979-bwzxk"
Jul 06 14:25:50.788983 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:50.788960    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1c5b8fcb-0726-4329-a059-33b0a582aeff-console-oauth-config\") pod \"console-6f96668979-bwzxk\" (UID: \"1c5b8fcb-0726-4329-a059-33b0a582aeff\") " pod="openshift-console/console-6f96668979-bwzxk"
Jul 06 14:25:50.789072 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:50.788982    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c5b8fcb-0726-4329-a059-33b0a582aeff-console-serving-cert\") pod \"console-6f96668979-bwzxk\" (UID: \"1c5b8fcb-0726-4329-a059-33b0a582aeff\") " pod="openshift-console/console-6f96668979-bwzxk"
Jul 06 14:25:50.789313 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:50.789293    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1dfd4274-1208-423f-a366-46495dab9e02","Type":"ContainerStarted","Data":"8bc9323def97cc52f1842607be7192fd8d7f211e16905271ceb3196e76aeff8d"}
Jul 06 14:25:50.789400 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:50.789386    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1dfd4274-1208-423f-a366-46495dab9e02","Type":"ContainerStarted","Data":"ace3aada7d253727a43dd85db9367162098eb93eaea8052fd7c38891a70d12a1"}
Jul 06 14:25:50.789466 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:50.789431    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1dfd4274-1208-423f-a366-46495dab9e02","Type":"ContainerStarted","Data":"e534d7c7c4d82d37b82cfbceff136abe2c4451d5d5b0c18e169880a0089680be"}
Jul 06 14:25:50.789523 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:50.789477    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1dfd4274-1208-423f-a366-46495dab9e02","Type":"ContainerStarted","Data":"e1c5af11d742bda64924dd6c565bd78f7146dd389a459ba094a958c382f861d2"}
Jul 06 14:25:50.789523 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:50.789519    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1dfd4274-1208-423f-a366-46495dab9e02","Type":"ContainerStarted","Data":"63d9a7f37fd69208a1504e7ea0dd85e2fa2c9037a5a317d3a1e2fb92219efcf1"}
Jul 06 14:25:50.789622 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:50.789558    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1dfd4274-1208-423f-a366-46495dab9e02","Type":"ContainerStarted","Data":"cbff8ec9afc2a55dae2199e46bbceea4bf8096e6a44676eecb886ff37ed82420"}
Jul 06 14:25:50.794440 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:50.794418    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsf4j\" (UniqueName: \"kubernetes.io/projected/1c5b8fcb-0726-4329-a059-33b0a582aeff-kube-api-access-rsf4j\") pod \"console-6f96668979-bwzxk\" (UID: \"1c5b8fcb-0726-4329-a059-33b0a582aeff\") " pod="openshift-console/console-6f96668979-bwzxk"
Jul 06 14:25:50.817685 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:50.817636    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.79652646 podStartE2EDuration="2.817619495s" totalImagesPullingTime="0s" totalInitContainerRuntime="21.093035ms" isStatefulPod=false podCreationTimestamp="2026-07-06 14:25:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:25:50.814490715 +0000 UTC m=+153.993139761" watchObservedRunningTime="2026-07-06 14:25:50.817619495 +0000 UTC m=+153.996268540"
Jul 06 14:25:50.838103 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:50.838076    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f96668979-bwzxk"
Jul 06 14:25:50.961954 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:50.961912    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f96668979-bwzxk"]
Jul 06 14:25:50.963955 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:25:50.963932    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c5b8fcb_0726_4329_a059_33b0a582aeff.slice/crio-887980bbcbe0f65bde424edc0e5fe97e5b08e47d778a40c7c2b14689c27d0713 WatchSource:0}: Error finding container 887980bbcbe0f65bde424edc0e5fe97e5b08e47d778a40c7c2b14689c27d0713: Status 404 returned error can't find the container with id 887980bbcbe0f65bde424edc0e5fe97e5b08e47d778a40c7c2b14689c27d0713
Jul 06 14:25:51.795443 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:51.795402    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f96668979-bwzxk" event={"ID":"1c5b8fcb-0726-4329-a059-33b0a582aeff","Type":"ContainerStarted","Data":"7a0d788c8a6ac51a56041d36bb16f7aaf940cdf11dfe07238efc3bd094702641"}
Jul 06 14:25:51.795879 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:51.795463    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f96668979-bwzxk" event={"ID":"1c5b8fcb-0726-4329-a059-33b0a582aeff","Type":"ContainerStarted","Data":"887980bbcbe0f65bde424edc0e5fe97e5b08e47d778a40c7c2b14689c27d0713"}
Jul 06 14:25:51.813630 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:51.813582    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f96668979-bwzxk" podStartSLOduration=1.813566148 podStartE2EDuration="1.813566148s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:25:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:25:51.811546467 +0000 UTC m=+154.990195538" watchObservedRunningTime="2026-07-06 14:25:51.813566148 +0000 UTC m=+154.992215263"
Jul 06 14:25:53.440468 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:25:53.440438    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:26:00.838482 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:26:00.838447    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f96668979-bwzxk"
Jul 06 14:26:00.838873 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:26:00.838508    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f96668979-bwzxk"
Jul 06 14:26:00.843812 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:26:00.843791    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f96668979-bwzxk"
Jul 06 14:26:01.839910 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:26:01.839882    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f96668979-bwzxk"
Jul 06 14:26:01.889105 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:26:01.889076    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59d5d646b-nblhm"]
Jul 06 14:26:26.910859 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:26:26.910797    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-59d5d646b-nblhm" podUID="06bec2d8-6db5-414f-8a9a-d1af1273bccc" containerName="console" containerID="cri-o://031833d56c92d1b8dfdad324fa1c0a5ea1b64c783c1ba5874651329a87247354" gracePeriod=15
Jul 06 14:26:27.156610 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:26:27.156585    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59d5d646b-nblhm"
Jul 06 14:26:27.313115 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:26:27.313006    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/06bec2d8-6db5-414f-8a9a-d1af1273bccc-service-ca\") pod \"06bec2d8-6db5-414f-8a9a-d1af1273bccc\" (UID: \"06bec2d8-6db5-414f-8a9a-d1af1273bccc\") "
Jul 06 14:26:27.313115 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:26:27.313051    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jg8jw\" (UniqueName: \"kubernetes.io/projected/06bec2d8-6db5-414f-8a9a-d1af1273bccc-kube-api-access-jg8jw\") pod \"06bec2d8-6db5-414f-8a9a-d1af1273bccc\" (UID: \"06bec2d8-6db5-414f-8a9a-d1af1273bccc\") "
Jul 06 14:26:27.313115 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:26:27.313077    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06bec2d8-6db5-414f-8a9a-d1af1273bccc-trusted-ca-bundle\") pod \"06bec2d8-6db5-414f-8a9a-d1af1273bccc\" (UID: \"06bec2d8-6db5-414f-8a9a-d1af1273bccc\") "
Jul 06 14:26:27.315629 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:26:27.313934    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06bec2d8-6db5-414f-8a9a-d1af1273bccc-service-ca" (OuterVolumeSpecName: "service-ca") pod "06bec2d8-6db5-414f-8a9a-d1af1273bccc" (UID: "06bec2d8-6db5-414f-8a9a-d1af1273bccc"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:26:27.315629 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:26:27.314021    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/06bec2d8-6db5-414f-8a9a-d1af1273bccc-console-oauth-config\") pod \"06bec2d8-6db5-414f-8a9a-d1af1273bccc\" (UID: \"06bec2d8-6db5-414f-8a9a-d1af1273bccc\") "
Jul 06 14:26:27.315629 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:26:27.314111    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/06bec2d8-6db5-414f-8a9a-d1af1273bccc-console-serving-cert\") pod \"06bec2d8-6db5-414f-8a9a-d1af1273bccc\" (UID: \"06bec2d8-6db5-414f-8a9a-d1af1273bccc\") "
Jul 06 14:26:27.315629 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:26:27.314157    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/06bec2d8-6db5-414f-8a9a-d1af1273bccc-console-config\") pod \"06bec2d8-6db5-414f-8a9a-d1af1273bccc\" (UID: \"06bec2d8-6db5-414f-8a9a-d1af1273bccc\") "
Jul 06 14:26:27.315629 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:26:27.314193    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/06bec2d8-6db5-414f-8a9a-d1af1273bccc-oauth-serving-cert\") pod \"06bec2d8-6db5-414f-8a9a-d1af1273bccc\" (UID: \"06bec2d8-6db5-414f-8a9a-d1af1273bccc\") "
Jul 06 14:26:27.315629 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:26:27.314656    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/06bec2d8-6db5-414f-8a9a-d1af1273bccc-service-ca\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:26:27.315629 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:26:27.315018    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06bec2d8-6db5-414f-8a9a-d1af1273bccc-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "06bec2d8-6db5-414f-8a9a-d1af1273bccc" (UID: "06bec2d8-6db5-414f-8a9a-d1af1273bccc"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:26:27.315629 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:26:27.315352    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06bec2d8-6db5-414f-8a9a-d1af1273bccc-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "06bec2d8-6db5-414f-8a9a-d1af1273bccc" (UID: "06bec2d8-6db5-414f-8a9a-d1af1273bccc"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:26:27.316896 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:26:27.316620    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06bec2d8-6db5-414f-8a9a-d1af1273bccc-kube-api-access-jg8jw" (OuterVolumeSpecName: "kube-api-access-jg8jw") pod "06bec2d8-6db5-414f-8a9a-d1af1273bccc" (UID: "06bec2d8-6db5-414f-8a9a-d1af1273bccc"). InnerVolumeSpecName "kube-api-access-jg8jw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:26:27.319278 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:26:27.319086    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06bec2d8-6db5-414f-8a9a-d1af1273bccc-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "06bec2d8-6db5-414f-8a9a-d1af1273bccc" (UID: "06bec2d8-6db5-414f-8a9a-d1af1273bccc"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:26:27.319753 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:26:27.319524    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06bec2d8-6db5-414f-8a9a-d1af1273bccc-console-config" (OuterVolumeSpecName: "console-config") pod "06bec2d8-6db5-414f-8a9a-d1af1273bccc" (UID: "06bec2d8-6db5-414f-8a9a-d1af1273bccc"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:26:27.320328 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:26:27.320297    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06bec2d8-6db5-414f-8a9a-d1af1273bccc-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "06bec2d8-6db5-414f-8a9a-d1af1273bccc" (UID: "06bec2d8-6db5-414f-8a9a-d1af1273bccc"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:26:27.415393 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:26:27.415327    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/06bec2d8-6db5-414f-8a9a-d1af1273bccc-console-serving-cert\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:26:27.415393 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:26:27.415390    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/06bec2d8-6db5-414f-8a9a-d1af1273bccc-console-config\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:26:27.415393 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:26:27.415401    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/06bec2d8-6db5-414f-8a9a-d1af1273bccc-oauth-serving-cert\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:26:27.415393 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:26:27.415409    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jg8jw\" (UniqueName: \"kubernetes.io/projected/06bec2d8-6db5-414f-8a9a-d1af1273bccc-kube-api-access-jg8jw\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:26:27.415630 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:26:27.415418    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06bec2d8-6db5-414f-8a9a-d1af1273bccc-trusted-ca-bundle\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:26:27.415630 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:26:27.415427    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/06bec2d8-6db5-414f-8a9a-d1af1273bccc-console-oauth-config\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:26:27.940119 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:26:27.940083    2565 generic.go:356] "Generic (PLEG): container finished" podID="06bec2d8-6db5-414f-8a9a-d1af1273bccc" containerID="031833d56c92d1b8dfdad324fa1c0a5ea1b64c783c1ba5874651329a87247354" exitCode=0
Jul 06 14:26:27.940571 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:26:27.940159    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59d5d646b-nblhm"
Jul 06 14:26:27.940571 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:26:27.940184    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59d5d646b-nblhm" event={"ID":"06bec2d8-6db5-414f-8a9a-d1af1273bccc","Type":"ContainerDied","Data":"031833d56c92d1b8dfdad324fa1c0a5ea1b64c783c1ba5874651329a87247354"}
Jul 06 14:26:27.940571 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:26:27.940270    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59d5d646b-nblhm" event={"ID":"06bec2d8-6db5-414f-8a9a-d1af1273bccc","Type":"ContainerDied","Data":"310d8b0f964fa33c1a1ce74040c678eac1bcec76e010bf9ca09e1f92a1850a89"}
Jul 06 14:26:27.940571 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:26:27.940292    2565 scope.go:117] "RemoveContainer" containerID="031833d56c92d1b8dfdad324fa1c0a5ea1b64c783c1ba5874651329a87247354"
Jul 06 14:26:27.949330 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:26:27.949309    2565 scope.go:117] "RemoveContainer" containerID="031833d56c92d1b8dfdad324fa1c0a5ea1b64c783c1ba5874651329a87247354"
Jul 06 14:26:27.949631 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:26:27.949610    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"031833d56c92d1b8dfdad324fa1c0a5ea1b64c783c1ba5874651329a87247354\": container with ID starting with 031833d56c92d1b8dfdad324fa1c0a5ea1b64c783c1ba5874651329a87247354 not found: ID does not exist" containerID="031833d56c92d1b8dfdad324fa1c0a5ea1b64c783c1ba5874651329a87247354"
Jul 06 14:26:27.949710 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:26:27.949638    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"031833d56c92d1b8dfdad324fa1c0a5ea1b64c783c1ba5874651329a87247354"} err="failed to get container status \"031833d56c92d1b8dfdad324fa1c0a5ea1b64c783c1ba5874651329a87247354\": rpc error: code = NotFound desc = could not find container \"031833d56c92d1b8dfdad324fa1c0a5ea1b64c783c1ba5874651329a87247354\": container with ID starting with 031833d56c92d1b8dfdad324fa1c0a5ea1b64c783c1ba5874651329a87247354 not found: ID does not exist"
Jul 06 14:26:27.963519 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:26:27.963499    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59d5d646b-nblhm"]
Jul 06 14:26:27.966457 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:26:27.966436    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59d5d646b-nblhm"]
Jul 06 14:26:29.952596 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:26:29.952564    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06bec2d8-6db5-414f-8a9a-d1af1273bccc" path="/var/lib/kubelet/pods/06bec2d8-6db5-414f-8a9a-d1af1273bccc/volumes"
Jul 06 14:26:48.440131 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:26:48.440099    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:26:48.455391 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:26:48.455371    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:26:49.035966 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:26:49.035933    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:27:03.269182 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:03.269148    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b8977fc97-pl9qd"]
Jul 06 14:27:03.269600 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:03.269516    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06bec2d8-6db5-414f-8a9a-d1af1273bccc" containerName="console"
Jul 06 14:27:03.269600 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:03.269528    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="06bec2d8-6db5-414f-8a9a-d1af1273bccc" containerName="console"
Jul 06 14:27:03.269600 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:03.269594    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="06bec2d8-6db5-414f-8a9a-d1af1273bccc" containerName="console"
Jul 06 14:27:03.274103 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:03.274082    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b8977fc97-pl9qd"
Jul 06 14:27:03.285444 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:03.285420    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b8977fc97-pl9qd"]
Jul 06 14:27:03.452878 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:03.452848    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7b6f7e1-37cc-4290-b58a-9262cd7ba58c-oauth-serving-cert\") pod \"console-6b8977fc97-pl9qd\" (UID: \"d7b6f7e1-37cc-4290-b58a-9262cd7ba58c\") " pod="openshift-console/console-6b8977fc97-pl9qd"
Jul 06 14:27:03.453044 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:03.452888    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvhrr\" (UniqueName: \"kubernetes.io/projected/d7b6f7e1-37cc-4290-b58a-9262cd7ba58c-kube-api-access-kvhrr\") pod \"console-6b8977fc97-pl9qd\" (UID: \"d7b6f7e1-37cc-4290-b58a-9262cd7ba58c\") " pod="openshift-console/console-6b8977fc97-pl9qd"
Jul 06 14:27:03.453044 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:03.452910    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7b6f7e1-37cc-4290-b58a-9262cd7ba58c-service-ca\") pod \"console-6b8977fc97-pl9qd\" (UID: \"d7b6f7e1-37cc-4290-b58a-9262cd7ba58c\") " pod="openshift-console/console-6b8977fc97-pl9qd"
Jul 06 14:27:03.453044 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:03.452949    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7b6f7e1-37cc-4290-b58a-9262cd7ba58c-console-serving-cert\") pod \"console-6b8977fc97-pl9qd\" (UID: \"d7b6f7e1-37cc-4290-b58a-9262cd7ba58c\") " pod="openshift-console/console-6b8977fc97-pl9qd"
Jul 06 14:27:03.453044 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:03.452974    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7b6f7e1-37cc-4290-b58a-9262cd7ba58c-console-oauth-config\") pod \"console-6b8977fc97-pl9qd\" (UID: \"d7b6f7e1-37cc-4290-b58a-9262cd7ba58c\") " pod="openshift-console/console-6b8977fc97-pl9qd"
Jul 06 14:27:03.453188 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:03.453044    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7b6f7e1-37cc-4290-b58a-9262cd7ba58c-console-config\") pod \"console-6b8977fc97-pl9qd\" (UID: \"d7b6f7e1-37cc-4290-b58a-9262cd7ba58c\") " pod="openshift-console/console-6b8977fc97-pl9qd"
Jul 06 14:27:03.453188 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:03.453078    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7b6f7e1-37cc-4290-b58a-9262cd7ba58c-trusted-ca-bundle\") pod \"console-6b8977fc97-pl9qd\" (UID: \"d7b6f7e1-37cc-4290-b58a-9262cd7ba58c\") " pod="openshift-console/console-6b8977fc97-pl9qd"
Jul 06 14:27:03.553768 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:03.553678    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7b6f7e1-37cc-4290-b58a-9262cd7ba58c-trusted-ca-bundle\") pod \"console-6b8977fc97-pl9qd\" (UID: \"d7b6f7e1-37cc-4290-b58a-9262cd7ba58c\") " pod="openshift-console/console-6b8977fc97-pl9qd"
Jul 06 14:27:03.553768 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:03.553721    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7b6f7e1-37cc-4290-b58a-9262cd7ba58c-oauth-serving-cert\") pod \"console-6b8977fc97-pl9qd\" (UID: \"d7b6f7e1-37cc-4290-b58a-9262cd7ba58c\") " pod="openshift-console/console-6b8977fc97-pl9qd"
Jul 06 14:27:03.553768 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:03.553743    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvhrr\" (UniqueName: \"kubernetes.io/projected/d7b6f7e1-37cc-4290-b58a-9262cd7ba58c-kube-api-access-kvhrr\") pod \"console-6b8977fc97-pl9qd\" (UID: \"d7b6f7e1-37cc-4290-b58a-9262cd7ba58c\") " pod="openshift-console/console-6b8977fc97-pl9qd"
Jul 06 14:27:03.553768 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:03.553765    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7b6f7e1-37cc-4290-b58a-9262cd7ba58c-service-ca\") pod \"console-6b8977fc97-pl9qd\" (UID: \"d7b6f7e1-37cc-4290-b58a-9262cd7ba58c\") " pod="openshift-console/console-6b8977fc97-pl9qd"
Jul 06 14:27:03.554113 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:03.553803    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7b6f7e1-37cc-4290-b58a-9262cd7ba58c-console-serving-cert\") pod \"console-6b8977fc97-pl9qd\" (UID: \"d7b6f7e1-37cc-4290-b58a-9262cd7ba58c\") " pod="openshift-console/console-6b8977fc97-pl9qd"
Jul 06 14:27:03.554113 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:03.553826    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7b6f7e1-37cc-4290-b58a-9262cd7ba58c-console-oauth-config\") pod \"console-6b8977fc97-pl9qd\" (UID: \"d7b6f7e1-37cc-4290-b58a-9262cd7ba58c\") " pod="openshift-console/console-6b8977fc97-pl9qd"
Jul 06 14:27:03.554113 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:03.553870    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7b6f7e1-37cc-4290-b58a-9262cd7ba58c-console-config\") pod \"console-6b8977fc97-pl9qd\" (UID: \"d7b6f7e1-37cc-4290-b58a-9262cd7ba58c\") " pod="openshift-console/console-6b8977fc97-pl9qd"
Jul 06 14:27:03.554639 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:03.554609    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7b6f7e1-37cc-4290-b58a-9262cd7ba58c-service-ca\") pod \"console-6b8977fc97-pl9qd\" (UID: \"d7b6f7e1-37cc-4290-b58a-9262cd7ba58c\") " pod="openshift-console/console-6b8977fc97-pl9qd"
Jul 06 14:27:03.554639 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:03.554626    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7b6f7e1-37cc-4290-b58a-9262cd7ba58c-oauth-serving-cert\") pod \"console-6b8977fc97-pl9qd\" (UID: \"d7b6f7e1-37cc-4290-b58a-9262cd7ba58c\") " pod="openshift-console/console-6b8977fc97-pl9qd"
Jul 06 14:27:03.554797 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:03.554652    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7b6f7e1-37cc-4290-b58a-9262cd7ba58c-console-config\") pod \"console-6b8977fc97-pl9qd\" (UID: \"d7b6f7e1-37cc-4290-b58a-9262cd7ba58c\") " pod="openshift-console/console-6b8977fc97-pl9qd"
Jul 06 14:27:03.554797 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:03.554674    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7b6f7e1-37cc-4290-b58a-9262cd7ba58c-trusted-ca-bundle\") pod \"console-6b8977fc97-pl9qd\" (UID: \"d7b6f7e1-37cc-4290-b58a-9262cd7ba58c\") " pod="openshift-console/console-6b8977fc97-pl9qd"
Jul 06 14:27:03.556844 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:03.556818    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7b6f7e1-37cc-4290-b58a-9262cd7ba58c-console-serving-cert\") pod \"console-6b8977fc97-pl9qd\" (UID: \"d7b6f7e1-37cc-4290-b58a-9262cd7ba58c\") " pod="openshift-console/console-6b8977fc97-pl9qd"
Jul 06 14:27:03.556945 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:03.556923    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7b6f7e1-37cc-4290-b58a-9262cd7ba58c-console-oauth-config\") pod \"console-6b8977fc97-pl9qd\" (UID: \"d7b6f7e1-37cc-4290-b58a-9262cd7ba58c\") " pod="openshift-console/console-6b8977fc97-pl9qd"
Jul 06 14:27:03.561868 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:03.561844    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvhrr\" (UniqueName: \"kubernetes.io/projected/d7b6f7e1-37cc-4290-b58a-9262cd7ba58c-kube-api-access-kvhrr\") pod \"console-6b8977fc97-pl9qd\" (UID: \"d7b6f7e1-37cc-4290-b58a-9262cd7ba58c\") " pod="openshift-console/console-6b8977fc97-pl9qd"
Jul 06 14:27:03.583027 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:03.583009    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b8977fc97-pl9qd"
Jul 06 14:27:03.707767 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:03.707678    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b8977fc97-pl9qd"]
Jul 06 14:27:03.710871 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:27:03.710846    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7b6f7e1_37cc_4290_b58a_9262cd7ba58c.slice/crio-f722198dd6d4e21f6e44c246d5c065c160e8741f15cdc1a4011c596b1af641a9 WatchSource:0}: Error finding container f722198dd6d4e21f6e44c246d5c065c160e8741f15cdc1a4011c596b1af641a9: Status 404 returned error can't find the container with id f722198dd6d4e21f6e44c246d5c065c160e8741f15cdc1a4011c596b1af641a9
Jul 06 14:27:04.081302 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:04.081264    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b8977fc97-pl9qd" event={"ID":"d7b6f7e1-37cc-4290-b58a-9262cd7ba58c","Type":"ContainerStarted","Data":"cecfacdeb9246b8a8707706b5d69ce58382770dd733b18f32ea209419556bb10"}
Jul 06 14:27:04.081501 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:04.081318    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b8977fc97-pl9qd" event={"ID":"d7b6f7e1-37cc-4290-b58a-9262cd7ba58c","Type":"ContainerStarted","Data":"f722198dd6d4e21f6e44c246d5c065c160e8741f15cdc1a4011c596b1af641a9"}
Jul 06 14:27:04.100514 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:04.100459    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b8977fc97-pl9qd" podStartSLOduration=1.100439286 podStartE2EDuration="1.100439286s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:27:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:27:04.099442871 +0000 UTC m=+227.278091931" watchObservedRunningTime="2026-07-06 14:27:04.100439286 +0000 UTC m=+227.279088335"
Jul 06 14:27:13.583482 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:13.583444    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b8977fc97-pl9qd"
Jul 06 14:27:13.583950 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:13.583513    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b8977fc97-pl9qd"
Jul 06 14:27:13.588086 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:13.588066    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b8977fc97-pl9qd"
Jul 06 14:27:14.126240 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:14.126211    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b8977fc97-pl9qd"
Jul 06 14:27:14.180908 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:14.180874    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f96668979-bwzxk"]
Jul 06 14:27:39.201702 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:39.201592    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6f96668979-bwzxk" podUID="1c5b8fcb-0726-4329-a059-33b0a582aeff" containerName="console" containerID="cri-o://7a0d788c8a6ac51a56041d36bb16f7aaf940cdf11dfe07238efc3bd094702641" gracePeriod=15
Jul 06 14:27:39.436877 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:39.436852    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f96668979-bwzxk"
Jul 06 14:27:39.570738 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:39.570646    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rsf4j\" (UniqueName: \"kubernetes.io/projected/1c5b8fcb-0726-4329-a059-33b0a582aeff-kube-api-access-rsf4j\") pod \"1c5b8fcb-0726-4329-a059-33b0a582aeff\" (UID: \"1c5b8fcb-0726-4329-a059-33b0a582aeff\") "
Jul 06 14:27:39.570738 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:39.570706    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1c5b8fcb-0726-4329-a059-33b0a582aeff-service-ca\") pod \"1c5b8fcb-0726-4329-a059-33b0a582aeff\" (UID: \"1c5b8fcb-0726-4329-a059-33b0a582aeff\") "
Jul 06 14:27:39.570962 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:39.570781    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1c5b8fcb-0726-4329-a059-33b0a582aeff-oauth-serving-cert\") pod \"1c5b8fcb-0726-4329-a059-33b0a582aeff\" (UID: \"1c5b8fcb-0726-4329-a059-33b0a582aeff\") "
Jul 06 14:27:39.570962 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:39.570819    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1c5b8fcb-0726-4329-a059-33b0a582aeff-console-config\") pod \"1c5b8fcb-0726-4329-a059-33b0a582aeff\" (UID: \"1c5b8fcb-0726-4329-a059-33b0a582aeff\") "
Jul 06 14:27:39.570962 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:39.570842    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c5b8fcb-0726-4329-a059-33b0a582aeff-trusted-ca-bundle\") pod \"1c5b8fcb-0726-4329-a059-33b0a582aeff\" (UID: \"1c5b8fcb-0726-4329-a059-33b0a582aeff\") "
Jul 06 14:27:39.571119 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:39.570958    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1c5b8fcb-0726-4329-a059-33b0a582aeff-console-oauth-config\") pod \"1c5b8fcb-0726-4329-a059-33b0a582aeff\" (UID: \"1c5b8fcb-0726-4329-a059-33b0a582aeff\") "
Jul 06 14:27:39.571119 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:39.571018    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c5b8fcb-0726-4329-a059-33b0a582aeff-console-serving-cert\") pod \"1c5b8fcb-0726-4329-a059-33b0a582aeff\" (UID: \"1c5b8fcb-0726-4329-a059-33b0a582aeff\") "
Jul 06 14:27:39.571223 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:39.571153    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c5b8fcb-0726-4329-a059-33b0a582aeff-service-ca" (OuterVolumeSpecName: "service-ca") pod "1c5b8fcb-0726-4329-a059-33b0a582aeff" (UID: "1c5b8fcb-0726-4329-a059-33b0a582aeff"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:27:39.571278 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:39.571235    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c5b8fcb-0726-4329-a059-33b0a582aeff-console-config" (OuterVolumeSpecName: "console-config") pod "1c5b8fcb-0726-4329-a059-33b0a582aeff" (UID: "1c5b8fcb-0726-4329-a059-33b0a582aeff"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:27:39.571278 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:39.571253    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c5b8fcb-0726-4329-a059-33b0a582aeff-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1c5b8fcb-0726-4329-a059-33b0a582aeff" (UID: "1c5b8fcb-0726-4329-a059-33b0a582aeff"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:27:39.571410 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:39.571295    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c5b8fcb-0726-4329-a059-33b0a582aeff-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1c5b8fcb-0726-4329-a059-33b0a582aeff" (UID: "1c5b8fcb-0726-4329-a059-33b0a582aeff"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:27:39.571465 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:39.571421    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1c5b8fcb-0726-4329-a059-33b0a582aeff-console-config\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:27:39.571465 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:39.571441    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c5b8fcb-0726-4329-a059-33b0a582aeff-trusted-ca-bundle\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:27:39.571465 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:39.571456    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1c5b8fcb-0726-4329-a059-33b0a582aeff-service-ca\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:27:39.571566 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:39.571470    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1c5b8fcb-0726-4329-a059-33b0a582aeff-oauth-serving-cert\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:27:39.572972 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:39.572944    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c5b8fcb-0726-4329-a059-33b0a582aeff-kube-api-access-rsf4j" (OuterVolumeSpecName: "kube-api-access-rsf4j") pod "1c5b8fcb-0726-4329-a059-33b0a582aeff" (UID: "1c5b8fcb-0726-4329-a059-33b0a582aeff"). InnerVolumeSpecName "kube-api-access-rsf4j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:27:39.573084 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:39.572979    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c5b8fcb-0726-4329-a059-33b0a582aeff-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1c5b8fcb-0726-4329-a059-33b0a582aeff" (UID: "1c5b8fcb-0726-4329-a059-33b0a582aeff"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:27:39.573084 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:39.572997    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c5b8fcb-0726-4329-a059-33b0a582aeff-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1c5b8fcb-0726-4329-a059-33b0a582aeff" (UID: "1c5b8fcb-0726-4329-a059-33b0a582aeff"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:27:39.672371 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:39.672315    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rsf4j\" (UniqueName: \"kubernetes.io/projected/1c5b8fcb-0726-4329-a059-33b0a582aeff-kube-api-access-rsf4j\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:27:39.672371 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:39.672365    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1c5b8fcb-0726-4329-a059-33b0a582aeff-console-oauth-config\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:27:39.672371 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:39.672375    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c5b8fcb-0726-4329-a059-33b0a582aeff-console-serving-cert\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:27:40.229703 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:40.229616    2565 generic.go:356] "Generic (PLEG): container finished" podID="1c5b8fcb-0726-4329-a059-33b0a582aeff" containerID="7a0d788c8a6ac51a56041d36bb16f7aaf940cdf11dfe07238efc3bd094702641" exitCode=0
Jul 06 14:27:40.229703 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:40.229665    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f96668979-bwzxk"
Jul 06 14:27:40.229703 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:40.229684    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f96668979-bwzxk" event={"ID":"1c5b8fcb-0726-4329-a059-33b0a582aeff","Type":"ContainerDied","Data":"7a0d788c8a6ac51a56041d36bb16f7aaf940cdf11dfe07238efc3bd094702641"}
Jul 06 14:27:40.230209 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:40.229733    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f96668979-bwzxk" event={"ID":"1c5b8fcb-0726-4329-a059-33b0a582aeff","Type":"ContainerDied","Data":"887980bbcbe0f65bde424edc0e5fe97e5b08e47d778a40c7c2b14689c27d0713"}
Jul 06 14:27:40.230209 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:40.229757    2565 scope.go:117] "RemoveContainer" containerID="7a0d788c8a6ac51a56041d36bb16f7aaf940cdf11dfe07238efc3bd094702641"
Jul 06 14:27:40.238137 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:40.238122    2565 scope.go:117] "RemoveContainer" containerID="7a0d788c8a6ac51a56041d36bb16f7aaf940cdf11dfe07238efc3bd094702641"
Jul 06 14:27:40.238412 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:27:40.238391    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a0d788c8a6ac51a56041d36bb16f7aaf940cdf11dfe07238efc3bd094702641\": container with ID starting with 7a0d788c8a6ac51a56041d36bb16f7aaf940cdf11dfe07238efc3bd094702641 not found: ID does not exist" containerID="7a0d788c8a6ac51a56041d36bb16f7aaf940cdf11dfe07238efc3bd094702641"
Jul 06 14:27:40.238486 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:40.238423    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a0d788c8a6ac51a56041d36bb16f7aaf940cdf11dfe07238efc3bd094702641"} err="failed to get container status \"7a0d788c8a6ac51a56041d36bb16f7aaf940cdf11dfe07238efc3bd094702641\": rpc error: code = NotFound desc = could not find container \"7a0d788c8a6ac51a56041d36bb16f7aaf940cdf11dfe07238efc3bd094702641\": container with ID starting with 7a0d788c8a6ac51a56041d36bb16f7aaf940cdf11dfe07238efc3bd094702641 not found: ID does not exist"
Jul 06 14:27:40.245971 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:40.245949    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f96668979-bwzxk"]
Jul 06 14:27:40.249694 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:40.249675    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f96668979-bwzxk"]
Jul 06 14:27:41.952941 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:27:41.952910    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c5b8fcb-0726-4329-a059-33b0a582aeff" path="/var/lib/kubelet/pods/1c5b8fcb-0726-4329-a059-33b0a582aeff/volumes"
Jul 06 14:28:17.836651 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:17.836626    2565 kubelet.go:1648] "Image garbage collection succeeded"
Jul 06 14:28:21.235496 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:21.235457    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-ss6fh"]
Jul 06 14:28:21.237387 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:21.235797    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c5b8fcb-0726-4329-a059-33b0a582aeff" containerName="console"
Jul 06 14:28:21.237387 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:21.235808    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c5b8fcb-0726-4329-a059-33b0a582aeff" containerName="console"
Jul 06 14:28:21.237387 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:21.235871    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c5b8fcb-0726-4329-a059-33b0a582aeff" containerName="console"
Jul 06 14:28:21.238145 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:21.238130    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-ss6fh"
Jul 06 14:28:21.240663 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:21.240641    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 06 14:28:21.241086 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:21.241064    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 06 14:28:21.241388 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:21.241376    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-mz672\""
Jul 06 14:28:21.249988 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:21.249965    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-ss6fh"]
Jul 06 14:28:21.343856 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:21.343812    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvw7n\" (UniqueName: \"kubernetes.io/projected/404f06da-2895-494f-b4fc-866ad4a59cec-kube-api-access-jvw7n\") pod \"cert-manager-webhook-6486ffd997-ss6fh\" (UID: \"404f06da-2895-494f-b4fc-866ad4a59cec\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ss6fh"
Jul 06 14:28:21.343856 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:21.343862    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/404f06da-2895-494f-b4fc-866ad4a59cec-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-ss6fh\" (UID: \"404f06da-2895-494f-b4fc-866ad4a59cec\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ss6fh"
Jul 06 14:28:21.444406 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:21.444368    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvw7n\" (UniqueName: \"kubernetes.io/projected/404f06da-2895-494f-b4fc-866ad4a59cec-kube-api-access-jvw7n\") pod \"cert-manager-webhook-6486ffd997-ss6fh\" (UID: \"404f06da-2895-494f-b4fc-866ad4a59cec\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ss6fh"
Jul 06 14:28:21.444569 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:21.444420    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/404f06da-2895-494f-b4fc-866ad4a59cec-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-ss6fh\" (UID: \"404f06da-2895-494f-b4fc-866ad4a59cec\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ss6fh"
Jul 06 14:28:21.455304 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:21.455267    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/404f06da-2895-494f-b4fc-866ad4a59cec-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-ss6fh\" (UID: \"404f06da-2895-494f-b4fc-866ad4a59cec\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ss6fh"
Jul 06 14:28:21.455304 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:21.455291    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvw7n\" (UniqueName: \"kubernetes.io/projected/404f06da-2895-494f-b4fc-866ad4a59cec-kube-api-access-jvw7n\") pod \"cert-manager-webhook-6486ffd997-ss6fh\" (UID: \"404f06da-2895-494f-b4fc-866ad4a59cec\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ss6fh"
Jul 06 14:28:21.559300 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:21.559215    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-ss6fh"
Jul 06 14:28:21.684567 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:21.684544    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-ss6fh"]
Jul 06 14:28:21.686814 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:28:21.686791    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod404f06da_2895_494f_b4fc_866ad4a59cec.slice/crio-fffa3b5f2af53e05a5574fd715792781ed3f049f811bf922d1c101c4225ab849 WatchSource:0}: Error finding container fffa3b5f2af53e05a5574fd715792781ed3f049f811bf922d1c101c4225ab849: Status 404 returned error can't find the container with id fffa3b5f2af53e05a5574fd715792781ed3f049f811bf922d1c101c4225ab849
Jul 06 14:28:21.689127 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:21.689113    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 14:28:22.397415 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:22.397375    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-ss6fh" event={"ID":"404f06da-2895-494f-b4fc-866ad4a59cec","Type":"ContainerStarted","Data":"fffa3b5f2af53e05a5574fd715792781ed3f049f811bf922d1c101c4225ab849"}
Jul 06 14:28:25.413780 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:25.413744    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-ss6fh" event={"ID":"404f06da-2895-494f-b4fc-866ad4a59cec","Type":"ContainerStarted","Data":"c42e373012160a8768b3aebbb836e9e8143203c550273641fe499dff438f1295"}
Jul 06 14:28:25.414178 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:25.413866    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-ss6fh"
Jul 06 14:28:25.431234 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:25.431189    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-ss6fh" podStartSLOduration=1.304120871 podStartE2EDuration="4.431175498s" totalImagesPullingTime="3.127054627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:28:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:28:25.429837548 +0000 UTC m=+308.608486594" watchObservedRunningTime="2026-07-06 14:28:25.431175498 +0000 UTC m=+308.609824543"
Jul 06 14:28:31.419639 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:31.419607    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-ss6fh"
Jul 06 14:28:32.828542 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:32.828511    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d5nxp"]
Jul 06 14:28:32.831828 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:32.831810    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d5nxp"
Jul 06 14:28:32.833926 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:32.833901    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 06 14:28:32.834414 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:32.834400    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 06 14:28:32.834473 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:32.834400    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-v9mf6\""
Jul 06 14:28:32.849001 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:32.848978    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d5nxp"]
Jul 06 14:28:32.954829 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:32.954800    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/edf0456f-d17c-4a39-a1ef-469fd0e301b4-tmp\") pod \"openshift-lws-operator-fd8ccff4c-d5nxp\" (UID: \"edf0456f-d17c-4a39-a1ef-469fd0e301b4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d5nxp"
Jul 06 14:28:32.955022 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:32.954873    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thnxk\" (UniqueName: \"kubernetes.io/projected/edf0456f-d17c-4a39-a1ef-469fd0e301b4-kube-api-access-thnxk\") pod \"openshift-lws-operator-fd8ccff4c-d5nxp\" (UID: \"edf0456f-d17c-4a39-a1ef-469fd0e301b4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d5nxp"
Jul 06 14:28:33.055550 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:33.055516    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thnxk\" (UniqueName: \"kubernetes.io/projected/edf0456f-d17c-4a39-a1ef-469fd0e301b4-kube-api-access-thnxk\") pod \"openshift-lws-operator-fd8ccff4c-d5nxp\" (UID: \"edf0456f-d17c-4a39-a1ef-469fd0e301b4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d5nxp"
Jul 06 14:28:33.055718 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:33.055654    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/edf0456f-d17c-4a39-a1ef-469fd0e301b4-tmp\") pod \"openshift-lws-operator-fd8ccff4c-d5nxp\" (UID: \"edf0456f-d17c-4a39-a1ef-469fd0e301b4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d5nxp"
Jul 06 14:28:33.055970 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:33.055953    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/edf0456f-d17c-4a39-a1ef-469fd0e301b4-tmp\") pod \"openshift-lws-operator-fd8ccff4c-d5nxp\" (UID: \"edf0456f-d17c-4a39-a1ef-469fd0e301b4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d5nxp"
Jul 06 14:28:33.064041 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:33.064018    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thnxk\" (UniqueName: \"kubernetes.io/projected/edf0456f-d17c-4a39-a1ef-469fd0e301b4-kube-api-access-thnxk\") pod \"openshift-lws-operator-fd8ccff4c-d5nxp\" (UID: \"edf0456f-d17c-4a39-a1ef-469fd0e301b4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d5nxp"
Jul 06 14:28:33.140395 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:33.140314    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d5nxp"
Jul 06 14:28:33.278252 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:33.278221    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d5nxp"]
Jul 06 14:28:33.281473 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:28:33.281449    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podedf0456f_d17c_4a39_a1ef_469fd0e301b4.slice/crio-d137b33cd45396ba616aa1d23c5ee7a4b15144252b6b45881de7d90571593246 WatchSource:0}: Error finding container d137b33cd45396ba616aa1d23c5ee7a4b15144252b6b45881de7d90571593246: Status 404 returned error can't find the container with id d137b33cd45396ba616aa1d23c5ee7a4b15144252b6b45881de7d90571593246
Jul 06 14:28:33.446074 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:33.446045    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d5nxp" event={"ID":"edf0456f-d17c-4a39-a1ef-469fd0e301b4","Type":"ContainerStarted","Data":"d137b33cd45396ba616aa1d23c5ee7a4b15144252b6b45881de7d90571593246"}
Jul 06 14:28:36.463934 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:36.463896    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d5nxp" event={"ID":"edf0456f-d17c-4a39-a1ef-469fd0e301b4","Type":"ContainerStarted","Data":"25df3d2bbe849d6af116e6de090f90aa01044394246dafe63ebf13a5578cde7b"}
Jul 06 14:28:36.488839 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:36.488777    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d5nxp" podStartSLOduration=1.9253389950000002 podStartE2EDuration="4.488757556s" totalImagesPullingTime="2.563418561s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:28:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:28:36.488523345 +0000 UTC m=+319.667172393" watchObservedRunningTime="2026-07-06 14:28:36.488757556 +0000 UTC m=+319.667406605"
Jul 06 14:28:52.198492 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:52.198460    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-557ddcc9b5-whk5m"]
Jul 06 14:28:52.202070 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:52.202047    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-557ddcc9b5-whk5m"
Jul 06 14:28:52.206857 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:52.206833    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-l564n\""
Jul 06 14:28:52.206993 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:52.206971    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 06 14:28:52.207533 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:52.207520    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 06 14:28:52.208088 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:52.208070    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 06 14:28:52.210489 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:52.210465    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 06 14:28:52.216632 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:52.216609    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-557ddcc9b5-whk5m"]
Jul 06 14:28:52.217863 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:52.217839    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hw4vl\" (UniqueName: \"kubernetes.io/projected/a774d71b-e43c-4680-a5ba-3bd61ec58ed5-kube-api-access-hw4vl\") pod \"opendatahub-operator-controller-manager-557ddcc9b5-whk5m\" (UID: \"a774d71b-e43c-4680-a5ba-3bd61ec58ed5\") " pod="opendatahub/opendatahub-operator-controller-manager-557ddcc9b5-whk5m"
Jul 06 14:28:52.217954 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:52.217890    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a774d71b-e43c-4680-a5ba-3bd61ec58ed5-webhook-cert\") pod \"opendatahub-operator-controller-manager-557ddcc9b5-whk5m\" (UID: \"a774d71b-e43c-4680-a5ba-3bd61ec58ed5\") " pod="opendatahub/opendatahub-operator-controller-manager-557ddcc9b5-whk5m"
Jul 06 14:28:52.218007 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:52.217962    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a774d71b-e43c-4680-a5ba-3bd61ec58ed5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-557ddcc9b5-whk5m\" (UID: \"a774d71b-e43c-4680-a5ba-3bd61ec58ed5\") " pod="opendatahub/opendatahub-operator-controller-manager-557ddcc9b5-whk5m"
Jul 06 14:28:52.218079 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:52.218054    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a774d71b-e43c-4680-a5ba-3bd61ec58ed5-manifests\") pod \"opendatahub-operator-controller-manager-557ddcc9b5-whk5m\" (UID: \"a774d71b-e43c-4680-a5ba-3bd61ec58ed5\") " pod="opendatahub/opendatahub-operator-controller-manager-557ddcc9b5-whk5m"
Jul 06 14:28:52.218119 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:52.218113    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a774d71b-e43c-4680-a5ba-3bd61ec58ed5-tmp\") pod \"opendatahub-operator-controller-manager-557ddcc9b5-whk5m\" (UID: \"a774d71b-e43c-4680-a5ba-3bd61ec58ed5\") " pod="opendatahub/opendatahub-operator-controller-manager-557ddcc9b5-whk5m"
Jul 06 14:28:52.318743 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:52.318710    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a774d71b-e43c-4680-a5ba-3bd61ec58ed5-webhook-cert\") pod \"opendatahub-operator-controller-manager-557ddcc9b5-whk5m\" (UID: \"a774d71b-e43c-4680-a5ba-3bd61ec58ed5\") " pod="opendatahub/opendatahub-operator-controller-manager-557ddcc9b5-whk5m"
Jul 06 14:28:52.318920 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:52.318756    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a774d71b-e43c-4680-a5ba-3bd61ec58ed5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-557ddcc9b5-whk5m\" (UID: \"a774d71b-e43c-4680-a5ba-3bd61ec58ed5\") " pod="opendatahub/opendatahub-operator-controller-manager-557ddcc9b5-whk5m"
Jul 06 14:28:52.318920 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:52.318804    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a774d71b-e43c-4680-a5ba-3bd61ec58ed5-manifests\") pod \"opendatahub-operator-controller-manager-557ddcc9b5-whk5m\" (UID: \"a774d71b-e43c-4680-a5ba-3bd61ec58ed5\") " pod="opendatahub/opendatahub-operator-controller-manager-557ddcc9b5-whk5m"
Jul 06 14:28:52.318920 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:52.318852    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a774d71b-e43c-4680-a5ba-3bd61ec58ed5-tmp\") pod \"opendatahub-operator-controller-manager-557ddcc9b5-whk5m\" (UID: \"a774d71b-e43c-4680-a5ba-3bd61ec58ed5\") " pod="opendatahub/opendatahub-operator-controller-manager-557ddcc9b5-whk5m"
Jul 06 14:28:52.318920 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:52.318912    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw4vl\" (UniqueName: \"kubernetes.io/projected/a774d71b-e43c-4680-a5ba-3bd61ec58ed5-kube-api-access-hw4vl\") pod \"opendatahub-operator-controller-manager-557ddcc9b5-whk5m\" (UID: \"a774d71b-e43c-4680-a5ba-3bd61ec58ed5\") " pod="opendatahub/opendatahub-operator-controller-manager-557ddcc9b5-whk5m"
Jul 06 14:28:52.319261 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:52.319236    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a774d71b-e43c-4680-a5ba-3bd61ec58ed5-manifests\") pod \"opendatahub-operator-controller-manager-557ddcc9b5-whk5m\" (UID: \"a774d71b-e43c-4680-a5ba-3bd61ec58ed5\") " pod="opendatahub/opendatahub-operator-controller-manager-557ddcc9b5-whk5m"
Jul 06 14:28:52.321131 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:52.321108    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a774d71b-e43c-4680-a5ba-3bd61ec58ed5-tmp\") pod \"opendatahub-operator-controller-manager-557ddcc9b5-whk5m\" (UID: \"a774d71b-e43c-4680-a5ba-3bd61ec58ed5\") " pod="opendatahub/opendatahub-operator-controller-manager-557ddcc9b5-whk5m"
Jul 06 14:28:52.321296 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:52.321218    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a774d71b-e43c-4680-a5ba-3bd61ec58ed5-webhook-cert\") pod \"opendatahub-operator-controller-manager-557ddcc9b5-whk5m\" (UID: \"a774d71b-e43c-4680-a5ba-3bd61ec58ed5\") " pod="opendatahub/opendatahub-operator-controller-manager-557ddcc9b5-whk5m"
Jul 06 14:28:52.321390 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:52.321324    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a774d71b-e43c-4680-a5ba-3bd61ec58ed5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-557ddcc9b5-whk5m\" (UID: \"a774d71b-e43c-4680-a5ba-3bd61ec58ed5\") " pod="opendatahub/opendatahub-operator-controller-manager-557ddcc9b5-whk5m"
Jul 06 14:28:52.326927 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:52.326903    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hw4vl\" (UniqueName: \"kubernetes.io/projected/a774d71b-e43c-4680-a5ba-3bd61ec58ed5-kube-api-access-hw4vl\") pod \"opendatahub-operator-controller-manager-557ddcc9b5-whk5m\" (UID: \"a774d71b-e43c-4680-a5ba-3bd61ec58ed5\") " pod="opendatahub/opendatahub-operator-controller-manager-557ddcc9b5-whk5m"
Jul 06 14:28:52.514078 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:52.513990    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-557ddcc9b5-whk5m"
Jul 06 14:28:52.660095 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:52.660066    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-557ddcc9b5-whk5m"]
Jul 06 14:28:52.663239 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:28:52.663200    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda774d71b_e43c_4680_a5ba_3bd61ec58ed5.slice/crio-5d15b8f3a453094f610b54663b0afefdf74e260d301e3aa0b580f29600a94039 WatchSource:0}: Error finding container 5d15b8f3a453094f610b54663b0afefdf74e260d301e3aa0b580f29600a94039: Status 404 returned error can't find the container with id 5d15b8f3a453094f610b54663b0afefdf74e260d301e3aa0b580f29600a94039
Jul 06 14:28:53.541826 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:53.541787    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-557ddcc9b5-whk5m" event={"ID":"a774d71b-e43c-4680-a5ba-3bd61ec58ed5","Type":"ContainerStarted","Data":"5d15b8f3a453094f610b54663b0afefdf74e260d301e3aa0b580f29600a94039"}
Jul 06 14:28:56.557401 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:56.557332    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-557ddcc9b5-whk5m" event={"ID":"a774d71b-e43c-4680-a5ba-3bd61ec58ed5","Type":"ContainerStarted","Data":"7b1ef49fe64bb87ffc2eda9e2f3f75b4769331b78381ce271ac8b3fc4babec84"}
Jul 06 14:28:57.563359 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:57.563306    2565 generic.go:356] "Generic (PLEG): container finished" podID="a774d71b-e43c-4680-a5ba-3bd61ec58ed5" containerID="7b1ef49fe64bb87ffc2eda9e2f3f75b4769331b78381ce271ac8b3fc4babec84" exitCode=0
Jul 06 14:28:57.563748 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:57.563385    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-557ddcc9b5-whk5m" event={"ID":"a774d71b-e43c-4680-a5ba-3bd61ec58ed5","Type":"ContainerDied","Data":"7b1ef49fe64bb87ffc2eda9e2f3f75b4769331b78381ce271ac8b3fc4babec84"}
Jul 06 14:28:58.570270 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:58.570233    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-557ddcc9b5-whk5m" event={"ID":"a774d71b-e43c-4680-a5ba-3bd61ec58ed5","Type":"ContainerStarted","Data":"989c3a36eccef43822f2d2c7a40d6debb5096707aafe76f63c5e179449decbc6"}
Jul 06 14:28:58.570688 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:58.570371    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-557ddcc9b5-whk5m"
Jul 06 14:28:58.596590 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:28:58.596537    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-557ddcc9b5-whk5m" podStartSLOduration=2.222370348 podStartE2EDuration="6.596521987s" totalImagesPullingTime="3.319332974s" totalInitContainerRuntime="1.054818665s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:28:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:28:58.596133051 +0000 UTC m=+341.774782098" watchObservedRunningTime="2026-07-06 14:28:58.596521987 +0000 UTC m=+341.775171042"
Jul 06 14:29:09.577219 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:09.577144    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-557ddcc9b5-whk5m"
Jul 06 14:29:20.346928 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:20.346892    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-66c4cbf4f4-klj5b"]
Jul 06 14:29:20.350287 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:20.350271    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-66c4cbf4f4-klj5b"
Jul 06 14:29:20.354001 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:20.353985    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 06 14:29:20.356661 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:20.356638    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-7l925\""
Jul 06 14:29:20.356773 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:20.356639    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 06 14:29:20.356773 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:20.356671    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 06 14:29:20.388568 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:20.388543    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-66c4cbf4f4-klj5b"]
Jul 06 14:29:20.464500 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:20.464473    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e06ea3ab-bbe9-4f80-a127-5b58f5350556-cert\") pod \"lws-controller-manager-66c4cbf4f4-klj5b\" (UID: \"e06ea3ab-bbe9-4f80-a127-5b58f5350556\") " pod="openshift-lws-operator/lws-controller-manager-66c4cbf4f4-klj5b"
Jul 06 14:29:20.464675 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:20.464527    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e06ea3ab-bbe9-4f80-a127-5b58f5350556-manager-config\") pod \"lws-controller-manager-66c4cbf4f4-klj5b\" (UID: \"e06ea3ab-bbe9-4f80-a127-5b58f5350556\") " pod="openshift-lws-operator/lws-controller-manager-66c4cbf4f4-klj5b"
Jul 06 14:29:20.464675 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:20.464565    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e06ea3ab-bbe9-4f80-a127-5b58f5350556-metrics-cert\") pod \"lws-controller-manager-66c4cbf4f4-klj5b\" (UID: \"e06ea3ab-bbe9-4f80-a127-5b58f5350556\") " pod="openshift-lws-operator/lws-controller-manager-66c4cbf4f4-klj5b"
Jul 06 14:29:20.464675 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:20.464663    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6z5b\" (UniqueName: \"kubernetes.io/projected/e06ea3ab-bbe9-4f80-a127-5b58f5350556-kube-api-access-j6z5b\") pod \"lws-controller-manager-66c4cbf4f4-klj5b\" (UID: \"e06ea3ab-bbe9-4f80-a127-5b58f5350556\") " pod="openshift-lws-operator/lws-controller-manager-66c4cbf4f4-klj5b"
Jul 06 14:29:20.565437 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:20.565400    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6z5b\" (UniqueName: \"kubernetes.io/projected/e06ea3ab-bbe9-4f80-a127-5b58f5350556-kube-api-access-j6z5b\") pod \"lws-controller-manager-66c4cbf4f4-klj5b\" (UID: \"e06ea3ab-bbe9-4f80-a127-5b58f5350556\") " pod="openshift-lws-operator/lws-controller-manager-66c4cbf4f4-klj5b"
Jul 06 14:29:20.565598 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:20.565459    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e06ea3ab-bbe9-4f80-a127-5b58f5350556-cert\") pod \"lws-controller-manager-66c4cbf4f4-klj5b\" (UID: \"e06ea3ab-bbe9-4f80-a127-5b58f5350556\") " pod="openshift-lws-operator/lws-controller-manager-66c4cbf4f4-klj5b"
Jul 06 14:29:20.565598 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:20.565492    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e06ea3ab-bbe9-4f80-a127-5b58f5350556-manager-config\") pod \"lws-controller-manager-66c4cbf4f4-klj5b\" (UID: \"e06ea3ab-bbe9-4f80-a127-5b58f5350556\") " pod="openshift-lws-operator/lws-controller-manager-66c4cbf4f4-klj5b"
Jul 06 14:29:20.565598 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:20.565512    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e06ea3ab-bbe9-4f80-a127-5b58f5350556-metrics-cert\") pod \"lws-controller-manager-66c4cbf4f4-klj5b\" (UID: \"e06ea3ab-bbe9-4f80-a127-5b58f5350556\") " pod="openshift-lws-operator/lws-controller-manager-66c4cbf4f4-klj5b"
Jul 06 14:29:20.566211 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:20.566187    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e06ea3ab-bbe9-4f80-a127-5b58f5350556-manager-config\") pod \"lws-controller-manager-66c4cbf4f4-klj5b\" (UID: \"e06ea3ab-bbe9-4f80-a127-5b58f5350556\") " pod="openshift-lws-operator/lws-controller-manager-66c4cbf4f4-klj5b"
Jul 06 14:29:20.568262 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:20.568230    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e06ea3ab-bbe9-4f80-a127-5b58f5350556-metrics-cert\") pod \"lws-controller-manager-66c4cbf4f4-klj5b\" (UID: \"e06ea3ab-bbe9-4f80-a127-5b58f5350556\") " pod="openshift-lws-operator/lws-controller-manager-66c4cbf4f4-klj5b"
Jul 06 14:29:20.568372 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:20.568317    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e06ea3ab-bbe9-4f80-a127-5b58f5350556-cert\") pod \"lws-controller-manager-66c4cbf4f4-klj5b\" (UID: \"e06ea3ab-bbe9-4f80-a127-5b58f5350556\") " pod="openshift-lws-operator/lws-controller-manager-66c4cbf4f4-klj5b"
Jul 06 14:29:20.580833 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:20.580812    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6z5b\" (UniqueName: \"kubernetes.io/projected/e06ea3ab-bbe9-4f80-a127-5b58f5350556-kube-api-access-j6z5b\") pod \"lws-controller-manager-66c4cbf4f4-klj5b\" (UID: \"e06ea3ab-bbe9-4f80-a127-5b58f5350556\") " pod="openshift-lws-operator/lws-controller-manager-66c4cbf4f4-klj5b"
Jul 06 14:29:20.659948 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:20.659911    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-66c4cbf4f4-klj5b"
Jul 06 14:29:20.800852 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:20.800827    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-66c4cbf4f4-klj5b"]
Jul 06 14:29:20.803302 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:29:20.803271    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode06ea3ab_bbe9_4f80_a127_5b58f5350556.slice/crio-a220d00391d632817e840c0852366e1e333affb223f6aa08e721a3873d0e0943 WatchSource:0}: Error finding container a220d00391d632817e840c0852366e1e333affb223f6aa08e721a3873d0e0943: Status 404 returned error can't find the container with id a220d00391d632817e840c0852366e1e333affb223f6aa08e721a3873d0e0943
Jul 06 14:29:21.687040 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:21.687006    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-66c4cbf4f4-klj5b" event={"ID":"e06ea3ab-bbe9-4f80-a127-5b58f5350556","Type":"ContainerStarted","Data":"a220d00391d632817e840c0852366e1e333affb223f6aa08e721a3873d0e0943"}
Jul 06 14:29:21.853657 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:21.853622    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf456sjm"]
Jul 06 14:29:21.856679 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:21.856664    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf456sjm"
Jul 06 14:29:21.867640 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:21.867621    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 06 14:29:21.869620 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:21.869599    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 06 14:29:21.869889 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:21.869874    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 06 14:29:21.872260 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:21.872243    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-ztdvf\""
Jul 06 14:29:21.953535 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:21.953466    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf456sjm"]
Jul 06 14:29:21.980058 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:21.980034    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dad63f33-db42-439e-b9ac-4fa5b9eef818-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf456sjm\" (UID: \"dad63f33-db42-439e-b9ac-4fa5b9eef818\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf456sjm"
Jul 06 14:29:21.980183 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:21.980070    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dad63f33-db42-439e-b9ac-4fa5b9eef818-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf456sjm\" (UID: \"dad63f33-db42-439e-b9ac-4fa5b9eef818\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf456sjm"
Jul 06 14:29:21.980183 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:21.980092    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dad63f33-db42-439e-b9ac-4fa5b9eef818-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf456sjm\" (UID: \"dad63f33-db42-439e-b9ac-4fa5b9eef818\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf456sjm"
Jul 06 14:29:21.980183 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:21.980124    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dad63f33-db42-439e-b9ac-4fa5b9eef818-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf456sjm\" (UID: \"dad63f33-db42-439e-b9ac-4fa5b9eef818\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf456sjm"
Jul 06 14:29:21.980183 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:21.980175    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96jmc\" (UniqueName: \"kubernetes.io/projected/dad63f33-db42-439e-b9ac-4fa5b9eef818-kube-api-access-96jmc\") pod \"data-science-gateway-data-science-gateway-class-6576859cf456sjm\" (UID: \"dad63f33-db42-439e-b9ac-4fa5b9eef818\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf456sjm"
Jul 06 14:29:21.980322 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:21.980203    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dad63f33-db42-439e-b9ac-4fa5b9eef818-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf456sjm\" (UID: \"dad63f33-db42-439e-b9ac-4fa5b9eef818\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf456sjm"
Jul 06 14:29:21.980322 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:21.980268    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dad63f33-db42-439e-b9ac-4fa5b9eef818-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf456sjm\" (UID: \"dad63f33-db42-439e-b9ac-4fa5b9eef818\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf456sjm"
Jul 06 14:29:21.980322 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:21.980295    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dad63f33-db42-439e-b9ac-4fa5b9eef818-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf456sjm\" (UID: \"dad63f33-db42-439e-b9ac-4fa5b9eef818\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf456sjm"
Jul 06 14:29:21.980438 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:21.980329    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dad63f33-db42-439e-b9ac-4fa5b9eef818-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf456sjm\" (UID: \"dad63f33-db42-439e-b9ac-4fa5b9eef818\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf456sjm"
Jul 06 14:29:22.081272 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:22.081238    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dad63f33-db42-439e-b9ac-4fa5b9eef818-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf456sjm\" (UID: \"dad63f33-db42-439e-b9ac-4fa5b9eef818\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf456sjm"
Jul 06 14:29:22.081464 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:22.081288    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dad63f33-db42-439e-b9ac-4fa5b9eef818-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf456sjm\" (UID: \"dad63f33-db42-439e-b9ac-4fa5b9eef818\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf456sjm"
Jul 06 14:29:22.081464 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:22.081404    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dad63f33-db42-439e-b9ac-4fa5b9eef818-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf456sjm\" (UID: \"dad63f33-db42-439e-b9ac-4fa5b9eef818\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf456sjm"
Jul 06 14:29:22.081553 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:22.081486    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dad63f33-db42-439e-b9ac-4fa5b9eef818-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf456sjm\" (UID: \"dad63f33-db42-439e-b9ac-4fa5b9eef818\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf456sjm"
Jul 06 14:29:22.081553 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:22.081537    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dad63f33-db42-439e-b9ac-4fa5b9eef818-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf456sjm\" (UID: \"dad63f33-db42-439e-b9ac-4fa5b9eef818\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf456sjm"
Jul 06 14:29:22.081656 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:22.081598    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dad63f33-db42-439e-b9ac-4fa5b9eef818-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf456sjm\" (UID: \"dad63f33-db42-439e-b9ac-4fa5b9eef818\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf456sjm"
Jul 06 14:29:22.081656 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:22.081645    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dad63f33-db42-439e-b9ac-4fa5b9eef818-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf456sjm\" (UID: \"dad63f33-db42-439e-b9ac-4fa5b9eef818\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf456sjm"
Jul 06 14:29:22.081760 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:22.081682    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dad63f33-db42-439e-b9ac-4fa5b9eef818-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf456sjm\" (UID: \"dad63f33-db42-439e-b9ac-4fa5b9eef818\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf456sjm"
Jul 06 14:29:22.081760 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:22.081703    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dad63f33-db42-439e-b9ac-4fa5b9eef818-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf456sjm\" (UID: \"dad63f33-db42-439e-b9ac-4fa5b9eef818\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf456sjm"
Jul 06 14:29:22.081760 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:22.081744    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dad63f33-db42-439e-b9ac-4fa5b9eef818-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf456sjm\" (UID: \"dad63f33-db42-439e-b9ac-4fa5b9eef818\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf456sjm"
Jul 06 14:29:22.081760 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:22.081755    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96jmc\" (UniqueName: \"kubernetes.io/projected/dad63f33-db42-439e-b9ac-4fa5b9eef818-kube-api-access-96jmc\") pod \"data-science-gateway-data-science-gateway-class-6576859cf456sjm\" (UID: \"dad63f33-db42-439e-b9ac-4fa5b9eef818\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf456sjm"
Jul 06 14:29:22.082114 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:22.082089    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dad63f33-db42-439e-b9ac-4fa5b9eef818-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf456sjm\" (UID: \"dad63f33-db42-439e-b9ac-4fa5b9eef818\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf456sjm"
Jul 06 14:29:22.082205 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:22.082160    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dad63f33-db42-439e-b9ac-4fa5b9eef818-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf456sjm\" (UID: \"dad63f33-db42-439e-b9ac-4fa5b9eef818\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf456sjm"
Jul 06 14:29:22.082258 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:22.082240    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dad63f33-db42-439e-b9ac-4fa5b9eef818-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf456sjm\" (UID: \"dad63f33-db42-439e-b9ac-4fa5b9eef818\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf456sjm"
Jul 06 14:29:22.084044 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:22.084022    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dad63f33-db42-439e-b9ac-4fa5b9eef818-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf456sjm\" (UID: \"dad63f33-db42-439e-b9ac-4fa5b9eef818\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf456sjm"
Jul 06 14:29:22.084137 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:22.084022    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dad63f33-db42-439e-b9ac-4fa5b9eef818-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf456sjm\" (UID: \"dad63f33-db42-439e-b9ac-4fa5b9eef818\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf456sjm"
Jul 06 14:29:22.091500 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:22.091481    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-96jmc\" (UniqueName: \"kubernetes.io/projected/dad63f33-db42-439e-b9ac-4fa5b9eef818-kube-api-access-96jmc\") pod \"data-science-gateway-data-science-gateway-class-6576859cf456sjm\" (UID: \"dad63f33-db42-439e-b9ac-4fa5b9eef818\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf456sjm"
Jul 06 14:29:22.097395 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:22.097377    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dad63f33-db42-439e-b9ac-4fa5b9eef818-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf456sjm\" (UID: \"dad63f33-db42-439e-b9ac-4fa5b9eef818\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf456sjm"
Jul 06 14:29:22.166542 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:22.166513    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf456sjm"
Jul 06 14:29:22.330321 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:22.330293    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf456sjm"]
Jul 06 14:29:22.331043 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:29:22.331020    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddad63f33_db42_439e_b9ac_4fa5b9eef818.slice/crio-a1d3250470c71a1e3ff7f4fac0f59389431758b64a051fe8afe80e0924bb9d66 WatchSource:0}: Error finding container a1d3250470c71a1e3ff7f4fac0f59389431758b64a051fe8afe80e0924bb9d66: Status 404 returned error can't find the container with id a1d3250470c71a1e3ff7f4fac0f59389431758b64a051fe8afe80e0924bb9d66
Jul 06 14:29:22.692184 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:22.692152    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf456sjm" event={"ID":"dad63f33-db42-439e-b9ac-4fa5b9eef818","Type":"ContainerStarted","Data":"a1d3250470c71a1e3ff7f4fac0f59389431758b64a051fe8afe80e0924bb9d66"}
Jul 06 14:29:23.361590 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:23.361560    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-gd6t8"]
Jul 06 14:29:23.364052 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:23.364032    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gd6t8"
Jul 06 14:29:23.367836 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:23.367810    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 06 14:29:23.367976 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:23.367959    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-qsqs8\""
Jul 06 14:29:23.399600 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:23.399575    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-gd6t8"]
Jul 06 14:29:23.496358 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:23.496305    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2v92\" (UniqueName: \"kubernetes.io/projected/454203ee-b935-4ce1-9d37-1a23fb2e09c7-kube-api-access-p2v92\") pod \"llmisvc-controller-manager-777c6bd7d5-gd6t8\" (UID: \"454203ee-b935-4ce1-9d37-1a23fb2e09c7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gd6t8"
Jul 06 14:29:23.496548 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:23.496455    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/454203ee-b935-4ce1-9d37-1a23fb2e09c7-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-gd6t8\" (UID: \"454203ee-b935-4ce1-9d37-1a23fb2e09c7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gd6t8"
Jul 06 14:29:23.597399 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:23.597331    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/454203ee-b935-4ce1-9d37-1a23fb2e09c7-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-gd6t8\" (UID: \"454203ee-b935-4ce1-9d37-1a23fb2e09c7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gd6t8"
Jul 06 14:29:23.597554 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:23.597512    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2v92\" (UniqueName: \"kubernetes.io/projected/454203ee-b935-4ce1-9d37-1a23fb2e09c7-kube-api-access-p2v92\") pod \"llmisvc-controller-manager-777c6bd7d5-gd6t8\" (UID: \"454203ee-b935-4ce1-9d37-1a23fb2e09c7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gd6t8"
Jul 06 14:29:23.600062 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:23.600036    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/454203ee-b935-4ce1-9d37-1a23fb2e09c7-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-gd6t8\" (UID: \"454203ee-b935-4ce1-9d37-1a23fb2e09c7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gd6t8"
Jul 06 14:29:23.619835 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:23.619774    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2v92\" (UniqueName: \"kubernetes.io/projected/454203ee-b935-4ce1-9d37-1a23fb2e09c7-kube-api-access-p2v92\") pod \"llmisvc-controller-manager-777c6bd7d5-gd6t8\" (UID: \"454203ee-b935-4ce1-9d37-1a23fb2e09c7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gd6t8"
Jul 06 14:29:23.674532 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:23.674493    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gd6t8"
Jul 06 14:29:23.846216 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:23.846185    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-gd6t8"]
Jul 06 14:29:23.849083 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:29:23.849045    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod454203ee_b935_4ce1_9d37_1a23fb2e09c7.slice/crio-83902f4486e296bb2fdffa301bbbc1e11a0714a87bdb7fe706df5a3dd0d1fa05 WatchSource:0}: Error finding container 83902f4486e296bb2fdffa301bbbc1e11a0714a87bdb7fe706df5a3dd0d1fa05: Status 404 returned error can't find the container with id 83902f4486e296bb2fdffa301bbbc1e11a0714a87bdb7fe706df5a3dd0d1fa05
Jul 06 14:29:24.704613 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:24.704578    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gd6t8" event={"ID":"454203ee-b935-4ce1-9d37-1a23fb2e09c7","Type":"ContainerStarted","Data":"83902f4486e296bb2fdffa301bbbc1e11a0714a87bdb7fe706df5a3dd0d1fa05"}
Jul 06 14:29:25.493701 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:25.493663    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:29:25.493963 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:25.493734    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:29:25.493963 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:25.493763    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:29:25.711584 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:25.711550    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf456sjm" event={"ID":"dad63f33-db42-439e-b9ac-4fa5b9eef818","Type":"ContainerStarted","Data":"42b25a8f9165dce94bd05b616f1f077d4fa0778bbcf420a7622781f6ac062e03"}
Jul 06 14:29:25.757078 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:25.756952    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf456sjm" podStartSLOduration=1.596542641 podStartE2EDuration="4.756930511s" totalImagesPullingTime="3.16038787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:29:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:29:25.75497178 +0000 UTC m=+368.933620830" watchObservedRunningTime="2026-07-06 14:29:25.756930511 +0000 UTC m=+368.935579559"
Jul 06 14:29:26.167690 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:26.167643    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf456sjm"
Jul 06 14:29:26.172831 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:26.172805    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf456sjm"
Jul 06 14:29:26.716944 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:26.716913    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf456sjm"
Jul 06 14:29:26.718080 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:26.718059    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf456sjm"
Jul 06 14:29:29.733681 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:29.733645    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gd6t8" event={"ID":"454203ee-b935-4ce1-9d37-1a23fb2e09c7","Type":"ContainerStarted","Data":"b703807301f59656d33fb3f18e3d4e3362285769483a96058bdaa550d68184ea"}
Jul 06 14:29:29.734151 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:29.733810    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gd6t8"
Jul 06 14:29:33.752536 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:33.752500    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-66c4cbf4f4-klj5b" event={"ID":"e06ea3ab-bbe9-4f80-a127-5b58f5350556","Type":"ContainerStarted","Data":"cffcf64afd9232661a82582d929fc12d964f24921189c16430139d2465786314"}
Jul 06 14:29:33.753008 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:33.752626    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-66c4cbf4f4-klj5b"
Jul 06 14:29:33.769660 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:33.769607    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gd6t8" podStartSLOduration=5.977522855 podStartE2EDuration="10.769589468s" totalImagesPullingTime="4.792066613s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:29:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:29:29.755224447 +0000 UTC m=+372.933873493" watchObservedRunningTime="2026-07-06 14:29:33.769589468 +0000 UTC m=+376.948238515"
Jul 06 14:29:33.770483 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:33.770445    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-66c4cbf4f4-klj5b" podStartSLOduration=0.978226677 podStartE2EDuration="13.770432412s" totalImagesPullingTime="12.792205735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:29:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:29:33.768723877 +0000 UTC m=+376.947372923" watchObservedRunningTime="2026-07-06 14:29:33.770432412 +0000 UTC m=+376.949081458"
Jul 06 14:29:44.759826 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:29:44.759795    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-66c4cbf4f4-klj5b"
Jul 06 14:30:00.740743 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:00.740715    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gd6t8"
Jul 06 14:30:12.792480 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:12.792441    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xqxqr"]
Jul 06 14:30:12.794920 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:12.794899    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xqxqr"
Jul 06 14:30:12.796886 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:12.796865    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-6mkr7\""
Jul 06 14:30:12.797390 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:12.797369    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 14:30:12.797479 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:12.797417    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 14:30:12.814924 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:12.814898    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xqxqr"]
Jul 06 14:30:12.843530 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:12.843498    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hr427\" (UniqueName: \"kubernetes.io/projected/5fc6480a-41d7-48ef-862d-95f1f710a221-kube-api-access-hr427\") pod \"kuadrant-operator-catalog-xqxqr\" (UID: \"5fc6480a-41d7-48ef-862d-95f1f710a221\") " pod="kuadrant-system/kuadrant-operator-catalog-xqxqr"
Jul 06 14:30:12.944429 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:12.944400    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hr427\" (UniqueName: \"kubernetes.io/projected/5fc6480a-41d7-48ef-862d-95f1f710a221-kube-api-access-hr427\") pod \"kuadrant-operator-catalog-xqxqr\" (UID: \"5fc6480a-41d7-48ef-862d-95f1f710a221\") " pod="kuadrant-system/kuadrant-operator-catalog-xqxqr"
Jul 06 14:30:12.959711 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:12.959680    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hr427\" (UniqueName: \"kubernetes.io/projected/5fc6480a-41d7-48ef-862d-95f1f710a221-kube-api-access-hr427\") pod \"kuadrant-operator-catalog-xqxqr\" (UID: \"5fc6480a-41d7-48ef-862d-95f1f710a221\") " pod="kuadrant-system/kuadrant-operator-catalog-xqxqr"
Jul 06 14:30:13.103965 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:13.103868    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xqxqr"
Jul 06 14:30:13.119587 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:13.119512    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xqxqr"]
Jul 06 14:30:13.236144 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:13.236106    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xqxqr"]
Jul 06 14:30:13.239973 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:30:13.239930    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fc6480a_41d7_48ef_862d_95f1f710a221.slice/crio-92aad9032550aec3717a671ca298ddb97fcfb3ede8123845d80b5cf2b8abcb21 WatchSource:0}: Error finding container 92aad9032550aec3717a671ca298ddb97fcfb3ede8123845d80b5cf2b8abcb21: Status 404 returned error can't find the container with id 92aad9032550aec3717a671ca298ddb97fcfb3ede8123845d80b5cf2b8abcb21
Jul 06 14:30:13.331171 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:13.331131    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-x84ml"]
Jul 06 14:30:13.334145 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:13.334130    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-x84ml"
Jul 06 14:30:13.344768 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:13.344744    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-x84ml"]
Jul 06 14:30:13.347625 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:13.347605    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9znz\" (UniqueName: \"kubernetes.io/projected/f619aa20-51b7-4f7e-a26d-993b9dcff70f-kube-api-access-d9znz\") pod \"kuadrant-operator-catalog-x84ml\" (UID: \"f619aa20-51b7-4f7e-a26d-993b9dcff70f\") " pod="kuadrant-system/kuadrant-operator-catalog-x84ml"
Jul 06 14:30:13.448478 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:13.448452    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9znz\" (UniqueName: \"kubernetes.io/projected/f619aa20-51b7-4f7e-a26d-993b9dcff70f-kube-api-access-d9znz\") pod \"kuadrant-operator-catalog-x84ml\" (UID: \"f619aa20-51b7-4f7e-a26d-993b9dcff70f\") " pod="kuadrant-system/kuadrant-operator-catalog-x84ml"
Jul 06 14:30:13.459198 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:13.459175    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9znz\" (UniqueName: \"kubernetes.io/projected/f619aa20-51b7-4f7e-a26d-993b9dcff70f-kube-api-access-d9znz\") pod \"kuadrant-operator-catalog-x84ml\" (UID: \"f619aa20-51b7-4f7e-a26d-993b9dcff70f\") " pod="kuadrant-system/kuadrant-operator-catalog-x84ml"
Jul 06 14:30:13.643654 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:13.643618    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-x84ml"
Jul 06 14:30:13.780850 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:13.780788    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-x84ml"]
Jul 06 14:30:13.785265 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:30:13.785237    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf619aa20_51b7_4f7e_a26d_993b9dcff70f.slice/crio-38e58a7225f555ceba1c35badde7bcb2813d95c3a87cfa9dfab4a7992b0bcc2c WatchSource:0}: Error finding container 38e58a7225f555ceba1c35badde7bcb2813d95c3a87cfa9dfab4a7992b0bcc2c: Status 404 returned error can't find the container with id 38e58a7225f555ceba1c35badde7bcb2813d95c3a87cfa9dfab4a7992b0bcc2c
Jul 06 14:30:13.935786 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:13.935752    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-x84ml" event={"ID":"f619aa20-51b7-4f7e-a26d-993b9dcff70f","Type":"ContainerStarted","Data":"38e58a7225f555ceba1c35badde7bcb2813d95c3a87cfa9dfab4a7992b0bcc2c"}
Jul 06 14:30:13.937010 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:13.936975    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xqxqr" event={"ID":"5fc6480a-41d7-48ef-862d-95f1f710a221","Type":"ContainerStarted","Data":"92aad9032550aec3717a671ca298ddb97fcfb3ede8123845d80b5cf2b8abcb21"}
Jul 06 14:30:15.956166 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:15.956132    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xqxqr" event={"ID":"5fc6480a-41d7-48ef-862d-95f1f710a221","Type":"ContainerStarted","Data":"3e04f0779f4ea3c2a62dc94202545927f15dd1c5e22f47a4d52909bc1d6f9e5b"}
Jul 06 14:30:15.956615 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:15.956170    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-xqxqr" podUID="5fc6480a-41d7-48ef-862d-95f1f710a221" containerName="registry-server" containerID="cri-o://3e04f0779f4ea3c2a62dc94202545927f15dd1c5e22f47a4d52909bc1d6f9e5b" gracePeriod=2
Jul 06 14:30:15.957599 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:15.957577    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-x84ml" event={"ID":"f619aa20-51b7-4f7e-a26d-993b9dcff70f","Type":"ContainerStarted","Data":"843adc476ab1452e4f98cfdd414afd7b08987100a146b3317df54775d25959ca"}
Jul 06 14:30:15.973447 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:15.973378    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-xqxqr" podStartSLOduration=1.9600971870000001 podStartE2EDuration="3.973320673s" totalImagesPullingTime="2.013223486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:30:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:30:15.971219689 +0000 UTC m=+419.149868735" watchObservedRunningTime="2026-07-06 14:30:15.973320673 +0000 UTC m=+419.151969718"
Jul 06 14:30:15.992581 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:15.992531    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-x84ml" podStartSLOduration=1.5211331860000001 podStartE2EDuration="2.992513582s" totalImagesPullingTime="1.471380396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:30:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:30:15.990799448 +0000 UTC m=+419.169448494" watchObservedRunningTime="2026-07-06 14:30:15.992513582 +0000 UTC m=+419.171162627"
Jul 06 14:30:16.205667 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:16.205641    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xqxqr"
Jul 06 14:30:16.273731 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:16.273655    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hr427\" (UniqueName: \"kubernetes.io/projected/5fc6480a-41d7-48ef-862d-95f1f710a221-kube-api-access-hr427\") pod \"5fc6480a-41d7-48ef-862d-95f1f710a221\" (UID: \"5fc6480a-41d7-48ef-862d-95f1f710a221\") "
Jul 06 14:30:16.275784 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:16.275753    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fc6480a-41d7-48ef-862d-95f1f710a221-kube-api-access-hr427" (OuterVolumeSpecName: "kube-api-access-hr427") pod "5fc6480a-41d7-48ef-862d-95f1f710a221" (UID: "5fc6480a-41d7-48ef-862d-95f1f710a221"). InnerVolumeSpecName "kube-api-access-hr427". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:30:16.375044 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:16.375008    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hr427\" (UniqueName: \"kubernetes.io/projected/5fc6480a-41d7-48ef-862d-95f1f710a221-kube-api-access-hr427\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:30:16.964260 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:16.964228    2565 generic.go:356] "Generic (PLEG): container finished" podID="5fc6480a-41d7-48ef-862d-95f1f710a221" containerID="3e04f0779f4ea3c2a62dc94202545927f15dd1c5e22f47a4d52909bc1d6f9e5b" exitCode=0
Jul 06 14:30:16.964667 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:16.964274    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xqxqr"
Jul 06 14:30:16.964667 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:16.964314    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xqxqr" event={"ID":"5fc6480a-41d7-48ef-862d-95f1f710a221","Type":"ContainerDied","Data":"3e04f0779f4ea3c2a62dc94202545927f15dd1c5e22f47a4d52909bc1d6f9e5b"}
Jul 06 14:30:16.964667 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:16.964382    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xqxqr" event={"ID":"5fc6480a-41d7-48ef-862d-95f1f710a221","Type":"ContainerDied","Data":"92aad9032550aec3717a671ca298ddb97fcfb3ede8123845d80b5cf2b8abcb21"}
Jul 06 14:30:16.964667 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:16.964409    2565 scope.go:117] "RemoveContainer" containerID="3e04f0779f4ea3c2a62dc94202545927f15dd1c5e22f47a4d52909bc1d6f9e5b"
Jul 06 14:30:16.974299 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:16.974284    2565 scope.go:117] "RemoveContainer" containerID="3e04f0779f4ea3c2a62dc94202545927f15dd1c5e22f47a4d52909bc1d6f9e5b"
Jul 06 14:30:16.974583 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:30:16.974564    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e04f0779f4ea3c2a62dc94202545927f15dd1c5e22f47a4d52909bc1d6f9e5b\": container with ID starting with 3e04f0779f4ea3c2a62dc94202545927f15dd1c5e22f47a4d52909bc1d6f9e5b not found: ID does not exist" containerID="3e04f0779f4ea3c2a62dc94202545927f15dd1c5e22f47a4d52909bc1d6f9e5b"
Jul 06 14:30:16.974658 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:16.974590    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e04f0779f4ea3c2a62dc94202545927f15dd1c5e22f47a4d52909bc1d6f9e5b"} err="failed to get container status \"3e04f0779f4ea3c2a62dc94202545927f15dd1c5e22f47a4d52909bc1d6f9e5b\": rpc error: code = NotFound desc = could not find container \"3e04f0779f4ea3c2a62dc94202545927f15dd1c5e22f47a4d52909bc1d6f9e5b\": container with ID starting with 3e04f0779f4ea3c2a62dc94202545927f15dd1c5e22f47a4d52909bc1d6f9e5b not found: ID does not exist"
Jul 06 14:30:16.985458 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:16.985432    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xqxqr"]
Jul 06 14:30:16.987149 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:16.987131    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xqxqr"]
Jul 06 14:30:17.954035 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:17.954007    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fc6480a-41d7-48ef-862d-95f1f710a221" path="/var/lib/kubelet/pods/5fc6480a-41d7-48ef-862d-95f1f710a221/volumes"
Jul 06 14:30:23.644031 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:23.643991    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-x84ml"
Jul 06 14:30:23.644474 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:23.644055    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-x84ml"
Jul 06 14:30:23.667055 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:23.667030    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-x84ml"
Jul 06 14:30:24.015454 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:24.015418    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-x84ml"
Jul 06 14:30:39.215932 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:39.215850    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-mr2n7"]
Jul 06 14:30:39.216298 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:39.216256    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fc6480a-41d7-48ef-862d-95f1f710a221" containerName="registry-server"
Jul 06 14:30:39.216298 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:39.216269    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fc6480a-41d7-48ef-862d-95f1f710a221" containerName="registry-server"
Jul 06 14:30:39.216386 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:39.216363    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fc6480a-41d7-48ef-862d-95f1f710a221" containerName="registry-server"
Jul 06 14:30:39.220623 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:39.220607    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mr2n7"
Jul 06 14:30:39.222565 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:39.222529    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 06 14:30:39.222565 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:39.222562    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-fcc82\""
Jul 06 14:30:39.231532 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:39.231511    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-mr2n7"]
Jul 06 14:30:39.282179 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:39.282142    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcbnn\" (UniqueName: \"kubernetes.io/projected/3d290cb8-d34c-4089-bd40-b4fec2830544-kube-api-access-kcbnn\") pod \"dns-operator-controller-manager-864dd78c4c-mr2n7\" (UID: \"3d290cb8-d34c-4089-bd40-b4fec2830544\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mr2n7"
Jul 06 14:30:39.383618 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:39.383591    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcbnn\" (UniqueName: \"kubernetes.io/projected/3d290cb8-d34c-4089-bd40-b4fec2830544-kube-api-access-kcbnn\") pod \"dns-operator-controller-manager-864dd78c4c-mr2n7\" (UID: \"3d290cb8-d34c-4089-bd40-b4fec2830544\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mr2n7"
Jul 06 14:30:39.395160 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:39.395135    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcbnn\" (UniqueName: \"kubernetes.io/projected/3d290cb8-d34c-4089-bd40-b4fec2830544-kube-api-access-kcbnn\") pod \"dns-operator-controller-manager-864dd78c4c-mr2n7\" (UID: \"3d290cb8-d34c-4089-bd40-b4fec2830544\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mr2n7"
Jul 06 14:30:39.530477 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:39.530404    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mr2n7"
Jul 06 14:30:39.665828 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:39.665803    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-mr2n7"]
Jul 06 14:30:39.667961 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:30:39.667930    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d290cb8_d34c_4089_bd40_b4fec2830544.slice/crio-a755c4affe752e404be3aabd9bd8d964ee0bbceec809e34dc2838b7594386858 WatchSource:0}: Error finding container a755c4affe752e404be3aabd9bd8d964ee0bbceec809e34dc2838b7594386858: Status 404 returned error can't find the container with id a755c4affe752e404be3aabd9bd8d964ee0bbceec809e34dc2838b7594386858
Jul 06 14:30:40.066390 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:40.066357    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mr2n7" event={"ID":"3d290cb8-d34c-4089-bd40-b4fec2830544","Type":"ContainerStarted","Data":"a755c4affe752e404be3aabd9bd8d964ee0bbceec809e34dc2838b7594386858"}
Jul 06 14:30:42.078289 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:42.078256    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mr2n7" event={"ID":"3d290cb8-d34c-4089-bd40-b4fec2830544","Type":"ContainerStarted","Data":"dd2d422a6eaed76e6531eebe31400f81a44fe280aae01dd3f3f0903956bc470b"}
Jul 06 14:30:42.078752 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:42.078318    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mr2n7"
Jul 06 14:30:42.094806 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:42.094760    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mr2n7" podStartSLOduration=1.3477664950000001 podStartE2EDuration="3.094743096s" totalImagesPullingTime="1.746976601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:30:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:30:42.093116048 +0000 UTC m=+445.271765093" watchObservedRunningTime="2026-07-06 14:30:42.094743096 +0000 UTC m=+445.273392146"
Jul 06 14:30:47.561472 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:47.561433    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cff4k"]
Jul 06 14:30:47.568333 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:47.568309    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cff4k"
Jul 06 14:30:47.570392 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:47.570371    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-l6jr9\""
Jul 06 14:30:47.578091 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:47.578068    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cff4k"]
Jul 06 14:30:47.659180 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:47.659136    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpzhq\" (UniqueName: \"kubernetes.io/projected/21743cb6-29b4-44f8-8c2e-7bb29bcb7a16-kube-api-access-dpzhq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cff4k\" (UID: \"21743cb6-29b4-44f8-8c2e-7bb29bcb7a16\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cff4k"
Jul 06 14:30:47.659403 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:47.659205    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/21743cb6-29b4-44f8-8c2e-7bb29bcb7a16-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cff4k\" (UID: \"21743cb6-29b4-44f8-8c2e-7bb29bcb7a16\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cff4k"
Jul 06 14:30:47.760791 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:47.760752    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpzhq\" (UniqueName: \"kubernetes.io/projected/21743cb6-29b4-44f8-8c2e-7bb29bcb7a16-kube-api-access-dpzhq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cff4k\" (UID: \"21743cb6-29b4-44f8-8c2e-7bb29bcb7a16\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cff4k"
Jul 06 14:30:47.760956 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:47.760823    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/21743cb6-29b4-44f8-8c2e-7bb29bcb7a16-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cff4k\" (UID: \"21743cb6-29b4-44f8-8c2e-7bb29bcb7a16\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cff4k"
Jul 06 14:30:47.761232 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:47.761212    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/21743cb6-29b4-44f8-8c2e-7bb29bcb7a16-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cff4k\" (UID: \"21743cb6-29b4-44f8-8c2e-7bb29bcb7a16\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cff4k"
Jul 06 14:30:47.768719 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:47.768698    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpzhq\" (UniqueName: \"kubernetes.io/projected/21743cb6-29b4-44f8-8c2e-7bb29bcb7a16-kube-api-access-dpzhq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cff4k\" (UID: \"21743cb6-29b4-44f8-8c2e-7bb29bcb7a16\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cff4k"
Jul 06 14:30:47.880099 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:47.880005    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cff4k"
Jul 06 14:30:48.022648 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:48.022620    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cff4k"]
Jul 06 14:30:48.025361 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:30:48.025322    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21743cb6_29b4_44f8_8c2e_7bb29bcb7a16.slice/crio-d0951f0b04e5588e845f7a30f0cf22d6d1b50a2396ff67a522c46277458fbb1a WatchSource:0}: Error finding container d0951f0b04e5588e845f7a30f0cf22d6d1b50a2396ff67a522c46277458fbb1a: Status 404 returned error can't find the container with id d0951f0b04e5588e845f7a30f0cf22d6d1b50a2396ff67a522c46277458fbb1a
Jul 06 14:30:48.109682 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:48.109647    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cff4k" event={"ID":"21743cb6-29b4-44f8-8c2e-7bb29bcb7a16","Type":"ContainerStarted","Data":"d0951f0b04e5588e845f7a30f0cf22d6d1b50a2396ff67a522c46277458fbb1a"}
Jul 06 14:30:51.342831 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:51.342799    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-xg6r7"]
Jul 06 14:30:51.346099 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:51.346081    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xg6r7"
Jul 06 14:30:51.347799 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:51.347779    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-cnf6m\""
Jul 06 14:30:51.355162 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:51.355141    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-xg6r7"]
Jul 06 14:30:51.507677 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:51.507648    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sd268\" (UniqueName: \"kubernetes.io/projected/2202a142-8ef8-4fbf-b9dd-1f35fb237b32-kube-api-access-sd268\") pod \"authorino-operator-75cc8d5cb7-xg6r7\" (UID: \"2202a142-8ef8-4fbf-b9dd-1f35fb237b32\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-xg6r7"
Jul 06 14:30:51.608791 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:51.608712    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sd268\" (UniqueName: \"kubernetes.io/projected/2202a142-8ef8-4fbf-b9dd-1f35fb237b32-kube-api-access-sd268\") pod \"authorino-operator-75cc8d5cb7-xg6r7\" (UID: \"2202a142-8ef8-4fbf-b9dd-1f35fb237b32\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-xg6r7"
Jul 06 14:30:51.617407 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:51.617367    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sd268\" (UniqueName: \"kubernetes.io/projected/2202a142-8ef8-4fbf-b9dd-1f35fb237b32-kube-api-access-sd268\") pod \"authorino-operator-75cc8d5cb7-xg6r7\" (UID: \"2202a142-8ef8-4fbf-b9dd-1f35fb237b32\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-xg6r7"
Jul 06 14:30:51.657888 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:51.657857    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xg6r7"
Jul 06 14:30:52.900970 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:52.900945    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-xg6r7"]
Jul 06 14:30:52.902635 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:30:52.902609    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2202a142_8ef8_4fbf_b9dd_1f35fb237b32.slice/crio-1af3d18cb84b92134793622dff1808095535aa7a650e9a6a24161dbb40e4c3de WatchSource:0}: Error finding container 1af3d18cb84b92134793622dff1808095535aa7a650e9a6a24161dbb40e4c3de: Status 404 returned error can't find the container with id 1af3d18cb84b92134793622dff1808095535aa7a650e9a6a24161dbb40e4c3de
Jul 06 14:30:53.085201 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:53.085121    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mr2n7"
Jul 06 14:30:53.141360 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:53.141299    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xg6r7" event={"ID":"2202a142-8ef8-4fbf-b9dd-1f35fb237b32","Type":"ContainerStarted","Data":"1af3d18cb84b92134793622dff1808095535aa7a650e9a6a24161dbb40e4c3de"}
Jul 06 14:30:53.142934 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:53.142910    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cff4k" event={"ID":"21743cb6-29b4-44f8-8c2e-7bb29bcb7a16","Type":"ContainerStarted","Data":"e7c9673c518f0ce42d12a553f876dcb5916ee58ca77f63a4fd09e41c7cbc4fa9"}
Jul 06 14:30:53.143057 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:53.143032    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cff4k"
Jul 06 14:30:53.163983 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:53.163933    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cff4k" podStartSLOduration=1.379880698 podStartE2EDuration="6.163916093s" totalImagesPullingTime="4.784035395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:30:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:30:53.162820841 +0000 UTC m=+456.341469887" watchObservedRunningTime="2026-07-06 14:30:53.163916093 +0000 UTC m=+456.342565141"
Jul 06 14:30:56.158709 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:56.158676    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xg6r7" event={"ID":"2202a142-8ef8-4fbf-b9dd-1f35fb237b32","Type":"ContainerStarted","Data":"a930190b50f0772d88a80e8701101d89f753ae996e95326a5c976a42fabde190"}
Jul 06 14:30:56.159114 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:56.158749    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xg6r7"
Jul 06 14:30:56.176515 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:30:56.176470    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xg6r7" podStartSLOduration=2.246448067 podStartE2EDuration="5.176455875s" totalImagesPullingTime="2.930007808s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:30:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:30:56.175888788 +0000 UTC m=+459.354537834" watchObservedRunningTime="2026-07-06 14:30:56.176455875 +0000 UTC m=+459.355104920"
Jul 06 14:31:04.149319 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:04.149281    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cff4k"
Jul 06 14:31:05.981445 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:05.981407    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cff4k"]
Jul 06 14:31:05.981905 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:05.981665    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cff4k" podUID="21743cb6-29b4-44f8-8c2e-7bb29bcb7a16" containerName="manager" containerID="cri-o://e7c9673c518f0ce42d12a553f876dcb5916ee58ca77f63a4fd09e41c7cbc4fa9" gracePeriod=2
Jul 06 14:31:05.995081 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:05.995050    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cff4k"]
Jul 06 14:31:06.050172 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:06.050141    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8p9fb"]
Jul 06 14:31:06.050750 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:06.050734    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21743cb6-29b4-44f8-8c2e-7bb29bcb7a16" containerName="manager"
Jul 06 14:31:06.050800 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:06.050753    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="21743cb6-29b4-44f8-8c2e-7bb29bcb7a16" containerName="manager"
Jul 06 14:31:06.050875 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:06.050864    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="21743cb6-29b4-44f8-8c2e-7bb29bcb7a16" containerName="manager"
Jul 06 14:31:06.053464 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:06.053446    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8p9fb"
Jul 06 14:31:06.062026 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:06.061999    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b8rnd"]
Jul 06 14:31:06.064804 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:06.064783    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b8rnd"
Jul 06 14:31:06.067510 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:06.067491    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-7dr4n\""
Jul 06 14:31:06.083976 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:06.083954    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8p9fb"]
Jul 06 14:31:06.097290 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:06.097265    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b8rnd"]
Jul 06 14:31:06.108914 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:31:06.108877    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cff4k\" is forbidden: User \"system:node:ip-10-0-138-90.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-90.ec2.internal' and this object" podUID="21743cb6-29b4-44f8-8c2e-7bb29bcb7a16" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cff4k"
Jul 06 14:31:06.140570 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:31:06.140527    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cff4k\" is forbidden: User \"system:node:ip-10-0-138-90.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-90.ec2.internal' and this object" podUID="21743cb6-29b4-44f8-8c2e-7bb29bcb7a16" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cff4k"
Jul 06 14:31:06.142954 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:06.142923    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qwmk\" (UniqueName: \"kubernetes.io/projected/07a90432-5b44-4dc3-921a-1aee51109dc9-kube-api-access-8qwmk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8p9fb\" (UID: \"07a90432-5b44-4dc3-921a-1aee51109dc9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8p9fb"
Jul 06 14:31:06.143103 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:06.142968    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/07a90432-5b44-4dc3-921a-1aee51109dc9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8p9fb\" (UID: \"07a90432-5b44-4dc3-921a-1aee51109dc9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8p9fb"
Jul 06 14:31:06.143103 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:06.143066    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8swv\" (UniqueName: \"kubernetes.io/projected/3cee5e9e-063a-4902-bf6b-c2ee206c0b78-kube-api-access-m8swv\") pod \"limitador-operator-controller-manager-859d7b78bd-b8rnd\" (UID: \"3cee5e9e-063a-4902-bf6b-c2ee206c0b78\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b8rnd"
Jul 06 14:31:06.209607 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:06.209569    2565 generic.go:356] "Generic (PLEG): container finished" podID="21743cb6-29b4-44f8-8c2e-7bb29bcb7a16" containerID="e7c9673c518f0ce42d12a553f876dcb5916ee58ca77f63a4fd09e41c7cbc4fa9" exitCode=0
Jul 06 14:31:06.238643 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:06.238589    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cff4k"
Jul 06 14:31:06.240511 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:31:06.240491    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cff4k\" is forbidden: User \"system:node:ip-10-0-138-90.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-90.ec2.internal' and this object" podUID="21743cb6-29b4-44f8-8c2e-7bb29bcb7a16" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cff4k"
Jul 06 14:31:06.243928 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:06.243909    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8swv\" (UniqueName: \"kubernetes.io/projected/3cee5e9e-063a-4902-bf6b-c2ee206c0b78-kube-api-access-m8swv\") pod \"limitador-operator-controller-manager-859d7b78bd-b8rnd\" (UID: \"3cee5e9e-063a-4902-bf6b-c2ee206c0b78\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b8rnd"
Jul 06 14:31:06.243994 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:06.243980    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qwmk\" (UniqueName: \"kubernetes.io/projected/07a90432-5b44-4dc3-921a-1aee51109dc9-kube-api-access-8qwmk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8p9fb\" (UID: \"07a90432-5b44-4dc3-921a-1aee51109dc9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8p9fb"
Jul 06 14:31:06.244032 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:06.244007    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/07a90432-5b44-4dc3-921a-1aee51109dc9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8p9fb\" (UID: \"07a90432-5b44-4dc3-921a-1aee51109dc9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8p9fb"
Jul 06 14:31:06.244440 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:06.244425    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/07a90432-5b44-4dc3-921a-1aee51109dc9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8p9fb\" (UID: \"07a90432-5b44-4dc3-921a-1aee51109dc9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8p9fb"
Jul 06 14:31:06.253494 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:06.253472    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qwmk\" (UniqueName: \"kubernetes.io/projected/07a90432-5b44-4dc3-921a-1aee51109dc9-kube-api-access-8qwmk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8p9fb\" (UID: \"07a90432-5b44-4dc3-921a-1aee51109dc9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8p9fb"
Jul 06 14:31:06.253623 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:06.253604    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8swv\" (UniqueName: \"kubernetes.io/projected/3cee5e9e-063a-4902-bf6b-c2ee206c0b78-kube-api-access-m8swv\") pod \"limitador-operator-controller-manager-859d7b78bd-b8rnd\" (UID: \"3cee5e9e-063a-4902-bf6b-c2ee206c0b78\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b8rnd"
Jul 06 14:31:06.345036 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:06.345005    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dpzhq\" (UniqueName: \"kubernetes.io/projected/21743cb6-29b4-44f8-8c2e-7bb29bcb7a16-kube-api-access-dpzhq\") pod \"21743cb6-29b4-44f8-8c2e-7bb29bcb7a16\" (UID: \"21743cb6-29b4-44f8-8c2e-7bb29bcb7a16\") "
Jul 06 14:31:06.345195 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:06.345106    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/21743cb6-29b4-44f8-8c2e-7bb29bcb7a16-extensions-socket-volume\") pod \"21743cb6-29b4-44f8-8c2e-7bb29bcb7a16\" (UID: \"21743cb6-29b4-44f8-8c2e-7bb29bcb7a16\") "
Jul 06 14:31:06.345589 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:06.345563    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21743cb6-29b4-44f8-8c2e-7bb29bcb7a16-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "21743cb6-29b4-44f8-8c2e-7bb29bcb7a16" (UID: "21743cb6-29b4-44f8-8c2e-7bb29bcb7a16"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:31:06.347040 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:06.347015    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21743cb6-29b4-44f8-8c2e-7bb29bcb7a16-kube-api-access-dpzhq" (OuterVolumeSpecName: "kube-api-access-dpzhq") pod "21743cb6-29b4-44f8-8c2e-7bb29bcb7a16" (UID: "21743cb6-29b4-44f8-8c2e-7bb29bcb7a16"). InnerVolumeSpecName "kube-api-access-dpzhq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:31:06.365172 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:06.365151    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8p9fb"
Jul 06 14:31:06.374008 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:06.373973    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b8rnd"
Jul 06 14:31:06.446036 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:06.445994    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dpzhq\" (UniqueName: \"kubernetes.io/projected/21743cb6-29b4-44f8-8c2e-7bb29bcb7a16-kube-api-access-dpzhq\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:31:06.446036 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:06.446033    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/21743cb6-29b4-44f8-8c2e-7bb29bcb7a16-extensions-socket-volume\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:31:06.511863 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:06.511829    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8p9fb"]
Jul 06 14:31:06.514384 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:31:06.514326    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07a90432_5b44_4dc3_921a_1aee51109dc9.slice/crio-d4a28323289e6a23dcc5fb9f1d2f22d42df260fa4b083ac7db65d5a1b233366c WatchSource:0}: Error finding container d4a28323289e6a23dcc5fb9f1d2f22d42df260fa4b083ac7db65d5a1b233366c: Status 404 returned error can't find the container with id d4a28323289e6a23dcc5fb9f1d2f22d42df260fa4b083ac7db65d5a1b233366c
Jul 06 14:31:06.529181 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:06.529159    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b8rnd"]
Jul 06 14:31:06.531514 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:31:06.531491    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cee5e9e_063a_4902_bf6b_c2ee206c0b78.slice/crio-2d7d6ffdef8e8890a3ea45331fbf15f71dc0c61fada1cdbf4dcaa285b3b0a3fe WatchSource:0}: Error finding container 2d7d6ffdef8e8890a3ea45331fbf15f71dc0c61fada1cdbf4dcaa285b3b0a3fe: Status 404 returned error can't find the container with id 2d7d6ffdef8e8890a3ea45331fbf15f71dc0c61fada1cdbf4dcaa285b3b0a3fe
Jul 06 14:31:07.166009 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:07.165984    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xg6r7"
Jul 06 14:31:07.167949 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:31:07.167917    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cff4k\" is forbidden: User \"system:node:ip-10-0-138-90.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-90.ec2.internal' and this object" podUID="21743cb6-29b4-44f8-8c2e-7bb29bcb7a16" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cff4k"
Jul 06 14:31:07.217460 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:07.217427    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8p9fb" event={"ID":"07a90432-5b44-4dc3-921a-1aee51109dc9","Type":"ContainerStarted","Data":"055baf48a4721b6ad331ad1b1a305485387ffcad3aacff7d75aed474aba37d95"}
Jul 06 14:31:07.217632 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:07.217487    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8p9fb" event={"ID":"07a90432-5b44-4dc3-921a-1aee51109dc9","Type":"ContainerStarted","Data":"d4a28323289e6a23dcc5fb9f1d2f22d42df260fa4b083ac7db65d5a1b233366c"}
Jul 06 14:31:07.217632 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:07.217615    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8p9fb"
Jul 06 14:31:07.218976 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:07.218950    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cff4k"
Jul 06 14:31:07.218976 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:07.218965    2565 scope.go:117] "RemoveContainer" containerID="e7c9673c518f0ce42d12a553f876dcb5916ee58ca77f63a4fd09e41c7cbc4fa9"
Jul 06 14:31:07.220870 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:07.220836    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b8rnd" event={"ID":"3cee5e9e-063a-4902-bf6b-c2ee206c0b78","Type":"ContainerStarted","Data":"2d7d6ffdef8e8890a3ea45331fbf15f71dc0c61fada1cdbf4dcaa285b3b0a3fe"}
Jul 06 14:31:07.242315 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:07.242115    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8p9fb" podStartSLOduration=1.242095516 podStartE2EDuration="1.242095516s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:31:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:31:07.240817808 +0000 UTC m=+470.419466854" watchObservedRunningTime="2026-07-06 14:31:07.242095516 +0000 UTC m=+470.420744566"
Jul 06 14:31:07.242751 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:31:07.242699    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cff4k\" is forbidden: User \"system:node:ip-10-0-138-90.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-90.ec2.internal' and this object" podUID="21743cb6-29b4-44f8-8c2e-7bb29bcb7a16" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cff4k"
Jul 06 14:31:07.244639 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:31:07.244610    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cff4k\" is forbidden: User \"system:node:ip-10-0-138-90.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-90.ec2.internal' and this object" podUID="21743cb6-29b4-44f8-8c2e-7bb29bcb7a16" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cff4k"
Jul 06 14:31:07.952241 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:31:07.952191    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cff4k\" is forbidden: User \"system:node:ip-10-0-138-90.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-90.ec2.internal' and this object" podUID="21743cb6-29b4-44f8-8c2e-7bb29bcb7a16" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cff4k"
Jul 06 14:31:07.957619 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:07.957587    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21743cb6-29b4-44f8-8c2e-7bb29bcb7a16" path="/var/lib/kubelet/pods/21743cb6-29b4-44f8-8c2e-7bb29bcb7a16/volumes"
Jul 06 14:31:08.227534 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:08.227451    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b8rnd" event={"ID":"3cee5e9e-063a-4902-bf6b-c2ee206c0b78","Type":"ContainerStarted","Data":"d351a27a41b5a135f83467c49d43ef2874b0e5fa76401a8902b02a80bd3cd66a"}
Jul 06 14:31:08.250138 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:08.250093    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b8rnd" podStartSLOduration=0.881328966 podStartE2EDuration="2.250080348s" totalImagesPullingTime="1.368751382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:31:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:31:08.24688227 +0000 UTC m=+471.425531316" watchObservedRunningTime="2026-07-06 14:31:08.250080348 +0000 UTC m=+471.428729394"
Jul 06 14:31:09.232534 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:09.232503    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b8rnd"
Jul 06 14:31:18.229590 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:18.229563    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8p9fb"
Jul 06 14:31:20.240398 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:20.240362    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b8rnd"
Jul 06 14:31:22.713583 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:22.713546    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8p9fb"]
Jul 06 14:31:22.713987 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:22.713765    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8p9fb" podUID="07a90432-5b44-4dc3-921a-1aee51109dc9" containerName="manager" containerID="cri-o://055baf48a4721b6ad331ad1b1a305485387ffcad3aacff7d75aed474aba37d95" gracePeriod=10
Jul 06 14:31:22.981649 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:22.981556    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xrbkx"]
Jul 06 14:31:22.986310 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:22.986287    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xrbkx"
Jul 06 14:31:23.009926 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:23.009898    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xrbkx"]
Jul 06 14:31:23.099269 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:23.099239    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5fc751f8-65da-4c48-9693-89f3585b4ea5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xrbkx\" (UID: \"5fc751f8-65da-4c48-9693-89f3585b4ea5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xrbkx"
Jul 06 14:31:23.099443 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:23.099406    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhp7b\" (UniqueName: \"kubernetes.io/projected/5fc751f8-65da-4c48-9693-89f3585b4ea5-kube-api-access-hhp7b\") pod \"kuadrant-operator-controller-manager-86878c769f-xrbkx\" (UID: \"5fc751f8-65da-4c48-9693-89f3585b4ea5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xrbkx"
Jul 06 14:31:23.199963 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:23.199932    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhp7b\" (UniqueName: \"kubernetes.io/projected/5fc751f8-65da-4c48-9693-89f3585b4ea5-kube-api-access-hhp7b\") pod \"kuadrant-operator-controller-manager-86878c769f-xrbkx\" (UID: \"5fc751f8-65da-4c48-9693-89f3585b4ea5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xrbkx"
Jul 06 14:31:23.200117 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:23.199977    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5fc751f8-65da-4c48-9693-89f3585b4ea5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xrbkx\" (UID: \"5fc751f8-65da-4c48-9693-89f3585b4ea5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xrbkx"
Jul 06 14:31:23.200396 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:23.200380    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5fc751f8-65da-4c48-9693-89f3585b4ea5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xrbkx\" (UID: \"5fc751f8-65da-4c48-9693-89f3585b4ea5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xrbkx"
Jul 06 14:31:23.208913 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:23.208880    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhp7b\" (UniqueName: \"kubernetes.io/projected/5fc751f8-65da-4c48-9693-89f3585b4ea5-kube-api-access-hhp7b\") pod \"kuadrant-operator-controller-manager-86878c769f-xrbkx\" (UID: \"5fc751f8-65da-4c48-9693-89f3585b4ea5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xrbkx"
Jul 06 14:31:23.298525 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:23.298432    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xrbkx"
Jul 06 14:31:23.434230 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:23.434141    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xrbkx"]
Jul 06 14:31:23.465303 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:31:23.465277    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fc751f8_65da_4c48_9693_89f3585b4ea5.slice/crio-1d3dabfaa5cdf0b66f5f40252a1465669b1f8e88bf8459ca2c2dbf1f8b400749 WatchSource:0}: Error finding container 1d3dabfaa5cdf0b66f5f40252a1465669b1f8e88bf8459ca2c2dbf1f8b400749: Status 404 returned error can't find the container with id 1d3dabfaa5cdf0b66f5f40252a1465669b1f8e88bf8459ca2c2dbf1f8b400749
Jul 06 14:31:23.561856 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:23.561834    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8p9fb"
Jul 06 14:31:23.704994 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:23.704967    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/07a90432-5b44-4dc3-921a-1aee51109dc9-extensions-socket-volume\") pod \"07a90432-5b44-4dc3-921a-1aee51109dc9\" (UID: \"07a90432-5b44-4dc3-921a-1aee51109dc9\") "
Jul 06 14:31:23.705174 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:23.705061    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8qwmk\" (UniqueName: \"kubernetes.io/projected/07a90432-5b44-4dc3-921a-1aee51109dc9-kube-api-access-8qwmk\") pod \"07a90432-5b44-4dc3-921a-1aee51109dc9\" (UID: \"07a90432-5b44-4dc3-921a-1aee51109dc9\") "
Jul 06 14:31:23.705380 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:23.705333    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07a90432-5b44-4dc3-921a-1aee51109dc9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "07a90432-5b44-4dc3-921a-1aee51109dc9" (UID: "07a90432-5b44-4dc3-921a-1aee51109dc9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:31:23.707061 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:23.707039    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07a90432-5b44-4dc3-921a-1aee51109dc9-kube-api-access-8qwmk" (OuterVolumeSpecName: "kube-api-access-8qwmk") pod "07a90432-5b44-4dc3-921a-1aee51109dc9" (UID: "07a90432-5b44-4dc3-921a-1aee51109dc9"). InnerVolumeSpecName "kube-api-access-8qwmk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:31:23.806637 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:23.806557    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/07a90432-5b44-4dc3-921a-1aee51109dc9-extensions-socket-volume\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:31:23.806637 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:23.806585    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8qwmk\" (UniqueName: \"kubernetes.io/projected/07a90432-5b44-4dc3-921a-1aee51109dc9-kube-api-access-8qwmk\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:31:24.306770 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:24.306737    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xrbkx" event={"ID":"5fc751f8-65da-4c48-9693-89f3585b4ea5","Type":"ContainerStarted","Data":"0b3e9cd224975102e68283ef0663bd752006177e820af2d47e5ecd36cc4226f6"}
Jul 06 14:31:24.306959 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:24.306801    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xrbkx"
Jul 06 14:31:24.306959 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:24.306825    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xrbkx" event={"ID":"5fc751f8-65da-4c48-9693-89f3585b4ea5","Type":"ContainerStarted","Data":"1d3dabfaa5cdf0b66f5f40252a1465669b1f8e88bf8459ca2c2dbf1f8b400749"}
Jul 06 14:31:24.308004 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:24.307975    2565 generic.go:356] "Generic (PLEG): container finished" podID="07a90432-5b44-4dc3-921a-1aee51109dc9" containerID="055baf48a4721b6ad331ad1b1a305485387ffcad3aacff7d75aed474aba37d95" exitCode=0
Jul 06 14:31:24.308128 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:24.308019    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8p9fb"
Jul 06 14:31:24.308128 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:24.308056    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8p9fb" event={"ID":"07a90432-5b44-4dc3-921a-1aee51109dc9","Type":"ContainerDied","Data":"055baf48a4721b6ad331ad1b1a305485387ffcad3aacff7d75aed474aba37d95"}
Jul 06 14:31:24.308128 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:24.308112    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8p9fb" event={"ID":"07a90432-5b44-4dc3-921a-1aee51109dc9","Type":"ContainerDied","Data":"d4a28323289e6a23dcc5fb9f1d2f22d42df260fa4b083ac7db65d5a1b233366c"}
Jul 06 14:31:24.308296 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:24.308144    2565 scope.go:117] "RemoveContainer" containerID="055baf48a4721b6ad331ad1b1a305485387ffcad3aacff7d75aed474aba37d95"
Jul 06 14:31:24.316819 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:24.316801    2565 scope.go:117] "RemoveContainer" containerID="055baf48a4721b6ad331ad1b1a305485387ffcad3aacff7d75aed474aba37d95"
Jul 06 14:31:24.317054 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:31:24.317036    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"055baf48a4721b6ad331ad1b1a305485387ffcad3aacff7d75aed474aba37d95\": container with ID starting with 055baf48a4721b6ad331ad1b1a305485387ffcad3aacff7d75aed474aba37d95 not found: ID does not exist" containerID="055baf48a4721b6ad331ad1b1a305485387ffcad3aacff7d75aed474aba37d95"
Jul 06 14:31:24.317101 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:24.317062    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"055baf48a4721b6ad331ad1b1a305485387ffcad3aacff7d75aed474aba37d95"} err="failed to get container status \"055baf48a4721b6ad331ad1b1a305485387ffcad3aacff7d75aed474aba37d95\": rpc error: code = NotFound desc = could not find container \"055baf48a4721b6ad331ad1b1a305485387ffcad3aacff7d75aed474aba37d95\": container with ID starting with 055baf48a4721b6ad331ad1b1a305485387ffcad3aacff7d75aed474aba37d95 not found: ID does not exist"
Jul 06 14:31:24.328175 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:24.328136    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xrbkx" podStartSLOduration=2.328123967 podStartE2EDuration="2.328123967s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:31:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:31:24.327126075 +0000 UTC m=+487.505775134" watchObservedRunningTime="2026-07-06 14:31:24.328123967 +0000 UTC m=+487.506773012"
Jul 06 14:31:24.342402 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:24.342380    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8p9fb"]
Jul 06 14:31:24.347715 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:24.347696    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8p9fb"]
Jul 06 14:31:25.954272 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:25.954242    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07a90432-5b44-4dc3-921a-1aee51109dc9" path="/var/lib/kubelet/pods/07a90432-5b44-4dc3-921a-1aee51109dc9/volumes"
Jul 06 14:31:35.316082 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:31:35.316055    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xrbkx"
Jul 06 14:33:35.426118 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:33:35.426073    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-lgnq7"]
Jul 06 14:33:35.427844 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:33:35.426696    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07a90432-5b44-4dc3-921a-1aee51109dc9" containerName="manager"
Jul 06 14:33:35.427844 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:33:35.426712    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="07a90432-5b44-4dc3-921a-1aee51109dc9" containerName="manager"
Jul 06 14:33:35.427844 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:33:35.426785    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="07a90432-5b44-4dc3-921a-1aee51109dc9" containerName="manager"
Jul 06 14:33:35.429125 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:33:35.429101    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lgnq7"
Jul 06 14:33:35.431761 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:33:35.431741    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 06 14:33:35.431878 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:33:35.431766    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 06 14:33:35.431878 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:33:35.431773    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 06 14:33:35.431878 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:33:35.431744    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-d45hj\""
Jul 06 14:33:35.440479 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:33:35.440458    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-lgnq7"]
Jul 06 14:33:35.527855 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:33:35.527823    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a5b2b75-685e-4c29-8925-3624272551e3-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lgnq7\" (UID: \"6a5b2b75-685e-4c29-8925-3624272551e3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lgnq7"
Jul 06 14:33:35.528031 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:33:35.527868    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a5b2b75-685e-4c29-8925-3624272551e3-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lgnq7\" (UID: \"6a5b2b75-685e-4c29-8925-3624272551e3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lgnq7"
Jul 06 14:33:35.528031 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:33:35.527887    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a5b2b75-685e-4c29-8925-3624272551e3-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lgnq7\" (UID: \"6a5b2b75-685e-4c29-8925-3624272551e3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lgnq7"
Jul 06 14:33:35.528031 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:33:35.527972    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mc8ww\" (UniqueName: \"kubernetes.io/projected/6a5b2b75-685e-4c29-8925-3624272551e3-kube-api-access-mc8ww\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lgnq7\" (UID: \"6a5b2b75-685e-4c29-8925-3624272551e3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lgnq7"
Jul 06 14:33:35.528031 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:33:35.528016    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a5b2b75-685e-4c29-8925-3624272551e3-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lgnq7\" (UID: \"6a5b2b75-685e-4c29-8925-3624272551e3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lgnq7"
Jul 06 14:33:35.528176 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:33:35.528043    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a5b2b75-685e-4c29-8925-3624272551e3-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lgnq7\" (UID: \"6a5b2b75-685e-4c29-8925-3624272551e3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lgnq7"
Jul 06 14:33:35.629295 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:33:35.629257    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mc8ww\" (UniqueName: \"kubernetes.io/projected/6a5b2b75-685e-4c29-8925-3624272551e3-kube-api-access-mc8ww\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lgnq7\" (UID: \"6a5b2b75-685e-4c29-8925-3624272551e3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lgnq7"
Jul 06 14:33:35.629525 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:33:35.629305    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a5b2b75-685e-4c29-8925-3624272551e3-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lgnq7\" (UID: \"6a5b2b75-685e-4c29-8925-3624272551e3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lgnq7"
Jul 06 14:33:35.629525 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:33:35.629364    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a5b2b75-685e-4c29-8925-3624272551e3-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lgnq7\" (UID: \"6a5b2b75-685e-4c29-8925-3624272551e3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lgnq7"
Jul 06 14:33:35.629525 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:33:35.629428    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a5b2b75-685e-4c29-8925-3624272551e3-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lgnq7\" (UID: \"6a5b2b75-685e-4c29-8925-3624272551e3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lgnq7"
Jul 06 14:33:35.629525 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:33:35.629465    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a5b2b75-685e-4c29-8925-3624272551e3-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lgnq7\" (UID: \"6a5b2b75-685e-4c29-8925-3624272551e3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lgnq7"
Jul 06 14:33:35.629525 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:33:35.629482    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a5b2b75-685e-4c29-8925-3624272551e3-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lgnq7\" (UID: \"6a5b2b75-685e-4c29-8925-3624272551e3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lgnq7"
Jul 06 14:33:35.629789 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:33:35.629744    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a5b2b75-685e-4c29-8925-3624272551e3-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lgnq7\" (UID: \"6a5b2b75-685e-4c29-8925-3624272551e3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lgnq7"
Jul 06 14:33:35.629848 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:33:35.629832    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a5b2b75-685e-4c29-8925-3624272551e3-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lgnq7\" (UID: \"6a5b2b75-685e-4c29-8925-3624272551e3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lgnq7"
Jul 06 14:33:35.629940 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:33:35.629908    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a5b2b75-685e-4c29-8925-3624272551e3-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lgnq7\" (UID: \"6a5b2b75-685e-4c29-8925-3624272551e3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lgnq7"
Jul 06 14:33:35.631740 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:33:35.631720    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a5b2b75-685e-4c29-8925-3624272551e3-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lgnq7\" (UID: \"6a5b2b75-685e-4c29-8925-3624272551e3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lgnq7"
Jul 06 14:33:35.631979 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:33:35.631961    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a5b2b75-685e-4c29-8925-3624272551e3-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lgnq7\" (UID: \"6a5b2b75-685e-4c29-8925-3624272551e3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lgnq7"
Jul 06 14:33:35.637134 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:33:35.637112    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mc8ww\" (UniqueName: \"kubernetes.io/projected/6a5b2b75-685e-4c29-8925-3624272551e3-kube-api-access-mc8ww\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lgnq7\" (UID: \"6a5b2b75-685e-4c29-8925-3624272551e3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lgnq7"
Jul 06 14:33:35.739616 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:33:35.739540    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lgnq7"
Jul 06 14:33:35.870613 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:33:35.870588    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-lgnq7"]
Jul 06 14:33:35.873017 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:33:35.872979    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a5b2b75_685e_4c29_8925_3624272551e3.slice/crio-71b76f56027a46f79d185b6019448344c7badba23704bd7cf0bfe8134419464d WatchSource:0}: Error finding container 71b76f56027a46f79d185b6019448344c7badba23704bd7cf0bfe8134419464d: Status 404 returned error can't find the container with id 71b76f56027a46f79d185b6019448344c7badba23704bd7cf0bfe8134419464d
Jul 06 14:33:35.874485 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:33:35.874467    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 14:33:35.964801 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:33:35.964772    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lgnq7" event={"ID":"6a5b2b75-685e-4c29-8925-3624272551e3","Type":"ContainerStarted","Data":"71b76f56027a46f79d185b6019448344c7badba23704bd7cf0bfe8134419464d"}
Jul 06 14:33:37.975454 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:33:37.975395    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lgnq7" event={"ID":"6a5b2b75-685e-4c29-8925-3624272551e3","Type":"ContainerStarted","Data":"7d7c12802b3f1ba0395ea5af93413c976ad421382dac6991dd8da8199908d94a"}
Jul 06 14:33:37.993968 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:33:37.993911    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lgnq7" podStartSLOduration=1.936484025 podStartE2EDuration="2.993892543s" totalImagesPullingTime="1.057408518s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:33:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:33:37.99269063 +0000 UTC m=+621.171339676" watchObservedRunningTime="2026-07-06 14:33:37.993892543 +0000 UTC m=+621.172541590"
Jul 06 14:33:45.740454 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:33:45.740370    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lgnq7"
Jul 06 14:33:45.740454 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:33:45.740445    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lgnq7"
Jul 06 14:33:45.752681 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:33:45.752655    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lgnq7"
Jul 06 14:33:46.025571 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:33:46.025489    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lgnq7"
Jul 06 14:34:10.644668 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:34:10.644632    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cfnb4"]
Jul 06 14:34:10.648258 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:34:10.648240    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cfnb4"
Jul 06 14:34:10.655198 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:34:10.654718    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 06 14:34:10.656930 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:34:10.656908    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8eee5ff-710f-4165-a183-95b73a0f03d1-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cfnb4\" (UID: \"d8eee5ff-710f-4165-a183-95b73a0f03d1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cfnb4"
Jul 06 14:34:10.657041 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:34:10.656939    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52w4s\" (UniqueName: \"kubernetes.io/projected/d8eee5ff-710f-4165-a183-95b73a0f03d1-kube-api-access-52w4s\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cfnb4\" (UID: \"d8eee5ff-710f-4165-a183-95b73a0f03d1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cfnb4"
Jul 06 14:34:10.657041 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:34:10.656971    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8eee5ff-710f-4165-a183-95b73a0f03d1-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cfnb4\" (UID: \"d8eee5ff-710f-4165-a183-95b73a0f03d1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cfnb4"
Jul 06 14:34:10.657123 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:34:10.657080    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8eee5ff-710f-4165-a183-95b73a0f03d1-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cfnb4\" (UID: \"d8eee5ff-710f-4165-a183-95b73a0f03d1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cfnb4"
Jul 06 14:34:10.657169 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:34:10.657119    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8eee5ff-710f-4165-a183-95b73a0f03d1-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cfnb4\" (UID: \"d8eee5ff-710f-4165-a183-95b73a0f03d1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cfnb4"
Jul 06 14:34:10.657169 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:34:10.657137    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8eee5ff-710f-4165-a183-95b73a0f03d1-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cfnb4\" (UID: \"d8eee5ff-710f-4165-a183-95b73a0f03d1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cfnb4"
Jul 06 14:34:10.663791 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:34:10.663770    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cfnb4"]
Jul 06 14:34:10.758102 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:34:10.758068    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8eee5ff-710f-4165-a183-95b73a0f03d1-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cfnb4\" (UID: \"d8eee5ff-710f-4165-a183-95b73a0f03d1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cfnb4"
Jul 06 14:34:10.758272 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:34:10.758126    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52w4s\" (UniqueName: \"kubernetes.io/projected/d8eee5ff-710f-4165-a183-95b73a0f03d1-kube-api-access-52w4s\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cfnb4\" (UID: \"d8eee5ff-710f-4165-a183-95b73a0f03d1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cfnb4"
Jul 06 14:34:10.758272 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:34:10.758166    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8eee5ff-710f-4165-a183-95b73a0f03d1-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cfnb4\" (UID: \"d8eee5ff-710f-4165-a183-95b73a0f03d1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cfnb4"
Jul 06 14:34:10.758272 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:34:10.758237    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8eee5ff-710f-4165-a183-95b73a0f03d1-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cfnb4\" (UID: \"d8eee5ff-710f-4165-a183-95b73a0f03d1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cfnb4"
Jul 06 14:34:10.758481 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:34:10.758278    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8eee5ff-710f-4165-a183-95b73a0f03d1-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cfnb4\" (UID: \"d8eee5ff-710f-4165-a183-95b73a0f03d1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cfnb4"
Jul 06 14:34:10.758481 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:34:10.758302    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8eee5ff-710f-4165-a183-95b73a0f03d1-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cfnb4\" (UID: \"d8eee5ff-710f-4165-a183-95b73a0f03d1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cfnb4"
Jul 06 14:34:10.758619 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:34:10.758600    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8eee5ff-710f-4165-a183-95b73a0f03d1-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cfnb4\" (UID: \"d8eee5ff-710f-4165-a183-95b73a0f03d1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cfnb4"
Jul 06 14:34:10.758683 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:34:10.758656    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8eee5ff-710f-4165-a183-95b73a0f03d1-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cfnb4\" (UID: \"d8eee5ff-710f-4165-a183-95b73a0f03d1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cfnb4"
Jul 06 14:34:10.758683 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:34:10.758668    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8eee5ff-710f-4165-a183-95b73a0f03d1-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cfnb4\" (UID: \"d8eee5ff-710f-4165-a183-95b73a0f03d1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cfnb4"
Jul 06 14:34:10.760457 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:34:10.760436    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8eee5ff-710f-4165-a183-95b73a0f03d1-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cfnb4\" (UID: \"d8eee5ff-710f-4165-a183-95b73a0f03d1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cfnb4"
Jul 06 14:34:10.760614 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:34:10.760598    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8eee5ff-710f-4165-a183-95b73a0f03d1-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cfnb4\" (UID: \"d8eee5ff-710f-4165-a183-95b73a0f03d1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cfnb4"
Jul 06 14:34:10.775483 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:34:10.775457    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52w4s\" (UniqueName: \"kubernetes.io/projected/d8eee5ff-710f-4165-a183-95b73a0f03d1-kube-api-access-52w4s\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cfnb4\" (UID: \"d8eee5ff-710f-4165-a183-95b73a0f03d1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cfnb4"
Jul 06 14:34:10.958152 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:34:10.958043    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cfnb4"
Jul 06 14:34:11.089080 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:34:11.089056    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cfnb4"]
Jul 06 14:34:11.092709 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:34:11.092682    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd8eee5ff_710f_4165_a183_95b73a0f03d1.slice/crio-5346c7fea6f762483387ae03450f92d7d3db190460dac0ae14a3ac6fa4d6a032 WatchSource:0}: Error finding container 5346c7fea6f762483387ae03450f92d7d3db190460dac0ae14a3ac6fa4d6a032: Status 404 returned error can't find the container with id 5346c7fea6f762483387ae03450f92d7d3db190460dac0ae14a3ac6fa4d6a032
Jul 06 14:34:11.143084 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:34:11.143049    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cfnb4" event={"ID":"d8eee5ff-710f-4165-a183-95b73a0f03d1","Type":"ContainerStarted","Data":"5346c7fea6f762483387ae03450f92d7d3db190460dac0ae14a3ac6fa4d6a032"}
Jul 06 14:34:12.149406 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:34:12.149372    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cfnb4" event={"ID":"d8eee5ff-710f-4165-a183-95b73a0f03d1","Type":"ContainerStarted","Data":"42086b04b7e0ed89e0328acdb65d60b564186cdd5fc715b9b3cba831f24ee814"}
Jul 06 14:34:12.167894 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:34:12.167849    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cfnb4" podStartSLOduration=1.959364857 podStartE2EDuration="2.167834378s" totalImagesPullingTime="208.469521ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:34:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:34:12.166028698 +0000 UTC m=+655.344677766" watchObservedRunningTime="2026-07-06 14:34:12.167834378 +0000 UTC m=+655.346483423"
Jul 06 14:34:20.959162 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:34:20.959117    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cfnb4"
Jul 06 14:34:20.959162 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:34:20.959175    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cfnb4"
Jul 06 14:34:20.971770 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:34:20.971747    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cfnb4"
Jul 06 14:34:21.205856 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:34:21.205826    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cfnb4"
Jul 06 14:36:05.493029 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:05.492992    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d8cff6dbf-6j7t6"]
Jul 06 14:36:05.496937 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:05.496914    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d8cff6dbf-6j7t6"
Jul 06 14:36:05.540454 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:05.540427    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d8cff6dbf-6j7t6"]
Jul 06 14:36:05.553389 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:05.553360    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7c046ceb-9a6a-4857-88ee-8cbca22fa1a6-console-config\") pod \"console-5d8cff6dbf-6j7t6\" (UID: \"7c046ceb-9a6a-4857-88ee-8cbca22fa1a6\") " pod="openshift-console/console-5d8cff6dbf-6j7t6"
Jul 06 14:36:05.553506 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:05.553419    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7c046ceb-9a6a-4857-88ee-8cbca22fa1a6-oauth-serving-cert\") pod \"console-5d8cff6dbf-6j7t6\" (UID: \"7c046ceb-9a6a-4857-88ee-8cbca22fa1a6\") " pod="openshift-console/console-5d8cff6dbf-6j7t6"
Jul 06 14:36:05.553548 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:05.553530    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7c046ceb-9a6a-4857-88ee-8cbca22fa1a6-service-ca\") pod \"console-5d8cff6dbf-6j7t6\" (UID: \"7c046ceb-9a6a-4857-88ee-8cbca22fa1a6\") " pod="openshift-console/console-5d8cff6dbf-6j7t6"
Jul 06 14:36:05.553583 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:05.553572    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c046ceb-9a6a-4857-88ee-8cbca22fa1a6-console-serving-cert\") pod \"console-5d8cff6dbf-6j7t6\" (UID: \"7c046ceb-9a6a-4857-88ee-8cbca22fa1a6\") " pod="openshift-console/console-5d8cff6dbf-6j7t6"
Jul 06 14:36:05.553623 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:05.553602    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7c046ceb-9a6a-4857-88ee-8cbca22fa1a6-console-oauth-config\") pod \"console-5d8cff6dbf-6j7t6\" (UID: \"7c046ceb-9a6a-4857-88ee-8cbca22fa1a6\") " pod="openshift-console/console-5d8cff6dbf-6j7t6"
Jul 06 14:36:05.553686 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:05.553671    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c046ceb-9a6a-4857-88ee-8cbca22fa1a6-trusted-ca-bundle\") pod \"console-5d8cff6dbf-6j7t6\" (UID: \"7c046ceb-9a6a-4857-88ee-8cbca22fa1a6\") " pod="openshift-console/console-5d8cff6dbf-6j7t6"
Jul 06 14:36:05.553723 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:05.553713    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drbtq\" (UniqueName: \"kubernetes.io/projected/7c046ceb-9a6a-4857-88ee-8cbca22fa1a6-kube-api-access-drbtq\") pod \"console-5d8cff6dbf-6j7t6\" (UID: \"7c046ceb-9a6a-4857-88ee-8cbca22fa1a6\") " pod="openshift-console/console-5d8cff6dbf-6j7t6"
Jul 06 14:36:05.654286 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:05.654248    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7c046ceb-9a6a-4857-88ee-8cbca22fa1a6-oauth-serving-cert\") pod \"console-5d8cff6dbf-6j7t6\" (UID: \"7c046ceb-9a6a-4857-88ee-8cbca22fa1a6\") " pod="openshift-console/console-5d8cff6dbf-6j7t6"
Jul 06 14:36:05.654519 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:05.654305    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7c046ceb-9a6a-4857-88ee-8cbca22fa1a6-service-ca\") pod \"console-5d8cff6dbf-6j7t6\" (UID: \"7c046ceb-9a6a-4857-88ee-8cbca22fa1a6\") " pod="openshift-console/console-5d8cff6dbf-6j7t6"
Jul 06 14:36:05.654519 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:05.654428    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c046ceb-9a6a-4857-88ee-8cbca22fa1a6-console-serving-cert\") pod \"console-5d8cff6dbf-6j7t6\" (UID: \"7c046ceb-9a6a-4857-88ee-8cbca22fa1a6\") " pod="openshift-console/console-5d8cff6dbf-6j7t6"
Jul 06 14:36:05.654519 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:05.654464    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7c046ceb-9a6a-4857-88ee-8cbca22fa1a6-console-oauth-config\") pod \"console-5d8cff6dbf-6j7t6\" (UID: \"7c046ceb-9a6a-4857-88ee-8cbca22fa1a6\") " pod="openshift-console/console-5d8cff6dbf-6j7t6"
Jul 06 14:36:05.654693 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:05.654534    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c046ceb-9a6a-4857-88ee-8cbca22fa1a6-trusted-ca-bundle\") pod \"console-5d8cff6dbf-6j7t6\" (UID: \"7c046ceb-9a6a-4857-88ee-8cbca22fa1a6\") " pod="openshift-console/console-5d8cff6dbf-6j7t6"
Jul 06 14:36:05.654693 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:05.654584    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drbtq\" (UniqueName: \"kubernetes.io/projected/7c046ceb-9a6a-4857-88ee-8cbca22fa1a6-kube-api-access-drbtq\") pod \"console-5d8cff6dbf-6j7t6\" (UID: \"7c046ceb-9a6a-4857-88ee-8cbca22fa1a6\") " pod="openshift-console/console-5d8cff6dbf-6j7t6"
Jul 06 14:36:05.654693 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:05.654627    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7c046ceb-9a6a-4857-88ee-8cbca22fa1a6-console-config\") pod \"console-5d8cff6dbf-6j7t6\" (UID: \"7c046ceb-9a6a-4857-88ee-8cbca22fa1a6\") " pod="openshift-console/console-5d8cff6dbf-6j7t6"
Jul 06 14:36:05.655129 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:05.655102    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7c046ceb-9a6a-4857-88ee-8cbca22fa1a6-service-ca\") pod \"console-5d8cff6dbf-6j7t6\" (UID: \"7c046ceb-9a6a-4857-88ee-8cbca22fa1a6\") " pod="openshift-console/console-5d8cff6dbf-6j7t6"
Jul 06 14:36:05.655395 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:05.655360    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7c046ceb-9a6a-4857-88ee-8cbca22fa1a6-console-config\") pod \"console-5d8cff6dbf-6j7t6\" (UID: \"7c046ceb-9a6a-4857-88ee-8cbca22fa1a6\") " pod="openshift-console/console-5d8cff6dbf-6j7t6"
Jul 06 14:36:05.655485 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:05.655410    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7c046ceb-9a6a-4857-88ee-8cbca22fa1a6-oauth-serving-cert\") pod \"console-5d8cff6dbf-6j7t6\" (UID: \"7c046ceb-9a6a-4857-88ee-8cbca22fa1a6\") " pod="openshift-console/console-5d8cff6dbf-6j7t6"
Jul 06 14:36:05.655575 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:05.655552    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c046ceb-9a6a-4857-88ee-8cbca22fa1a6-trusted-ca-bundle\") pod \"console-5d8cff6dbf-6j7t6\" (UID: \"7c046ceb-9a6a-4857-88ee-8cbca22fa1a6\") " pod="openshift-console/console-5d8cff6dbf-6j7t6"
Jul 06 14:36:05.656942 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:05.656914    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c046ceb-9a6a-4857-88ee-8cbca22fa1a6-console-serving-cert\") pod \"console-5d8cff6dbf-6j7t6\" (UID: \"7c046ceb-9a6a-4857-88ee-8cbca22fa1a6\") " pod="openshift-console/console-5d8cff6dbf-6j7t6"
Jul 06 14:36:05.657046 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:05.656949    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7c046ceb-9a6a-4857-88ee-8cbca22fa1a6-console-oauth-config\") pod \"console-5d8cff6dbf-6j7t6\" (UID: \"7c046ceb-9a6a-4857-88ee-8cbca22fa1a6\") " pod="openshift-console/console-5d8cff6dbf-6j7t6"
Jul 06 14:36:05.682126 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:05.682095    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drbtq\" (UniqueName: \"kubernetes.io/projected/7c046ceb-9a6a-4857-88ee-8cbca22fa1a6-kube-api-access-drbtq\") pod \"console-5d8cff6dbf-6j7t6\" (UID: \"7c046ceb-9a6a-4857-88ee-8cbca22fa1a6\") " pod="openshift-console/console-5d8cff6dbf-6j7t6"
Jul 06 14:36:05.806251 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:05.806167    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d8cff6dbf-6j7t6"
Jul 06 14:36:05.957974 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:05.957954    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d8cff6dbf-6j7t6"]
Jul 06 14:36:05.959864 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:36:05.959839    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c046ceb_9a6a_4857_88ee_8cbca22fa1a6.slice/crio-e11ace18c0c883781344eeb6c7e6fa7e8ca827f954bc2732c9a967a624385da6 WatchSource:0}: Error finding container e11ace18c0c883781344eeb6c7e6fa7e8ca827f954bc2732c9a967a624385da6: Status 404 returned error can't find the container with id e11ace18c0c883781344eeb6c7e6fa7e8ca827f954bc2732c9a967a624385da6
Jul 06 14:36:06.733921 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:06.733877    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d8cff6dbf-6j7t6" event={"ID":"7c046ceb-9a6a-4857-88ee-8cbca22fa1a6","Type":"ContainerStarted","Data":"f1fe143e92087360995f58e59fc4bb145ac33f17b0a9d8a561e18f9c69c36775"}
Jul 06 14:36:06.733921 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:06.733927    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d8cff6dbf-6j7t6" event={"ID":"7c046ceb-9a6a-4857-88ee-8cbca22fa1a6","Type":"ContainerStarted","Data":"e11ace18c0c883781344eeb6c7e6fa7e8ca827f954bc2732c9a967a624385da6"}
Jul 06 14:36:06.767978 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:06.767933    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d8cff6dbf-6j7t6" podStartSLOduration=1.767918988 podStartE2EDuration="1.767918988s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:36:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:36:06.766967069 +0000 UTC m=+769.945616120" watchObservedRunningTime="2026-07-06 14:36:06.767918988 +0000 UTC m=+769.946568034"
Jul 06 14:36:15.806848 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:15.806763    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d8cff6dbf-6j7t6"
Jul 06 14:36:15.806848 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:15.806819    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d8cff6dbf-6j7t6"
Jul 06 14:36:15.811749 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:15.811724    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5d8cff6dbf-6j7t6"
Jul 06 14:36:16.791209 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:16.791177    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5d8cff6dbf-6j7t6"
Jul 06 14:36:16.888373 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:16.888324    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b8977fc97-pl9qd"]
Jul 06 14:36:41.909106 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:41.909013    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6b8977fc97-pl9qd" podUID="d7b6f7e1-37cc-4290-b58a-9262cd7ba58c" containerName="console" containerID="cri-o://cecfacdeb9246b8a8707706b5d69ce58382770dd733b18f32ea209419556bb10" gracePeriod=15
Jul 06 14:36:42.162316 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:42.162256    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b8977fc97-pl9qd"
Jul 06 14:36:42.209462 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:42.209430    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7b6f7e1-37cc-4290-b58a-9262cd7ba58c-console-config\") pod \"d7b6f7e1-37cc-4290-b58a-9262cd7ba58c\" (UID: \"d7b6f7e1-37cc-4290-b58a-9262cd7ba58c\") "
Jul 06 14:36:42.209633 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:42.209482    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7b6f7e1-37cc-4290-b58a-9262cd7ba58c-service-ca\") pod \"d7b6f7e1-37cc-4290-b58a-9262cd7ba58c\" (UID: \"d7b6f7e1-37cc-4290-b58a-9262cd7ba58c\") "
Jul 06 14:36:42.209633 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:42.209517    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7b6f7e1-37cc-4290-b58a-9262cd7ba58c-console-oauth-config\") pod \"d7b6f7e1-37cc-4290-b58a-9262cd7ba58c\" (UID: \"d7b6f7e1-37cc-4290-b58a-9262cd7ba58c\") "
Jul 06 14:36:42.209633 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:42.209569    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7b6f7e1-37cc-4290-b58a-9262cd7ba58c-oauth-serving-cert\") pod \"d7b6f7e1-37cc-4290-b58a-9262cd7ba58c\" (UID: \"d7b6f7e1-37cc-4290-b58a-9262cd7ba58c\") "
Jul 06 14:36:42.209800 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:42.209723    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7b6f7e1-37cc-4290-b58a-9262cd7ba58c-trusted-ca-bundle\") pod \"d7b6f7e1-37cc-4290-b58a-9262cd7ba58c\" (UID: \"d7b6f7e1-37cc-4290-b58a-9262cd7ba58c\") "
Jul 06 14:36:42.209800 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:42.209786    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7b6f7e1-37cc-4290-b58a-9262cd7ba58c-console-serving-cert\") pod \"d7b6f7e1-37cc-4290-b58a-9262cd7ba58c\" (UID: \"d7b6f7e1-37cc-4290-b58a-9262cd7ba58c\") "
Jul 06 14:36:42.209901 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:42.209842    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kvhrr\" (UniqueName: \"kubernetes.io/projected/d7b6f7e1-37cc-4290-b58a-9262cd7ba58c-kube-api-access-kvhrr\") pod \"d7b6f7e1-37cc-4290-b58a-9262cd7ba58c\" (UID: \"d7b6f7e1-37cc-4290-b58a-9262cd7ba58c\") "
Jul 06 14:36:42.209901 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:42.209874    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7b6f7e1-37cc-4290-b58a-9262cd7ba58c-console-config" (OuterVolumeSpecName: "console-config") pod "d7b6f7e1-37cc-4290-b58a-9262cd7ba58c" (UID: "d7b6f7e1-37cc-4290-b58a-9262cd7ba58c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:36:42.210004 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:42.209939    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7b6f7e1-37cc-4290-b58a-9262cd7ba58c-service-ca" (OuterVolumeSpecName: "service-ca") pod "d7b6f7e1-37cc-4290-b58a-9262cd7ba58c" (UID: "d7b6f7e1-37cc-4290-b58a-9262cd7ba58c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:36:42.210004 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:42.209969    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7b6f7e1-37cc-4290-b58a-9262cd7ba58c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d7b6f7e1-37cc-4290-b58a-9262cd7ba58c" (UID: "d7b6f7e1-37cc-4290-b58a-9262cd7ba58c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:36:42.210233 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:42.210213    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7b6f7e1-37cc-4290-b58a-9262cd7ba58c-oauth-serving-cert\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:36:42.210304 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:42.210234    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7b6f7e1-37cc-4290-b58a-9262cd7ba58c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d7b6f7e1-37cc-4290-b58a-9262cd7ba58c" (UID: "d7b6f7e1-37cc-4290-b58a-9262cd7ba58c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:36:42.210304 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:42.210240    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7b6f7e1-37cc-4290-b58a-9262cd7ba58c-console-config\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:36:42.210304 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:42.210281    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7b6f7e1-37cc-4290-b58a-9262cd7ba58c-service-ca\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:36:42.212020 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:42.211996    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7b6f7e1-37cc-4290-b58a-9262cd7ba58c-kube-api-access-kvhrr" (OuterVolumeSpecName: "kube-api-access-kvhrr") pod "d7b6f7e1-37cc-4290-b58a-9262cd7ba58c" (UID: "d7b6f7e1-37cc-4290-b58a-9262cd7ba58c"). InnerVolumeSpecName "kube-api-access-kvhrr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:36:42.212178 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:42.212163    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7b6f7e1-37cc-4290-b58a-9262cd7ba58c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d7b6f7e1-37cc-4290-b58a-9262cd7ba58c" (UID: "d7b6f7e1-37cc-4290-b58a-9262cd7ba58c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:36:42.212265 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:42.212248    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7b6f7e1-37cc-4290-b58a-9262cd7ba58c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d7b6f7e1-37cc-4290-b58a-9262cd7ba58c" (UID: "d7b6f7e1-37cc-4290-b58a-9262cd7ba58c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:36:42.311553 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:42.311523    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7b6f7e1-37cc-4290-b58a-9262cd7ba58c-trusted-ca-bundle\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:36:42.311553 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:42.311547    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7b6f7e1-37cc-4290-b58a-9262cd7ba58c-console-serving-cert\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:36:42.311553 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:42.311559    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kvhrr\" (UniqueName: \"kubernetes.io/projected/d7b6f7e1-37cc-4290-b58a-9262cd7ba58c-kube-api-access-kvhrr\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:36:42.311790 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:42.311568    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7b6f7e1-37cc-4290-b58a-9262cd7ba58c-console-oauth-config\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:36:42.927037 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:42.927000    2565 generic.go:356] "Generic (PLEG): container finished" podID="d7b6f7e1-37cc-4290-b58a-9262cd7ba58c" containerID="cecfacdeb9246b8a8707706b5d69ce58382770dd733b18f32ea209419556bb10" exitCode=0
Jul 06 14:36:42.927470 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:42.927044    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b8977fc97-pl9qd"
Jul 06 14:36:42.927470 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:42.927087    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b8977fc97-pl9qd" event={"ID":"d7b6f7e1-37cc-4290-b58a-9262cd7ba58c","Type":"ContainerDied","Data":"cecfacdeb9246b8a8707706b5d69ce58382770dd733b18f32ea209419556bb10"}
Jul 06 14:36:42.927470 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:42.927143    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b8977fc97-pl9qd" event={"ID":"d7b6f7e1-37cc-4290-b58a-9262cd7ba58c","Type":"ContainerDied","Data":"f722198dd6d4e21f6e44c246d5c065c160e8741f15cdc1a4011c596b1af641a9"}
Jul 06 14:36:42.927470 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:42.927166    2565 scope.go:117] "RemoveContainer" containerID="cecfacdeb9246b8a8707706b5d69ce58382770dd733b18f32ea209419556bb10"
Jul 06 14:36:42.941440 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:42.938182    2565 scope.go:117] "RemoveContainer" containerID="cecfacdeb9246b8a8707706b5d69ce58382770dd733b18f32ea209419556bb10"
Jul 06 14:36:42.941440 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:36:42.938556    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cecfacdeb9246b8a8707706b5d69ce58382770dd733b18f32ea209419556bb10\": container with ID starting with cecfacdeb9246b8a8707706b5d69ce58382770dd733b18f32ea209419556bb10 not found: ID does not exist" containerID="cecfacdeb9246b8a8707706b5d69ce58382770dd733b18f32ea209419556bb10"
Jul 06 14:36:42.941440 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:42.938583    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cecfacdeb9246b8a8707706b5d69ce58382770dd733b18f32ea209419556bb10"} err="failed to get container status \"cecfacdeb9246b8a8707706b5d69ce58382770dd733b18f32ea209419556bb10\": rpc error: code = NotFound desc = could not find container \"cecfacdeb9246b8a8707706b5d69ce58382770dd733b18f32ea209419556bb10\": container with ID starting with cecfacdeb9246b8a8707706b5d69ce58382770dd733b18f32ea209419556bb10 not found: ID does not exist"
Jul 06 14:36:42.962300 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:42.962279    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b8977fc97-pl9qd"]
Jul 06 14:36:42.967695 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:42.967674    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b8977fc97-pl9qd"]
Jul 06 14:36:43.953299 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:36:43.953265    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7b6f7e1-37cc-4290-b58a-9262cd7ba58c" path="/var/lib/kubelet/pods/d7b6f7e1-37cc-4290-b58a-9262cd7ba58c/volumes"
Jul 06 14:41:14.657152 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:41:14.657068    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xrbkx"]
Jul 06 14:41:14.659832 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:41:14.657288    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xrbkx" podUID="5fc751f8-65da-4c48-9693-89f3585b4ea5" containerName="manager" containerID="cri-o://0b3e9cd224975102e68283ef0663bd752006177e820af2d47e5ecd36cc4226f6" gracePeriod=10
Jul 06 14:41:16.514785 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:41:16.514761    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xrbkx"
Jul 06 14:41:16.628383 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:41:16.628291    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5fc751f8-65da-4c48-9693-89f3585b4ea5-extensions-socket-volume\") pod \"5fc751f8-65da-4c48-9693-89f3585b4ea5\" (UID: \"5fc751f8-65da-4c48-9693-89f3585b4ea5\") "
Jul 06 14:41:16.628527 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:41:16.628403    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hhp7b\" (UniqueName: \"kubernetes.io/projected/5fc751f8-65da-4c48-9693-89f3585b4ea5-kube-api-access-hhp7b\") pod \"5fc751f8-65da-4c48-9693-89f3585b4ea5\" (UID: \"5fc751f8-65da-4c48-9693-89f3585b4ea5\") "
Jul 06 14:41:16.628748 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:41:16.628721    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fc751f8-65da-4c48-9693-89f3585b4ea5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5fc751f8-65da-4c48-9693-89f3585b4ea5" (UID: "5fc751f8-65da-4c48-9693-89f3585b4ea5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:41:16.630360 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:41:16.630317    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fc751f8-65da-4c48-9693-89f3585b4ea5-kube-api-access-hhp7b" (OuterVolumeSpecName: "kube-api-access-hhp7b") pod "5fc751f8-65da-4c48-9693-89f3585b4ea5" (UID: "5fc751f8-65da-4c48-9693-89f3585b4ea5"). InnerVolumeSpecName "kube-api-access-hhp7b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:41:16.730029 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:41:16.730000    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hhp7b\" (UniqueName: \"kubernetes.io/projected/5fc751f8-65da-4c48-9693-89f3585b4ea5-kube-api-access-hhp7b\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:41:16.730029 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:41:16.730026    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5fc751f8-65da-4c48-9693-89f3585b4ea5-extensions-socket-volume\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:41:17.303393 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:41:17.303357    2565 generic.go:356] "Generic (PLEG): container finished" podID="5fc751f8-65da-4c48-9693-89f3585b4ea5" containerID="0b3e9cd224975102e68283ef0663bd752006177e820af2d47e5ecd36cc4226f6" exitCode=0
Jul 06 14:41:17.303587 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:41:17.303433    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xrbkx"
Jul 06 14:41:17.303587 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:41:17.303448    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xrbkx" event={"ID":"5fc751f8-65da-4c48-9693-89f3585b4ea5","Type":"ContainerDied","Data":"0b3e9cd224975102e68283ef0663bd752006177e820af2d47e5ecd36cc4226f6"}
Jul 06 14:41:17.303587 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:41:17.303513    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xrbkx" event={"ID":"5fc751f8-65da-4c48-9693-89f3585b4ea5","Type":"ContainerDied","Data":"1d3dabfaa5cdf0b66f5f40252a1465669b1f8e88bf8459ca2c2dbf1f8b400749"}
Jul 06 14:41:17.303587 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:41:17.303540    2565 scope.go:117] "RemoveContainer" containerID="0b3e9cd224975102e68283ef0663bd752006177e820af2d47e5ecd36cc4226f6"
Jul 06 14:41:17.314323 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:41:17.314292    2565 scope.go:117] "RemoveContainer" containerID="0b3e9cd224975102e68283ef0663bd752006177e820af2d47e5ecd36cc4226f6"
Jul 06 14:41:17.314650 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:41:17.314611    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b3e9cd224975102e68283ef0663bd752006177e820af2d47e5ecd36cc4226f6\": container with ID starting with 0b3e9cd224975102e68283ef0663bd752006177e820af2d47e5ecd36cc4226f6 not found: ID does not exist" containerID="0b3e9cd224975102e68283ef0663bd752006177e820af2d47e5ecd36cc4226f6"
Jul 06 14:41:17.314744 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:41:17.314654    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b3e9cd224975102e68283ef0663bd752006177e820af2d47e5ecd36cc4226f6"} err="failed to get container status \"0b3e9cd224975102e68283ef0663bd752006177e820af2d47e5ecd36cc4226f6\": rpc error: code = NotFound desc = could not find container \"0b3e9cd224975102e68283ef0663bd752006177e820af2d47e5ecd36cc4226f6\": container with ID starting with 0b3e9cd224975102e68283ef0663bd752006177e820af2d47e5ecd36cc4226f6 not found: ID does not exist"
Jul 06 14:41:17.329983 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:41:17.329960    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xrbkx"]
Jul 06 14:41:17.334525 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:41:17.334501    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xrbkx"]
Jul 06 14:41:17.954207 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:41:17.954177    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fc751f8-65da-4c48-9693-89f3585b4ea5" path="/var/lib/kubelet/pods/5fc751f8-65da-4c48-9693-89f3585b4ea5/volumes"
Jul 06 14:42:15.821235 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:42:15.821203    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wqmf2"]
Jul 06 14:42:15.821725 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:42:15.821604    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fc751f8-65da-4c48-9693-89f3585b4ea5" containerName="manager"
Jul 06 14:42:15.821725 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:42:15.821616    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fc751f8-65da-4c48-9693-89f3585b4ea5" containerName="manager"
Jul 06 14:42:15.821725 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:42:15.821643    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7b6f7e1-37cc-4290-b58a-9262cd7ba58c" containerName="console"
Jul 06 14:42:15.821725 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:42:15.821649    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7b6f7e1-37cc-4290-b58a-9262cd7ba58c" containerName="console"
Jul 06 14:42:15.821725 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:42:15.821718    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fc751f8-65da-4c48-9693-89f3585b4ea5" containerName="manager"
Jul 06 14:42:15.821725 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:42:15.821728    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7b6f7e1-37cc-4290-b58a-9262cd7ba58c" containerName="console"
Jul 06 14:42:15.824821 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:42:15.824805    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wqmf2"
Jul 06 14:42:15.826982 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:42:15.826961    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-l6jr9\""
Jul 06 14:42:15.844312 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:42:15.844293    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wqmf2"]
Jul 06 14:42:15.988156 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:42:15.988128    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shbdt\" (UniqueName: \"kubernetes.io/projected/10465b0f-f261-44a5-8579-bc4924a27fcf-kube-api-access-shbdt\") pod \"kuadrant-operator-controller-manager-86878c769f-wqmf2\" (UID: \"10465b0f-f261-44a5-8579-bc4924a27fcf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wqmf2"
Jul 06 14:42:15.988320 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:42:15.988192    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/10465b0f-f261-44a5-8579-bc4924a27fcf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wqmf2\" (UID: \"10465b0f-f261-44a5-8579-bc4924a27fcf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wqmf2"
Jul 06 14:42:16.089056 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:42:16.088978    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shbdt\" (UniqueName: \"kubernetes.io/projected/10465b0f-f261-44a5-8579-bc4924a27fcf-kube-api-access-shbdt\") pod \"kuadrant-operator-controller-manager-86878c769f-wqmf2\" (UID: \"10465b0f-f261-44a5-8579-bc4924a27fcf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wqmf2"
Jul 06 14:42:16.089204 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:42:16.089153    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/10465b0f-f261-44a5-8579-bc4924a27fcf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wqmf2\" (UID: \"10465b0f-f261-44a5-8579-bc4924a27fcf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wqmf2"
Jul 06 14:42:16.089623 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:42:16.089595    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/10465b0f-f261-44a5-8579-bc4924a27fcf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wqmf2\" (UID: \"10465b0f-f261-44a5-8579-bc4924a27fcf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wqmf2"
Jul 06 14:42:16.102867 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:42:16.100332    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shbdt\" (UniqueName: \"kubernetes.io/projected/10465b0f-f261-44a5-8579-bc4924a27fcf-kube-api-access-shbdt\") pod \"kuadrant-operator-controller-manager-86878c769f-wqmf2\" (UID: \"10465b0f-f261-44a5-8579-bc4924a27fcf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wqmf2"
Jul 06 14:42:16.135390 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:42:16.135367    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wqmf2"
Jul 06 14:42:16.277623 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:42:16.277590    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wqmf2"]
Jul 06 14:42:16.279029 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:42:16.279002    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10465b0f_f261_44a5_8579_bc4924a27fcf.slice/crio-97451edaf7dcbef7277a7c3bb3b058b1982fe63904380dec91cb01eca5dfaafa WatchSource:0}: Error finding container 97451edaf7dcbef7277a7c3bb3b058b1982fe63904380dec91cb01eca5dfaafa: Status 404 returned error can't find the container with id 97451edaf7dcbef7277a7c3bb3b058b1982fe63904380dec91cb01eca5dfaafa
Jul 06 14:42:16.596039 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:42:16.595938    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wqmf2" event={"ID":"10465b0f-f261-44a5-8579-bc4924a27fcf","Type":"ContainerStarted","Data":"2a967481cf45e95f59c1a07e26ee3700722a1a966b040539ff3c60976ac38c72"}
Jul 06 14:42:16.596039 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:42:16.596019    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wqmf2" event={"ID":"10465b0f-f261-44a5-8579-bc4924a27fcf","Type":"ContainerStarted","Data":"97451edaf7dcbef7277a7c3bb3b058b1982fe63904380dec91cb01eca5dfaafa"}
Jul 06 14:42:16.596305 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:42:16.596280    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wqmf2"
Jul 06 14:42:16.620456 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:42:16.620408    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wqmf2" podStartSLOduration=1.620392271 podStartE2EDuration="1.620392271s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:42:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:42:16.618563126 +0000 UTC m=+1139.797212173" watchObservedRunningTime="2026-07-06 14:42:16.620392271 +0000 UTC m=+1139.799041316"
Jul 06 14:42:27.604021 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:42:27.603992    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wqmf2"
Jul 06 14:49:00.161548 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:00.161518    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs"]
Jul 06 14:49:00.165210 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:00.165189    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs"
Jul 06 14:49:00.167265 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:00.167245    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-1d78acdd-openshift-default-dockercfg-92mpp\""
Jul 06 14:49:00.181487 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:00.181461    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs"]
Jul 06 14:49:00.285812 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:00.285777    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55c7e873-ad08-4929-94b6-f6ff12efcd09-istio-data\") pod \"e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs\" (UID: \"55c7e873-ad08-4929-94b6-f6ff12efcd09\") " pod="openshift-ingress/e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs"
Jul 06 14:49:00.286016 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:00.285834    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55c7e873-ad08-4929-94b6-f6ff12efcd09-workload-socket\") pod \"e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs\" (UID: \"55c7e873-ad08-4929-94b6-f6ff12efcd09\") " pod="openshift-ingress/e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs"
Jul 06 14:49:00.286016 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:00.285860    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55c7e873-ad08-4929-94b6-f6ff12efcd09-credential-socket\") pod \"e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs\" (UID: \"55c7e873-ad08-4929-94b6-f6ff12efcd09\") " pod="openshift-ingress/e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs"
Jul 06 14:49:00.286016 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:00.285886    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhgd6\" (UniqueName: \"kubernetes.io/projected/55c7e873-ad08-4929-94b6-f6ff12efcd09-kube-api-access-fhgd6\") pod \"e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs\" (UID: \"55c7e873-ad08-4929-94b6-f6ff12efcd09\") " pod="openshift-ingress/e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs"
Jul 06 14:49:00.286016 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:00.285986    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55c7e873-ad08-4929-94b6-f6ff12efcd09-istio-podinfo\") pod \"e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs\" (UID: \"55c7e873-ad08-4929-94b6-f6ff12efcd09\") " pod="openshift-ingress/e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs"
Jul 06 14:49:00.286016 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:00.286010    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55c7e873-ad08-4929-94b6-f6ff12efcd09-istio-envoy\") pod \"e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs\" (UID: \"55c7e873-ad08-4929-94b6-f6ff12efcd09\") " pod="openshift-ingress/e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs"
Jul 06 14:49:00.286237 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:00.286036    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55c7e873-ad08-4929-94b6-f6ff12efcd09-workload-certs\") pod \"e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs\" (UID: \"55c7e873-ad08-4929-94b6-f6ff12efcd09\") " pod="openshift-ingress/e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs"
Jul 06 14:49:00.286237 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:00.286062    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55c7e873-ad08-4929-94b6-f6ff12efcd09-istio-token\") pod \"e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs\" (UID: \"55c7e873-ad08-4929-94b6-f6ff12efcd09\") " pod="openshift-ingress/e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs"
Jul 06 14:49:00.286237 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:00.286140    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55c7e873-ad08-4929-94b6-f6ff12efcd09-istiod-ca-cert\") pod \"e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs\" (UID: \"55c7e873-ad08-4929-94b6-f6ff12efcd09\") " pod="openshift-ingress/e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs"
Jul 06 14:49:00.387285 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:00.387254    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55c7e873-ad08-4929-94b6-f6ff12efcd09-istiod-ca-cert\") pod \"e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs\" (UID: \"55c7e873-ad08-4929-94b6-f6ff12efcd09\") " pod="openshift-ingress/e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs"
Jul 06 14:49:00.387496 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:00.387322    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55c7e873-ad08-4929-94b6-f6ff12efcd09-istio-data\") pod \"e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs\" (UID: \"55c7e873-ad08-4929-94b6-f6ff12efcd09\") " pod="openshift-ingress/e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs"
Jul 06 14:49:00.387496 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:00.387378    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55c7e873-ad08-4929-94b6-f6ff12efcd09-workload-socket\") pod \"e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs\" (UID: \"55c7e873-ad08-4929-94b6-f6ff12efcd09\") " pod="openshift-ingress/e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs"
Jul 06 14:49:00.387496 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:00.387402    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55c7e873-ad08-4929-94b6-f6ff12efcd09-credential-socket\") pod \"e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs\" (UID: \"55c7e873-ad08-4929-94b6-f6ff12efcd09\") " pod="openshift-ingress/e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs"
Jul 06 14:49:00.387656 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:00.387525    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhgd6\" (UniqueName: \"kubernetes.io/projected/55c7e873-ad08-4929-94b6-f6ff12efcd09-kube-api-access-fhgd6\") pod \"e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs\" (UID: \"55c7e873-ad08-4929-94b6-f6ff12efcd09\") " pod="openshift-ingress/e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs"
Jul 06 14:49:00.387656 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:00.387637    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55c7e873-ad08-4929-94b6-f6ff12efcd09-istio-podinfo\") pod \"e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs\" (UID: \"55c7e873-ad08-4929-94b6-f6ff12efcd09\") " pod="openshift-ingress/e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs"
Jul 06 14:49:00.387752 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:00.387670    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55c7e873-ad08-4929-94b6-f6ff12efcd09-istio-envoy\") pod \"e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs\" (UID: \"55c7e873-ad08-4929-94b6-f6ff12efcd09\") " pod="openshift-ingress/e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs"
Jul 06 14:49:00.387752 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:00.387699    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55c7e873-ad08-4929-94b6-f6ff12efcd09-workload-certs\") pod \"e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs\" (UID: \"55c7e873-ad08-4929-94b6-f6ff12efcd09\") " pod="openshift-ingress/e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs"
Jul 06 14:49:00.387752 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:00.387728    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55c7e873-ad08-4929-94b6-f6ff12efcd09-istio-token\") pod \"e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs\" (UID: \"55c7e873-ad08-4929-94b6-f6ff12efcd09\") " pod="openshift-ingress/e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs"
Jul 06 14:49:00.387893 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:00.387808    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55c7e873-ad08-4929-94b6-f6ff12efcd09-istio-data\") pod \"e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs\" (UID: \"55c7e873-ad08-4929-94b6-f6ff12efcd09\") " pod="openshift-ingress/e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs"
Jul 06 14:49:00.387893 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:00.387866    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55c7e873-ad08-4929-94b6-f6ff12efcd09-credential-socket\") pod \"e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs\" (UID: \"55c7e873-ad08-4929-94b6-f6ff12efcd09\") " pod="openshift-ingress/e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs"
Jul 06 14:49:00.388002 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:00.387932    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55c7e873-ad08-4929-94b6-f6ff12efcd09-workload-socket\") pod \"e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs\" (UID: \"55c7e873-ad08-4929-94b6-f6ff12efcd09\") " pod="openshift-ingress/e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs"
Jul 06 14:49:00.388129 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:00.388105    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55c7e873-ad08-4929-94b6-f6ff12efcd09-istiod-ca-cert\") pod \"e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs\" (UID: \"55c7e873-ad08-4929-94b6-f6ff12efcd09\") " pod="openshift-ingress/e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs"
Jul 06 14:49:00.388226 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:00.388204    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55c7e873-ad08-4929-94b6-f6ff12efcd09-workload-certs\") pod \"e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs\" (UID: \"55c7e873-ad08-4929-94b6-f6ff12efcd09\") " pod="openshift-ingress/e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs"
Jul 06 14:49:00.390130 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:00.390109    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55c7e873-ad08-4929-94b6-f6ff12efcd09-istio-envoy\") pod \"e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs\" (UID: \"55c7e873-ad08-4929-94b6-f6ff12efcd09\") " pod="openshift-ingress/e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs"
Jul 06 14:49:00.390572 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:00.390552    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55c7e873-ad08-4929-94b6-f6ff12efcd09-istio-podinfo\") pod \"e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs\" (UID: \"55c7e873-ad08-4929-94b6-f6ff12efcd09\") " pod="openshift-ingress/e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs"
Jul 06 14:49:00.395212 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:00.395177    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55c7e873-ad08-4929-94b6-f6ff12efcd09-istio-token\") pod \"e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs\" (UID: \"55c7e873-ad08-4929-94b6-f6ff12efcd09\") " pod="openshift-ingress/e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs"
Jul 06 14:49:00.395899 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:00.395878    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhgd6\" (UniqueName: \"kubernetes.io/projected/55c7e873-ad08-4929-94b6-f6ff12efcd09-kube-api-access-fhgd6\") pod \"e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs\" (UID: \"55c7e873-ad08-4929-94b6-f6ff12efcd09\") " pod="openshift-ingress/e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs"
Jul 06 14:49:00.475903 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:00.475809    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs"
Jul 06 14:49:00.618158 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:00.618128    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs"]
Jul 06 14:49:00.620300 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:49:00.620268    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55c7e873_ad08_4929_94b6_f6ff12efcd09.slice/crio-8a2f403f14c0c6218d3d2e228f7a31e6a73ed43ec5a3e17dd2c7a8e3907f75b8 WatchSource:0}: Error finding container 8a2f403f14c0c6218d3d2e228f7a31e6a73ed43ec5a3e17dd2c7a8e3907f75b8: Status 404 returned error can't find the container with id 8a2f403f14c0c6218d3d2e228f7a31e6a73ed43ec5a3e17dd2c7a8e3907f75b8
Jul 06 14:49:00.622560 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:00.622523    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:49:00.622661 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:00.622611    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:49:00.622702 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:00.622660    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:49:00.656257 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:00.656229    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs" event={"ID":"55c7e873-ad08-4929-94b6-f6ff12efcd09","Type":"ContainerStarted","Data":"8a2f403f14c0c6218d3d2e228f7a31e6a73ed43ec5a3e17dd2c7a8e3907f75b8"}
Jul 06 14:49:01.662361 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:01.662303    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs" event={"ID":"55c7e873-ad08-4929-94b6-f6ff12efcd09","Type":"ContainerStarted","Data":"e8a9f776d48a0961d63ff4766662482caaa94ca8b4e0e1e971235de9280d845d"}
Jul 06 14:49:01.683528 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:01.683478    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs" podStartSLOduration=1.683428051 podStartE2EDuration="1.683428051s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:49:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:49:01.681843617 +0000 UTC m=+1544.860492687" watchObservedRunningTime="2026-07-06 14:49:01.683428051 +0000 UTC m=+1544.862077098"
Jul 06 14:49:02.476291 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:02.476252    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs"
Jul 06 14:49:02.481123 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:02.481098    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs"
Jul 06 14:49:02.667842 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:02.667815    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs"
Jul 06 14:49:02.668897 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:02.668876    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs"
Jul 06 14:49:11.732949 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:11.732919    2565 generic.go:356] "Generic (PLEG): container finished" podID="55c7e873-ad08-4929-94b6-f6ff12efcd09" containerID="e8a9f776d48a0961d63ff4766662482caaa94ca8b4e0e1e971235de9280d845d" exitCode=0
Jul 06 14:49:11.733349 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:11.732965    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs" event={"ID":"55c7e873-ad08-4929-94b6-f6ff12efcd09","Type":"ContainerDied","Data":"e8a9f776d48a0961d63ff4766662482caaa94ca8b4e0e1e971235de9280d845d"}
Jul 06 14:49:11.733429 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:11.733414    2565 scope.go:117] "RemoveContainer" containerID="e8a9f776d48a0961d63ff4766662482caaa94ca8b4e0e1e971235de9280d845d"
Jul 06 14:49:11.734504 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:11.734472    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:49:11.734581 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:11.734541    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:49:11.734581 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:11.734569    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:49:12.740239 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:12.740203    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs" event={"ID":"55c7e873-ad08-4929-94b6-f6ff12efcd09","Type":"ContainerStarted","Data":"a76bfedd6b0226785d000ed40963bb77a9e94f3e479c4597b74130495d60d424"}
Jul 06 14:49:12.776807 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:12.776773    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs"]
Jul 06 14:49:13.476471 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:13.476444    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs"
Jul 06 14:49:13.481253 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:13.481228    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs"
Jul 06 14:49:13.745883 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:13.745777    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs" podUID="55c7e873-ad08-4929-94b6-f6ff12efcd09" containerName="istio-proxy" containerID="cri-o://a76bfedd6b0226785d000ed40963bb77a9e94f3e479c4597b74130495d60d424" gracePeriod=30
Jul 06 14:49:13.746322 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:13.745906    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs"
Jul 06 14:49:13.747149 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:13.747126    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs"
Jul 06 14:49:19.006892 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.006826    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs"
Jul 06 14:49:19.180451 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.180420    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55c7e873-ad08-4929-94b6-f6ff12efcd09-istio-token\") pod \"55c7e873-ad08-4929-94b6-f6ff12efcd09\" (UID: \"55c7e873-ad08-4929-94b6-f6ff12efcd09\") "
Jul 06 14:49:19.180611 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.180540    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55c7e873-ad08-4929-94b6-f6ff12efcd09-workload-socket\") pod \"55c7e873-ad08-4929-94b6-f6ff12efcd09\" (UID: \"55c7e873-ad08-4929-94b6-f6ff12efcd09\") "
Jul 06 14:49:19.180611 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.180572    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55c7e873-ad08-4929-94b6-f6ff12efcd09-istiod-ca-cert\") pod \"55c7e873-ad08-4929-94b6-f6ff12efcd09\" (UID: \"55c7e873-ad08-4929-94b6-f6ff12efcd09\") "
Jul 06 14:49:19.180611 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.180596    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55c7e873-ad08-4929-94b6-f6ff12efcd09-istio-envoy\") pod \"55c7e873-ad08-4929-94b6-f6ff12efcd09\" (UID: \"55c7e873-ad08-4929-94b6-f6ff12efcd09\") "
Jul 06 14:49:19.180768 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.180621    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55c7e873-ad08-4929-94b6-f6ff12efcd09-istio-data\") pod \"55c7e873-ad08-4929-94b6-f6ff12efcd09\" (UID: \"55c7e873-ad08-4929-94b6-f6ff12efcd09\") "
Jul 06 14:49:19.180768 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.180647    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55c7e873-ad08-4929-94b6-f6ff12efcd09-credential-socket\") pod \"55c7e873-ad08-4929-94b6-f6ff12efcd09\" (UID: \"55c7e873-ad08-4929-94b6-f6ff12efcd09\") "
Jul 06 14:49:19.180768 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.180679    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55c7e873-ad08-4929-94b6-f6ff12efcd09-istio-podinfo\") pod \"55c7e873-ad08-4929-94b6-f6ff12efcd09\" (UID: \"55c7e873-ad08-4929-94b6-f6ff12efcd09\") "
Jul 06 14:49:19.180768 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.180721    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55c7e873-ad08-4929-94b6-f6ff12efcd09-workload-certs\") pod \"55c7e873-ad08-4929-94b6-f6ff12efcd09\" (UID: \"55c7e873-ad08-4929-94b6-f6ff12efcd09\") "
Jul 06 14:49:19.180768 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.180747    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fhgd6\" (UniqueName: \"kubernetes.io/projected/55c7e873-ad08-4929-94b6-f6ff12efcd09-kube-api-access-fhgd6\") pod \"55c7e873-ad08-4929-94b6-f6ff12efcd09\" (UID: \"55c7e873-ad08-4929-94b6-f6ff12efcd09\") "
Jul 06 14:49:19.181613 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.181052    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55c7e873-ad08-4929-94b6-f6ff12efcd09-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "55c7e873-ad08-4929-94b6-f6ff12efcd09" (UID: "55c7e873-ad08-4929-94b6-f6ff12efcd09"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:49:19.181613 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.181272    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55c7e873-ad08-4929-94b6-f6ff12efcd09-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "55c7e873-ad08-4929-94b6-f6ff12efcd09" (UID: "55c7e873-ad08-4929-94b6-f6ff12efcd09"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:49:19.181613 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.181459    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55c7e873-ad08-4929-94b6-f6ff12efcd09-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "55c7e873-ad08-4929-94b6-f6ff12efcd09" (UID: "55c7e873-ad08-4929-94b6-f6ff12efcd09"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:49:19.181838 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.181700    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55c7e873-ad08-4929-94b6-f6ff12efcd09-istio-data" (OuterVolumeSpecName: "istio-data") pod "55c7e873-ad08-4929-94b6-f6ff12efcd09" (UID: "55c7e873-ad08-4929-94b6-f6ff12efcd09"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:49:19.181838 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.181760    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55c7e873-ad08-4929-94b6-f6ff12efcd09-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "55c7e873-ad08-4929-94b6-f6ff12efcd09" (UID: "55c7e873-ad08-4929-94b6-f6ff12efcd09"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:49:19.183740 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.183714    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55c7e873-ad08-4929-94b6-f6ff12efcd09-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "55c7e873-ad08-4929-94b6-f6ff12efcd09" (UID: "55c7e873-ad08-4929-94b6-f6ff12efcd09"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:49:19.183817 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.183760    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55c7e873-ad08-4929-94b6-f6ff12efcd09-kube-api-access-fhgd6" (OuterVolumeSpecName: "kube-api-access-fhgd6") pod "55c7e873-ad08-4929-94b6-f6ff12efcd09" (UID: "55c7e873-ad08-4929-94b6-f6ff12efcd09"). InnerVolumeSpecName "kube-api-access-fhgd6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:49:19.183865 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.183846    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55c7e873-ad08-4929-94b6-f6ff12efcd09-istio-token" (OuterVolumeSpecName: "istio-token") pod "55c7e873-ad08-4929-94b6-f6ff12efcd09" (UID: "55c7e873-ad08-4929-94b6-f6ff12efcd09"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:49:19.184000 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.183978    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/55c7e873-ad08-4929-94b6-f6ff12efcd09-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "55c7e873-ad08-4929-94b6-f6ff12efcd09" (UID: "55c7e873-ad08-4929-94b6-f6ff12efcd09"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 14:49:19.204746 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.204716    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9"]
Jul 06 14:49:19.205376 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.205360    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55c7e873-ad08-4929-94b6-f6ff12efcd09" containerName="istio-proxy"
Jul 06 14:49:19.205427 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.205380    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="55c7e873-ad08-4929-94b6-f6ff12efcd09" containerName="istio-proxy"
Jul 06 14:49:19.205505 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.205494    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="55c7e873-ad08-4929-94b6-f6ff12efcd09" containerName="istio-proxy"
Jul 06 14:49:19.205544 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.205513    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="55c7e873-ad08-4929-94b6-f6ff12efcd09" containerName="istio-proxy"
Jul 06 14:49:19.209387 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.209367    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9"
Jul 06 14:49:19.213637 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.213618    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-b7b274f6-openshift-default-dockercfg-xvxkp\""
Jul 06 14:49:19.226155 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.226131    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9"]
Jul 06 14:49:19.282294 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.282210    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55c7e873-ad08-4929-94b6-f6ff12efcd09-istio-token\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:49:19.282294 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.282235    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55c7e873-ad08-4929-94b6-f6ff12efcd09-workload-socket\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:49:19.282294 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.282247    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55c7e873-ad08-4929-94b6-f6ff12efcd09-istiod-ca-cert\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:49:19.282294 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.282261    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55c7e873-ad08-4929-94b6-f6ff12efcd09-istio-envoy\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:49:19.282294 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.282272    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55c7e873-ad08-4929-94b6-f6ff12efcd09-istio-data\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:49:19.282294 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.282282    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55c7e873-ad08-4929-94b6-f6ff12efcd09-credential-socket\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:49:19.282294 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.282293    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55c7e873-ad08-4929-94b6-f6ff12efcd09-istio-podinfo\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:49:19.282639 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.282305    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55c7e873-ad08-4929-94b6-f6ff12efcd09-workload-certs\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:49:19.282639 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.282316    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fhgd6\" (UniqueName: \"kubernetes.io/projected/55c7e873-ad08-4929-94b6-f6ff12efcd09-kube-api-access-fhgd6\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:49:19.382926 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.382887    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1683fd34-5731-400d-b86c-98342160e1b3-credential-socket\") pod \"e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9\" (UID: \"1683fd34-5731-400d-b86c-98342160e1b3\") " pod="openshift-ingress/e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9"
Jul 06 14:49:19.383099 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.382953    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1683fd34-5731-400d-b86c-98342160e1b3-workload-certs\") pod \"e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9\" (UID: \"1683fd34-5731-400d-b86c-98342160e1b3\") " pod="openshift-ingress/e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9"
Jul 06 14:49:19.383099 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.382979    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1683fd34-5731-400d-b86c-98342160e1b3-istio-token\") pod \"e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9\" (UID: \"1683fd34-5731-400d-b86c-98342160e1b3\") " pod="openshift-ingress/e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9"
Jul 06 14:49:19.383099 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.383006    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1683fd34-5731-400d-b86c-98342160e1b3-istiod-ca-cert\") pod \"e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9\" (UID: \"1683fd34-5731-400d-b86c-98342160e1b3\") " pod="openshift-ingress/e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9"
Jul 06 14:49:19.383099 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.383037    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2r62\" (UniqueName: \"kubernetes.io/projected/1683fd34-5731-400d-b86c-98342160e1b3-kube-api-access-r2r62\") pod \"e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9\" (UID: \"1683fd34-5731-400d-b86c-98342160e1b3\") " pod="openshift-ingress/e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9"
Jul 06 14:49:19.383099 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.383080    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1683fd34-5731-400d-b86c-98342160e1b3-workload-socket\") pod \"e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9\" (UID: \"1683fd34-5731-400d-b86c-98342160e1b3\") " pod="openshift-ingress/e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9"
Jul 06 14:49:19.383276 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.383139    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1683fd34-5731-400d-b86c-98342160e1b3-istio-podinfo\") pod \"e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9\" (UID: \"1683fd34-5731-400d-b86c-98342160e1b3\") " pod="openshift-ingress/e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9"
Jul 06 14:49:19.383276 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.383219    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1683fd34-5731-400d-b86c-98342160e1b3-istio-data\") pod \"e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9\" (UID: \"1683fd34-5731-400d-b86c-98342160e1b3\") " pod="openshift-ingress/e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9"
Jul 06 14:49:19.383276 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.383260    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1683fd34-5731-400d-b86c-98342160e1b3-istio-envoy\") pod \"e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9\" (UID: \"1683fd34-5731-400d-b86c-98342160e1b3\") " pod="openshift-ingress/e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9"
Jul 06 14:49:19.484430 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.484389    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1683fd34-5731-400d-b86c-98342160e1b3-credential-socket\") pod \"e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9\" (UID: \"1683fd34-5731-400d-b86c-98342160e1b3\") " pod="openshift-ingress/e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9"
Jul 06 14:49:19.484602 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.484463    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1683fd34-5731-400d-b86c-98342160e1b3-workload-certs\") pod \"e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9\" (UID: \"1683fd34-5731-400d-b86c-98342160e1b3\") " pod="openshift-ingress/e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9"
Jul 06 14:49:19.484602 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.484496    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1683fd34-5731-400d-b86c-98342160e1b3-istio-token\") pod \"e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9\" (UID: \"1683fd34-5731-400d-b86c-98342160e1b3\") " pod="openshift-ingress/e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9"
Jul 06 14:49:19.484602 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.484526    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1683fd34-5731-400d-b86c-98342160e1b3-istiod-ca-cert\") pod \"e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9\" (UID: \"1683fd34-5731-400d-b86c-98342160e1b3\") " pod="openshift-ingress/e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9"
Jul 06 14:49:19.484602 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.484558    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2r62\" (UniqueName: \"kubernetes.io/projected/1683fd34-5731-400d-b86c-98342160e1b3-kube-api-access-r2r62\") pod \"e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9\" (UID: \"1683fd34-5731-400d-b86c-98342160e1b3\") " pod="openshift-ingress/e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9"
Jul 06 14:49:19.484850 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.484606    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1683fd34-5731-400d-b86c-98342160e1b3-workload-socket\") pod \"e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9\" (UID: \"1683fd34-5731-400d-b86c-98342160e1b3\") " pod="openshift-ingress/e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9"
Jul 06 14:49:19.484850 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.484651    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1683fd34-5731-400d-b86c-98342160e1b3-istio-podinfo\") pod \"e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9\" (UID: \"1683fd34-5731-400d-b86c-98342160e1b3\") " pod="openshift-ingress/e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9"
Jul 06 14:49:19.484850 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.484728    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1683fd34-5731-400d-b86c-98342160e1b3-istio-data\") pod \"e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9\" (UID: \"1683fd34-5731-400d-b86c-98342160e1b3\") " pod="openshift-ingress/e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9"
Jul 06 14:49:19.484850 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.484780    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1683fd34-5731-400d-b86c-98342160e1b3-istio-envoy\") pod \"e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9\" (UID: \"1683fd34-5731-400d-b86c-98342160e1b3\") " pod="openshift-ingress/e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9"
Jul 06 14:49:19.485039 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.484893    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1683fd34-5731-400d-b86c-98342160e1b3-credential-socket\") pod \"e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9\" (UID: \"1683fd34-5731-400d-b86c-98342160e1b3\") " pod="openshift-ingress/e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9"
Jul 06 14:49:19.485506 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.485474    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1683fd34-5731-400d-b86c-98342160e1b3-istio-data\") pod \"e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9\" (UID: \"1683fd34-5731-400d-b86c-98342160e1b3\") " pod="openshift-ingress/e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9"
Jul 06 14:49:19.485640 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.485508    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1683fd34-5731-400d-b86c-98342160e1b3-workload-certs\") pod \"e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9\" (UID: \"1683fd34-5731-400d-b86c-98342160e1b3\") " pod="openshift-ingress/e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9"
Jul 06 14:49:19.485741 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.485715    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1683fd34-5731-400d-b86c-98342160e1b3-workload-socket\") pod \"e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9\" (UID: \"1683fd34-5731-400d-b86c-98342160e1b3\") " pod="openshift-ingress/e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9"
Jul 06 14:49:19.486034 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.485991    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1683fd34-5731-400d-b86c-98342160e1b3-istiod-ca-cert\") pod \"e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9\" (UID: \"1683fd34-5731-400d-b86c-98342160e1b3\") " pod="openshift-ingress/e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9"
Jul 06 14:49:19.488127 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.488098    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1683fd34-5731-400d-b86c-98342160e1b3-istio-envoy\") pod \"e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9\" (UID: \"1683fd34-5731-400d-b86c-98342160e1b3\") " pod="openshift-ingress/e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9"
Jul 06 14:49:19.488591 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.488567    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1683fd34-5731-400d-b86c-98342160e1b3-istio-podinfo\") pod \"e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9\" (UID: \"1683fd34-5731-400d-b86c-98342160e1b3\") " pod="openshift-ingress/e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9"
Jul 06 14:49:19.493714 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.493683    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2r62\" (UniqueName: \"kubernetes.io/projected/1683fd34-5731-400d-b86c-98342160e1b3-kube-api-access-r2r62\") pod \"e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9\" (UID: \"1683fd34-5731-400d-b86c-98342160e1b3\") " pod="openshift-ingress/e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9"
Jul 06 14:49:19.494044 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.493999    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1683fd34-5731-400d-b86c-98342160e1b3-istio-token\") pod \"e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9\" (UID: \"1683fd34-5731-400d-b86c-98342160e1b3\") " pod="openshift-ingress/e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9"
Jul 06 14:49:19.521117 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.521076    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9"
Jul 06 14:49:19.659446 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.659424    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9"]
Jul 06 14:49:19.661440 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:49:19.661413    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1683fd34_5731_400d_b86c_98342160e1b3.slice/crio-2c868a76903516e65054a14c65dc6fd4724fbc3813e9b01789023052bf9d4d70 WatchSource:0}: Error finding container 2c868a76903516e65054a14c65dc6fd4724fbc3813e9b01789023052bf9d4d70: Status 404 returned error can't find the container with id 2c868a76903516e65054a14c65dc6fd4724fbc3813e9b01789023052bf9d4d70
Jul 06 14:49:19.664757 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.663974    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:49:19.664757 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.664132    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:49:19.664757 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.664221    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:49:19.778075 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.778029    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9" event={"ID":"1683fd34-5731-400d-b86c-98342160e1b3","Type":"ContainerStarted","Data":"030e62d87b28b79253bcc64c57fc609d16e4b164d47fad7e31ee2b4446e32579"}
Jul 06 14:49:19.778249 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.778140    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9" event={"ID":"1683fd34-5731-400d-b86c-98342160e1b3","Type":"ContainerStarted","Data":"2c868a76903516e65054a14c65dc6fd4724fbc3813e9b01789023052bf9d4d70"}
Jul 06 14:49:19.779924 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.779895    2565 generic.go:356] "Generic (PLEG): container finished" podID="55c7e873-ad08-4929-94b6-f6ff12efcd09" containerID="a76bfedd6b0226785d000ed40963bb77a9e94f3e479c4597b74130495d60d424" exitCode=0
Jul 06 14:49:19.780059 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.779950    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs"
Jul 06 14:49:19.780059 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.779949    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs" event={"ID":"55c7e873-ad08-4929-94b6-f6ff12efcd09","Type":"ContainerDied","Data":"a76bfedd6b0226785d000ed40963bb77a9e94f3e479c4597b74130495d60d424"}
Jul 06 14:49:19.780171 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.780072    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs" event={"ID":"55c7e873-ad08-4929-94b6-f6ff12efcd09","Type":"ContainerDied","Data":"8a2f403f14c0c6218d3d2e228f7a31e6a73ed43ec5a3e17dd2c7a8e3907f75b8"}
Jul 06 14:49:19.780171 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.780092    2565 scope.go:117] "RemoveContainer" containerID="a76bfedd6b0226785d000ed40963bb77a9e94f3e479c4597b74130495d60d424"
Jul 06 14:49:19.794071 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.794048    2565 scope.go:117] "RemoveContainer" containerID="e8a9f776d48a0961d63ff4766662482caaa94ca8b4e0e1e971235de9280d845d"
Jul 06 14:49:19.799712 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.799657    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9" podStartSLOduration=0.799635491 podStartE2EDuration="799.635491ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:49:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:49:19.798212115 +0000 UTC m=+1562.976861174" watchObservedRunningTime="2026-07-06 14:49:19.799635491 +0000 UTC m=+1562.978284532"
Jul 06 14:49:19.804737 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.804712    2565 scope.go:117] "RemoveContainer" containerID="a76bfedd6b0226785d000ed40963bb77a9e94f3e479c4597b74130495d60d424"
Jul 06 14:49:19.805073 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:49:19.805052    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a76bfedd6b0226785d000ed40963bb77a9e94f3e479c4597b74130495d60d424\": container with ID starting with a76bfedd6b0226785d000ed40963bb77a9e94f3e479c4597b74130495d60d424 not found: ID does not exist" containerID="a76bfedd6b0226785d000ed40963bb77a9e94f3e479c4597b74130495d60d424"
Jul 06 14:49:19.805161 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.805085    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a76bfedd6b0226785d000ed40963bb77a9e94f3e479c4597b74130495d60d424"} err="failed to get container status \"a76bfedd6b0226785d000ed40963bb77a9e94f3e479c4597b74130495d60d424\": rpc error: code = NotFound desc = could not find container \"a76bfedd6b0226785d000ed40963bb77a9e94f3e479c4597b74130495d60d424\": container with ID starting with a76bfedd6b0226785d000ed40963bb77a9e94f3e479c4597b74130495d60d424 not found: ID does not exist"
Jul 06 14:49:19.805161 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.805110    2565 scope.go:117] "RemoveContainer" containerID="e8a9f776d48a0961d63ff4766662482caaa94ca8b4e0e1e971235de9280d845d"
Jul 06 14:49:19.805392 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:49:19.805367    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8a9f776d48a0961d63ff4766662482caaa94ca8b4e0e1e971235de9280d845d\": container with ID starting with e8a9f776d48a0961d63ff4766662482caaa94ca8b4e0e1e971235de9280d845d not found: ID does not exist" containerID="e8a9f776d48a0961d63ff4766662482caaa94ca8b4e0e1e971235de9280d845d"
Jul 06 14:49:19.805445 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.805401    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8a9f776d48a0961d63ff4766662482caaa94ca8b4e0e1e971235de9280d845d"} err="failed to get container status \"e8a9f776d48a0961d63ff4766662482caaa94ca8b4e0e1e971235de9280d845d\": rpc error: code = NotFound desc = could not find container \"e8a9f776d48a0961d63ff4766662482caaa94ca8b4e0e1e971235de9280d845d\": container with ID starting with e8a9f776d48a0961d63ff4766662482caaa94ca8b4e0e1e971235de9280d845d not found: ID does not exist"
Jul 06 14:49:19.814296 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.814264    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs"]
Jul 06 14:49:19.819911 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.819886    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-1d78acdd-openshift-default-64f65f5547-bhnqs"]
Jul 06 14:49:19.955736 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:19.955704    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55c7e873-ad08-4929-94b6-f6ff12efcd09" path="/var/lib/kubelet/pods/55c7e873-ad08-4929-94b6-f6ff12efcd09/volumes"
Jul 06 14:49:20.521569 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:20.521480    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9"
Jul 06 14:49:20.525841 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:20.525813    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9"
Jul 06 14:49:20.787452 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:20.787379    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9"
Jul 06 14:49:20.788439 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:20.788423    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9"
Jul 06 14:49:24.942121 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:24.942091    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9"]
Jul 06 14:49:24.942593 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:24.942261    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9" podUID="1683fd34-5731-400d-b86c-98342160e1b3" containerName="istio-proxy" containerID="cri-o://030e62d87b28b79253bcc64c57fc609d16e4b164d47fad7e31ee2b4446e32579" gracePeriod=30
Jul 06 14:49:30.813906 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:30.813856    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9"
Jul 06 14:49:30.844985 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:30.844953    2565 generic.go:356] "Generic (PLEG): container finished" podID="1683fd34-5731-400d-b86c-98342160e1b3" containerID="030e62d87b28b79253bcc64c57fc609d16e4b164d47fad7e31ee2b4446e32579" exitCode=0
Jul 06 14:49:30.845116 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:30.845047    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9"
Jul 06 14:49:30.845116 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:30.845076    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9" event={"ID":"1683fd34-5731-400d-b86c-98342160e1b3","Type":"ContainerDied","Data":"030e62d87b28b79253bcc64c57fc609d16e4b164d47fad7e31ee2b4446e32579"}
Jul 06 14:49:30.845195 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:30.845126    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9" event={"ID":"1683fd34-5731-400d-b86c-98342160e1b3","Type":"ContainerDied","Data":"2c868a76903516e65054a14c65dc6fd4724fbc3813e9b01789023052bf9d4d70"}
Jul 06 14:49:30.845195 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:30.845156    2565 scope.go:117] "RemoveContainer" containerID="030e62d87b28b79253bcc64c57fc609d16e4b164d47fad7e31ee2b4446e32579"
Jul 06 14:49:30.854033 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:30.854014    2565 scope.go:117] "RemoveContainer" containerID="030e62d87b28b79253bcc64c57fc609d16e4b164d47fad7e31ee2b4446e32579"
Jul 06 14:49:30.854284 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:49:30.854268    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"030e62d87b28b79253bcc64c57fc609d16e4b164d47fad7e31ee2b4446e32579\": container with ID starting with 030e62d87b28b79253bcc64c57fc609d16e4b164d47fad7e31ee2b4446e32579 not found: ID does not exist" containerID="030e62d87b28b79253bcc64c57fc609d16e4b164d47fad7e31ee2b4446e32579"
Jul 06 14:49:30.854362 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:30.854294    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"030e62d87b28b79253bcc64c57fc609d16e4b164d47fad7e31ee2b4446e32579"} err="failed to get container status \"030e62d87b28b79253bcc64c57fc609d16e4b164d47fad7e31ee2b4446e32579\": rpc error: code = NotFound desc = could not find container \"030e62d87b28b79253bcc64c57fc609d16e4b164d47fad7e31ee2b4446e32579\": container with ID starting with 030e62d87b28b79253bcc64c57fc609d16e4b164d47fad7e31ee2b4446e32579 not found: ID does not exist"
Jul 06 14:49:30.901223 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:30.901199    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1683fd34-5731-400d-b86c-98342160e1b3-workload-socket\") pod \"1683fd34-5731-400d-b86c-98342160e1b3\" (UID: \"1683fd34-5731-400d-b86c-98342160e1b3\") "
Jul 06 14:49:30.901375 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:30.901240    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1683fd34-5731-400d-b86c-98342160e1b3-istio-token\") pod \"1683fd34-5731-400d-b86c-98342160e1b3\" (UID: \"1683fd34-5731-400d-b86c-98342160e1b3\") "
Jul 06 14:49:30.901375 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:30.901262    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1683fd34-5731-400d-b86c-98342160e1b3-workload-certs\") pod \"1683fd34-5731-400d-b86c-98342160e1b3\" (UID: \"1683fd34-5731-400d-b86c-98342160e1b3\") "
Jul 06 14:49:30.901375 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:30.901294    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1683fd34-5731-400d-b86c-98342160e1b3-istiod-ca-cert\") pod \"1683fd34-5731-400d-b86c-98342160e1b3\" (UID: \"1683fd34-5731-400d-b86c-98342160e1b3\") "
Jul 06 14:49:30.901375 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:30.901332    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r2r62\" (UniqueName: \"kubernetes.io/projected/1683fd34-5731-400d-b86c-98342160e1b3-kube-api-access-r2r62\") pod \"1683fd34-5731-400d-b86c-98342160e1b3\" (UID: \"1683fd34-5731-400d-b86c-98342160e1b3\") "
Jul 06 14:49:30.901593 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:30.901406    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1683fd34-5731-400d-b86c-98342160e1b3-credential-socket\") pod \"1683fd34-5731-400d-b86c-98342160e1b3\" (UID: \"1683fd34-5731-400d-b86c-98342160e1b3\") "
Jul 06 14:49:30.901593 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:30.901539    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1683fd34-5731-400d-b86c-98342160e1b3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1683fd34-5731-400d-b86c-98342160e1b3" (UID: "1683fd34-5731-400d-b86c-98342160e1b3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:49:30.901700 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:30.901606    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1683fd34-5731-400d-b86c-98342160e1b3-istio-podinfo\") pod \"1683fd34-5731-400d-b86c-98342160e1b3\" (UID: \"1683fd34-5731-400d-b86c-98342160e1b3\") "
Jul 06 14:49:30.901700 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:30.901623    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1683fd34-5731-400d-b86c-98342160e1b3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1683fd34-5731-400d-b86c-98342160e1b3" (UID: "1683fd34-5731-400d-b86c-98342160e1b3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:49:30.901700 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:30.901646    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1683fd34-5731-400d-b86c-98342160e1b3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1683fd34-5731-400d-b86c-98342160e1b3" (UID: "1683fd34-5731-400d-b86c-98342160e1b3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:49:30.901700 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:30.901650    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1683fd34-5731-400d-b86c-98342160e1b3-istio-envoy\") pod \"1683fd34-5731-400d-b86c-98342160e1b3\" (UID: \"1683fd34-5731-400d-b86c-98342160e1b3\") "
Jul 06 14:49:30.902003 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:30.901765    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1683fd34-5731-400d-b86c-98342160e1b3-istio-data\") pod \"1683fd34-5731-400d-b86c-98342160e1b3\" (UID: \"1683fd34-5731-400d-b86c-98342160e1b3\") "
Jul 06 14:49:30.902003 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:30.901845    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1683fd34-5731-400d-b86c-98342160e1b3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1683fd34-5731-400d-b86c-98342160e1b3" (UID: "1683fd34-5731-400d-b86c-98342160e1b3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:49:30.902150 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:30.902125    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1683fd34-5731-400d-b86c-98342160e1b3-istiod-ca-cert\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:49:30.902150 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:30.902151    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1683fd34-5731-400d-b86c-98342160e1b3-credential-socket\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:49:30.902332 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:30.902165    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1683fd34-5731-400d-b86c-98342160e1b3-workload-socket\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:49:30.902332 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:30.902178    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1683fd34-5731-400d-b86c-98342160e1b3-workload-certs\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:49:30.902615 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:30.902594    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1683fd34-5731-400d-b86c-98342160e1b3-istio-data" (OuterVolumeSpecName: "istio-data") pod "1683fd34-5731-400d-b86c-98342160e1b3" (UID: "1683fd34-5731-400d-b86c-98342160e1b3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:49:30.903578 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:30.903557    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1683fd34-5731-400d-b86c-98342160e1b3-kube-api-access-r2r62" (OuterVolumeSpecName: "kube-api-access-r2r62") pod "1683fd34-5731-400d-b86c-98342160e1b3" (UID: "1683fd34-5731-400d-b86c-98342160e1b3"). InnerVolumeSpecName "kube-api-access-r2r62". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:49:30.903834 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:30.903808    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1683fd34-5731-400d-b86c-98342160e1b3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1683fd34-5731-400d-b86c-98342160e1b3" (UID: "1683fd34-5731-400d-b86c-98342160e1b3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 14:49:30.903932 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:30.903898    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1683fd34-5731-400d-b86c-98342160e1b3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1683fd34-5731-400d-b86c-98342160e1b3" (UID: "1683fd34-5731-400d-b86c-98342160e1b3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:49:30.903932 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:30.903920    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1683fd34-5731-400d-b86c-98342160e1b3-istio-token" (OuterVolumeSpecName: "istio-token") pod "1683fd34-5731-400d-b86c-98342160e1b3" (UID: "1683fd34-5731-400d-b86c-98342160e1b3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:49:31.003788 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:31.003689    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r2r62\" (UniqueName: \"kubernetes.io/projected/1683fd34-5731-400d-b86c-98342160e1b3-kube-api-access-r2r62\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:49:31.003788 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:31.003723    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1683fd34-5731-400d-b86c-98342160e1b3-istio-podinfo\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:49:31.003788 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:31.003739    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1683fd34-5731-400d-b86c-98342160e1b3-istio-envoy\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:49:31.003788 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:31.003753    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1683fd34-5731-400d-b86c-98342160e1b3-istio-data\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:49:31.003788 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:31.003763    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1683fd34-5731-400d-b86c-98342160e1b3-istio-token\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:49:31.167832 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:31.167805    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9"]
Jul 06 14:49:31.171760 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:31.171736    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-b7b274f6-openshift-default-9844bbf5f-p5xm9"]
Jul 06 14:49:31.954273 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:49:31.954241    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1683fd34-5731-400d-b86c-98342160e1b3" path="/var/lib/kubelet/pods/1683fd34-5731-400d-b86c-98342160e1b3/volumes"
Jul 06 14:51:59.946352 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:51:59.946264    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4"]
Jul 06 14:51:59.946812 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:51:59.946795    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1683fd34-5731-400d-b86c-98342160e1b3" containerName="istio-proxy"
Jul 06 14:51:59.946862 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:51:59.946814    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1683fd34-5731-400d-b86c-98342160e1b3" containerName="istio-proxy"
Jul 06 14:51:59.946862 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:51:59.946830    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55c7e873-ad08-4929-94b6-f6ff12efcd09" containerName="istio-proxy"
Jul 06 14:51:59.946862 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:51:59.946835    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="55c7e873-ad08-4929-94b6-f6ff12efcd09" containerName="istio-proxy"
Jul 06 14:51:59.946990 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:51:59.946902    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1683fd34-5731-400d-b86c-98342160e1b3" containerName="istio-proxy"
Jul 06 14:51:59.949541 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:51:59.949517    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4"
Jul 06 14:51:59.951943 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:51:59.951922    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-4937319b-openshift-default-dockercfg-k8zmp\""
Jul 06 14:51:59.963362 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:51:59.963324    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4"]
Jul 06 14:52:00.053524 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:00.053491    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af1c2bf7-1ada-4489-8084-d8a5fcf66492-istio-token\") pod \"e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4\" (UID: \"af1c2bf7-1ada-4489-8084-d8a5fcf66492\") " pod="openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4"
Jul 06 14:52:00.053716 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:00.053538    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af1c2bf7-1ada-4489-8084-d8a5fcf66492-workload-socket\") pod \"e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4\" (UID: \"af1c2bf7-1ada-4489-8084-d8a5fcf66492\") " pod="openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4"
Jul 06 14:52:00.053716 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:00.053562    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af1c2bf7-1ada-4489-8084-d8a5fcf66492-istio-envoy\") pod \"e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4\" (UID: \"af1c2bf7-1ada-4489-8084-d8a5fcf66492\") " pod="openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4"
Jul 06 14:52:00.053716 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:00.053578    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af1c2bf7-1ada-4489-8084-d8a5fcf66492-workload-certs\") pod \"e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4\" (UID: \"af1c2bf7-1ada-4489-8084-d8a5fcf66492\") " pod="openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4"
Jul 06 14:52:00.053716 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:00.053641    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af1c2bf7-1ada-4489-8084-d8a5fcf66492-istio-data\") pod \"e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4\" (UID: \"af1c2bf7-1ada-4489-8084-d8a5fcf66492\") " pod="openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4"
Jul 06 14:52:00.053716 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:00.053682    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af1c2bf7-1ada-4489-8084-d8a5fcf66492-istio-podinfo\") pod \"e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4\" (UID: \"af1c2bf7-1ada-4489-8084-d8a5fcf66492\") " pod="openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4"
Jul 06 14:52:00.053716 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:00.053699    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af1c2bf7-1ada-4489-8084-d8a5fcf66492-istiod-ca-cert\") pod \"e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4\" (UID: \"af1c2bf7-1ada-4489-8084-d8a5fcf66492\") " pod="openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4"
Jul 06 14:52:00.053917 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:00.053759    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af1c2bf7-1ada-4489-8084-d8a5fcf66492-credential-socket\") pod \"e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4\" (UID: \"af1c2bf7-1ada-4489-8084-d8a5fcf66492\") " pod="openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4"
Jul 06 14:52:00.053917 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:00.053781    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bm7fr\" (UniqueName: \"kubernetes.io/projected/af1c2bf7-1ada-4489-8084-d8a5fcf66492-kube-api-access-bm7fr\") pod \"e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4\" (UID: \"af1c2bf7-1ada-4489-8084-d8a5fcf66492\") " pod="openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4"
Jul 06 14:52:00.154951 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:00.154913    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af1c2bf7-1ada-4489-8084-d8a5fcf66492-credential-socket\") pod \"e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4\" (UID: \"af1c2bf7-1ada-4489-8084-d8a5fcf66492\") " pod="openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4"
Jul 06 14:52:00.154951 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:00.154951    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bm7fr\" (UniqueName: \"kubernetes.io/projected/af1c2bf7-1ada-4489-8084-d8a5fcf66492-kube-api-access-bm7fr\") pod \"e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4\" (UID: \"af1c2bf7-1ada-4489-8084-d8a5fcf66492\") " pod="openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4"
Jul 06 14:52:00.155218 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:00.155009    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af1c2bf7-1ada-4489-8084-d8a5fcf66492-istio-token\") pod \"e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4\" (UID: \"af1c2bf7-1ada-4489-8084-d8a5fcf66492\") " pod="openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4"
Jul 06 14:52:00.155218 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:00.155043    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af1c2bf7-1ada-4489-8084-d8a5fcf66492-workload-socket\") pod \"e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4\" (UID: \"af1c2bf7-1ada-4489-8084-d8a5fcf66492\") " pod="openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4"
Jul 06 14:52:00.155218 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:00.155067    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af1c2bf7-1ada-4489-8084-d8a5fcf66492-istio-envoy\") pod \"e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4\" (UID: \"af1c2bf7-1ada-4489-8084-d8a5fcf66492\") " pod="openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4"
Jul 06 14:52:00.155218 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:00.155090    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af1c2bf7-1ada-4489-8084-d8a5fcf66492-workload-certs\") pod \"e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4\" (UID: \"af1c2bf7-1ada-4489-8084-d8a5fcf66492\") " pod="openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4"
Jul 06 14:52:00.155218 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:00.155132    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af1c2bf7-1ada-4489-8084-d8a5fcf66492-istio-data\") pod \"e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4\" (UID: \"af1c2bf7-1ada-4489-8084-d8a5fcf66492\") " pod="openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4"
Jul 06 14:52:00.155218 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:00.155166    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af1c2bf7-1ada-4489-8084-d8a5fcf66492-istio-podinfo\") pod \"e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4\" (UID: \"af1c2bf7-1ada-4489-8084-d8a5fcf66492\") " pod="openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4"
Jul 06 14:52:00.155218 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:00.155190    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af1c2bf7-1ada-4489-8084-d8a5fcf66492-istiod-ca-cert\") pod \"e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4\" (UID: \"af1c2bf7-1ada-4489-8084-d8a5fcf66492\") " pod="openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4"
Jul 06 14:52:00.155527 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:00.155487    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af1c2bf7-1ada-4489-8084-d8a5fcf66492-workload-socket\") pod \"e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4\" (UID: \"af1c2bf7-1ada-4489-8084-d8a5fcf66492\") " pod="openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4"
Jul 06 14:52:00.155527 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:00.155515    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af1c2bf7-1ada-4489-8084-d8a5fcf66492-credential-socket\") pod \"e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4\" (UID: \"af1c2bf7-1ada-4489-8084-d8a5fcf66492\") " pod="openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4"
Jul 06 14:52:00.155760 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:00.155736    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af1c2bf7-1ada-4489-8084-d8a5fcf66492-workload-certs\") pod \"e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4\" (UID: \"af1c2bf7-1ada-4489-8084-d8a5fcf66492\") " pod="openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4"
Jul 06 14:52:00.155843 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:00.155772    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af1c2bf7-1ada-4489-8084-d8a5fcf66492-istio-data\") pod \"e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4\" (UID: \"af1c2bf7-1ada-4489-8084-d8a5fcf66492\") " pod="openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4"
Jul 06 14:52:00.155933 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:00.155917    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af1c2bf7-1ada-4489-8084-d8a5fcf66492-istiod-ca-cert\") pod \"e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4\" (UID: \"af1c2bf7-1ada-4489-8084-d8a5fcf66492\") " pod="openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4"
Jul 06 14:52:00.157430 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:00.157408    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af1c2bf7-1ada-4489-8084-d8a5fcf66492-istio-envoy\") pod \"e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4\" (UID: \"af1c2bf7-1ada-4489-8084-d8a5fcf66492\") " pod="openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4"
Jul 06 14:52:00.157671 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:00.157652    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af1c2bf7-1ada-4489-8084-d8a5fcf66492-istio-podinfo\") pod \"e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4\" (UID: \"af1c2bf7-1ada-4489-8084-d8a5fcf66492\") " pod="openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4"
Jul 06 14:52:00.167826 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:00.167796    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af1c2bf7-1ada-4489-8084-d8a5fcf66492-istio-token\") pod \"e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4\" (UID: \"af1c2bf7-1ada-4489-8084-d8a5fcf66492\") " pod="openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4"
Jul 06 14:52:00.168620 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:00.168603    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bm7fr\" (UniqueName: \"kubernetes.io/projected/af1c2bf7-1ada-4489-8084-d8a5fcf66492-kube-api-access-bm7fr\") pod \"e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4\" (UID: \"af1c2bf7-1ada-4489-8084-d8a5fcf66492\") " pod="openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4"
Jul 06 14:52:00.260499 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:00.260408    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4"
Jul 06 14:52:00.411140 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:00.411110    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4"]
Jul 06 14:52:00.414996 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:52:00.414965    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf1c2bf7_1ada_4489_8084_d8a5fcf66492.slice/crio-e63c9cdefa3e753ef363ac93621421101475d37d0a8cdaa7770db883153757d0 WatchSource:0}: Error finding container e63c9cdefa3e753ef363ac93621421101475d37d0a8cdaa7770db883153757d0: Status 404 returned error can't find the container with id e63c9cdefa3e753ef363ac93621421101475d37d0a8cdaa7770db883153757d0
Jul 06 14:52:00.417102 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:00.417070    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:52:00.417178 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:00.417133    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:52:00.417178 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:00.417162    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:52:00.612036 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:00.611941    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4" event={"ID":"af1c2bf7-1ada-4489-8084-d8a5fcf66492","Type":"ContainerStarted","Data":"788f2cf5be3599472f624728dd9af182fdaad46f7e41e8fb07fe930977469c6f"}
Jul 06 14:52:00.612036 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:00.612007    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4" event={"ID":"af1c2bf7-1ada-4489-8084-d8a5fcf66492","Type":"ContainerStarted","Data":"e63c9cdefa3e753ef363ac93621421101475d37d0a8cdaa7770db883153757d0"}
Jul 06 14:52:00.636702 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:00.636643    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4" podStartSLOduration=1.636621469 podStartE2EDuration="1.636621469s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:51:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:52:00.635705272 +0000 UTC m=+1723.814354347" watchObservedRunningTime="2026-07-06 14:52:00.636621469 +0000 UTC m=+1723.815270516"
Jul 06 14:52:01.261393 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:01.261320    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4"
Jul 06 14:52:01.262895 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:01.262873    2565 patch_prober.go:28] interesting pod/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 06 14:52:01.262950 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:01.262924    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4" podUID="af1c2bf7-1ada-4489-8084-d8a5fcf66492" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 06 14:52:02.264554 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:02.264522    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4"
Jul 06 14:52:02.622715 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:02.622629    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4"
Jul 06 14:52:02.623620 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:02.623597    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4"
Jul 06 14:52:15.691429 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:15.691390    2565 generic.go:356] "Generic (PLEG): container finished" podID="af1c2bf7-1ada-4489-8084-d8a5fcf66492" containerID="788f2cf5be3599472f624728dd9af182fdaad46f7e41e8fb07fe930977469c6f" exitCode=0
Jul 06 14:52:15.691858 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:15.691461    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4" event={"ID":"af1c2bf7-1ada-4489-8084-d8a5fcf66492","Type":"ContainerDied","Data":"788f2cf5be3599472f624728dd9af182fdaad46f7e41e8fb07fe930977469c6f"}
Jul 06 14:52:15.691937 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:15.691922    2565 scope.go:117] "RemoveContainer" containerID="788f2cf5be3599472f624728dd9af182fdaad46f7e41e8fb07fe930977469c6f"
Jul 06 14:52:15.693012 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:15.692980    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:52:15.693087 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:15.693068    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:52:15.693146 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:15.693132    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:52:16.702522 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:16.702480    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4" event={"ID":"af1c2bf7-1ada-4489-8084-d8a5fcf66492","Type":"ContainerStarted","Data":"5c21d72aa7677dca9c153a4247bb346e47852f07d3ab1f6f792fbd5678b96558"}
Jul 06 14:52:17.261186 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:17.261156    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4"
Jul 06 14:52:17.262144 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:17.262121    2565 patch_prober.go:28] interesting pod/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 06 14:52:17.262272 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:17.262164    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4" podUID="af1c2bf7-1ada-4489-8084-d8a5fcf66492" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 06 14:52:17.623232 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:17.623144    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4"
Jul 06 14:52:18.261305 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:18.261255    2565 patch_prober.go:28] interesting pod/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 06 14:52:18.261724 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:18.261370    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4" podUID="af1c2bf7-1ada-4489-8084-d8a5fcf66492" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 06 14:52:19.260973 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:19.260932    2565 patch_prober.go:28] interesting pod/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 06 14:52:19.261152 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:19.261005    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4" podUID="af1c2bf7-1ada-4489-8084-d8a5fcf66492" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 06 14:52:20.261163 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:20.261120    2565 patch_prober.go:28] interesting pod/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 06 14:52:20.261605 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:20.261192    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4" podUID="af1c2bf7-1ada-4489-8084-d8a5fcf66492" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 06 14:52:21.265169 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:21.265136    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4"
Jul 06 14:52:21.266036 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:52:21.266020    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4"
Jul 06 14:53:50.098496 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:53:50.098463    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4"]
Jul 06 14:53:50.099120 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:53:50.098691    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4" podUID="af1c2bf7-1ada-4489-8084-d8a5fcf66492" containerName="istio-proxy" containerID="cri-o://5c21d72aa7677dca9c153a4247bb346e47852f07d3ab1f6f792fbd5678b96558" gracePeriod=30
Jul 06 14:53:51.267934 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:53:51.267890    2565 patch_prober.go:28] interesting pod/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 06 14:53:51.268313 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:53:51.267977    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4" podUID="af1c2bf7-1ada-4489-8084-d8a5fcf66492" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 14:53:55.352428 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:53:55.352403    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4"
Jul 06 14:53:55.544470 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:53:55.544436    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af1c2bf7-1ada-4489-8084-d8a5fcf66492-workload-certs\") pod \"af1c2bf7-1ada-4489-8084-d8a5fcf66492\" (UID: \"af1c2bf7-1ada-4489-8084-d8a5fcf66492\") "
Jul 06 14:53:55.544470 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:53:55.544473    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af1c2bf7-1ada-4489-8084-d8a5fcf66492-istio-data\") pod \"af1c2bf7-1ada-4489-8084-d8a5fcf66492\" (UID: \"af1c2bf7-1ada-4489-8084-d8a5fcf66492\") "
Jul 06 14:53:55.544728 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:53:55.544493    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af1c2bf7-1ada-4489-8084-d8a5fcf66492-workload-socket\") pod \"af1c2bf7-1ada-4489-8084-d8a5fcf66492\" (UID: \"af1c2bf7-1ada-4489-8084-d8a5fcf66492\") "
Jul 06 14:53:55.544728 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:53:55.544518    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bm7fr\" (UniqueName: \"kubernetes.io/projected/af1c2bf7-1ada-4489-8084-d8a5fcf66492-kube-api-access-bm7fr\") pod \"af1c2bf7-1ada-4489-8084-d8a5fcf66492\" (UID: \"af1c2bf7-1ada-4489-8084-d8a5fcf66492\") "
Jul 06 14:53:55.544728 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:53:55.544597    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af1c2bf7-1ada-4489-8084-d8a5fcf66492-istio-podinfo\") pod \"af1c2bf7-1ada-4489-8084-d8a5fcf66492\" (UID: \"af1c2bf7-1ada-4489-8084-d8a5fcf66492\") "
Jul 06 14:53:55.544728 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:53:55.544623    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af1c2bf7-1ada-4489-8084-d8a5fcf66492-credential-socket\") pod \"af1c2bf7-1ada-4489-8084-d8a5fcf66492\" (UID: \"af1c2bf7-1ada-4489-8084-d8a5fcf66492\") "
Jul 06 14:53:55.544728 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:53:55.544656    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af1c2bf7-1ada-4489-8084-d8a5fcf66492-istio-envoy\") pod \"af1c2bf7-1ada-4489-8084-d8a5fcf66492\" (UID: \"af1c2bf7-1ada-4489-8084-d8a5fcf66492\") "
Jul 06 14:53:55.544728 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:53:55.544691    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af1c2bf7-1ada-4489-8084-d8a5fcf66492-istiod-ca-cert\") pod \"af1c2bf7-1ada-4489-8084-d8a5fcf66492\" (UID: \"af1c2bf7-1ada-4489-8084-d8a5fcf66492\") "
Jul 06 14:53:55.544728 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:53:55.544726    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af1c2bf7-1ada-4489-8084-d8a5fcf66492-istio-token\") pod \"af1c2bf7-1ada-4489-8084-d8a5fcf66492\" (UID: \"af1c2bf7-1ada-4489-8084-d8a5fcf66492\") "
Jul 06 14:53:55.545163 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:53:55.544743    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af1c2bf7-1ada-4489-8084-d8a5fcf66492-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "af1c2bf7-1ada-4489-8084-d8a5fcf66492" (UID: "af1c2bf7-1ada-4489-8084-d8a5fcf66492"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:53:55.545163 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:53:55.544815    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af1c2bf7-1ada-4489-8084-d8a5fcf66492-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "af1c2bf7-1ada-4489-8084-d8a5fcf66492" (UID: "af1c2bf7-1ada-4489-8084-d8a5fcf66492"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:53:55.545163 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:53:55.544934    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af1c2bf7-1ada-4489-8084-d8a5fcf66492-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "af1c2bf7-1ada-4489-8084-d8a5fcf66492" (UID: "af1c2bf7-1ada-4489-8084-d8a5fcf66492"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:53:55.545163 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:53:55.545132    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af1c2bf7-1ada-4489-8084-d8a5fcf66492-credential-socket\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:53:55.545163 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:53:55.545151    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af1c2bf7-1ada-4489-8084-d8a5fcf66492-workload-certs\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:53:55.545163 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:53:55.545165    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af1c2bf7-1ada-4489-8084-d8a5fcf66492-workload-socket\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:53:55.545527 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:53:55.545221    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af1c2bf7-1ada-4489-8084-d8a5fcf66492-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "af1c2bf7-1ada-4489-8084-d8a5fcf66492" (UID: "af1c2bf7-1ada-4489-8084-d8a5fcf66492"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:53:55.545527 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:53:55.545457    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af1c2bf7-1ada-4489-8084-d8a5fcf66492-istio-data" (OuterVolumeSpecName: "istio-data") pod "af1c2bf7-1ada-4489-8084-d8a5fcf66492" (UID: "af1c2bf7-1ada-4489-8084-d8a5fcf66492"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:53:55.546959 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:53:55.546938    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af1c2bf7-1ada-4489-8084-d8a5fcf66492-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "af1c2bf7-1ada-4489-8084-d8a5fcf66492" (UID: "af1c2bf7-1ada-4489-8084-d8a5fcf66492"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:53:55.547036 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:53:55.547021    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af1c2bf7-1ada-4489-8084-d8a5fcf66492-kube-api-access-bm7fr" (OuterVolumeSpecName: "kube-api-access-bm7fr") pod "af1c2bf7-1ada-4489-8084-d8a5fcf66492" (UID: "af1c2bf7-1ada-4489-8084-d8a5fcf66492"). InnerVolumeSpecName "kube-api-access-bm7fr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:53:55.547313 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:53:55.547293    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/af1c2bf7-1ada-4489-8084-d8a5fcf66492-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "af1c2bf7-1ada-4489-8084-d8a5fcf66492" (UID: "af1c2bf7-1ada-4489-8084-d8a5fcf66492"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 14:53:55.547372 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:53:55.547319    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af1c2bf7-1ada-4489-8084-d8a5fcf66492-istio-token" (OuterVolumeSpecName: "istio-token") pod "af1c2bf7-1ada-4489-8084-d8a5fcf66492" (UID: "af1c2bf7-1ada-4489-8084-d8a5fcf66492"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:53:55.646029 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:53:55.645989    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af1c2bf7-1ada-4489-8084-d8a5fcf66492-istio-data\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:53:55.646029 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:53:55.646025    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bm7fr\" (UniqueName: \"kubernetes.io/projected/af1c2bf7-1ada-4489-8084-d8a5fcf66492-kube-api-access-bm7fr\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:53:55.646029 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:53:55.646035    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af1c2bf7-1ada-4489-8084-d8a5fcf66492-istio-podinfo\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:53:55.646270 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:53:55.646044    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af1c2bf7-1ada-4489-8084-d8a5fcf66492-istio-envoy\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:53:55.646270 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:53:55.646052    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af1c2bf7-1ada-4489-8084-d8a5fcf66492-istiod-ca-cert\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:53:55.646270 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:53:55.646059    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af1c2bf7-1ada-4489-8084-d8a5fcf66492-istio-token\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:53:56.214054 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:53:56.213960    2565 generic.go:356] "Generic (PLEG): container finished" podID="af1c2bf7-1ada-4489-8084-d8a5fcf66492" containerID="5c21d72aa7677dca9c153a4247bb346e47852f07d3ab1f6f792fbd5678b96558" exitCode=0
Jul 06 14:53:56.214054 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:53:56.214024    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4"
Jul 06 14:53:56.214238 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:53:56.214050    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4" event={"ID":"af1c2bf7-1ada-4489-8084-d8a5fcf66492","Type":"ContainerDied","Data":"5c21d72aa7677dca9c153a4247bb346e47852f07d3ab1f6f792fbd5678b96558"}
Jul 06 14:53:56.214238 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:53:56.214101    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4" event={"ID":"af1c2bf7-1ada-4489-8084-d8a5fcf66492","Type":"ContainerDied","Data":"e63c9cdefa3e753ef363ac93621421101475d37d0a8cdaa7770db883153757d0"}
Jul 06 14:53:56.214238 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:53:56.214123    2565 scope.go:117] "RemoveContainer" containerID="5c21d72aa7677dca9c153a4247bb346e47852f07d3ab1f6f792fbd5678b96558"
Jul 06 14:53:56.222874 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:53:56.222855    2565 scope.go:117] "RemoveContainer" containerID="788f2cf5be3599472f624728dd9af182fdaad46f7e41e8fb07fe930977469c6f"
Jul 06 14:53:56.231272 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:53:56.231253    2565 scope.go:117] "RemoveContainer" containerID="5c21d72aa7677dca9c153a4247bb346e47852f07d3ab1f6f792fbd5678b96558"
Jul 06 14:53:56.231584 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:53:56.231562    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c21d72aa7677dca9c153a4247bb346e47852f07d3ab1f6f792fbd5678b96558\": container with ID starting with 5c21d72aa7677dca9c153a4247bb346e47852f07d3ab1f6f792fbd5678b96558 not found: ID does not exist" containerID="5c21d72aa7677dca9c153a4247bb346e47852f07d3ab1f6f792fbd5678b96558"
Jul 06 14:53:56.231651 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:53:56.231593    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c21d72aa7677dca9c153a4247bb346e47852f07d3ab1f6f792fbd5678b96558"} err="failed to get container status \"5c21d72aa7677dca9c153a4247bb346e47852f07d3ab1f6f792fbd5678b96558\": rpc error: code = NotFound desc = could not find container \"5c21d72aa7677dca9c153a4247bb346e47852f07d3ab1f6f792fbd5678b96558\": container with ID starting with 5c21d72aa7677dca9c153a4247bb346e47852f07d3ab1f6f792fbd5678b96558 not found: ID does not exist"
Jul 06 14:53:56.231651 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:53:56.231616    2565 scope.go:117] "RemoveContainer" containerID="788f2cf5be3599472f624728dd9af182fdaad46f7e41e8fb07fe930977469c6f"
Jul 06 14:53:56.231878 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:53:56.231860    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"788f2cf5be3599472f624728dd9af182fdaad46f7e41e8fb07fe930977469c6f\": container with ID starting with 788f2cf5be3599472f624728dd9af182fdaad46f7e41e8fb07fe930977469c6f not found: ID does not exist" containerID="788f2cf5be3599472f624728dd9af182fdaad46f7e41e8fb07fe930977469c6f"
Jul 06 14:53:56.231915 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:53:56.231888    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"788f2cf5be3599472f624728dd9af182fdaad46f7e41e8fb07fe930977469c6f"} err="failed to get container status \"788f2cf5be3599472f624728dd9af182fdaad46f7e41e8fb07fe930977469c6f\": rpc error: code = NotFound desc = could not find container \"788f2cf5be3599472f624728dd9af182fdaad46f7e41e8fb07fe930977469c6f\": container with ID starting with 788f2cf5be3599472f624728dd9af182fdaad46f7e41e8fb07fe930977469c6f not found: ID does not exist"
Jul 06 14:53:56.236914 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:53:56.236893    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4"]
Jul 06 14:53:56.243780 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:53:56.243761    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-4937319b-openshift-default-85bccc8b47-pxsn4"]
Jul 06 14:53:57.954391 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:53:57.954357    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af1c2bf7-1ada-4489-8084-d8a5fcf66492" path="/var/lib/kubelet/pods/af1c2bf7-1ada-4489-8084-d8a5fcf66492/volumes"
Jul 06 14:54:47.246620 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:54:47.246514    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv"]
Jul 06 14:54:47.247059 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:54:47.247010    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af1c2bf7-1ada-4489-8084-d8a5fcf66492" containerName="istio-proxy"
Jul 06 14:54:47.247059 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:54:47.247025    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="af1c2bf7-1ada-4489-8084-d8a5fcf66492" containerName="istio-proxy"
Jul 06 14:54:47.247059 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:54:47.247038    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af1c2bf7-1ada-4489-8084-d8a5fcf66492" containerName="istio-proxy"
Jul 06 14:54:47.247059 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:54:47.247043    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="af1c2bf7-1ada-4489-8084-d8a5fcf66492" containerName="istio-proxy"
Jul 06 14:54:47.247210 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:54:47.247111    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="af1c2bf7-1ada-4489-8084-d8a5fcf66492" containerName="istio-proxy"
Jul 06 14:54:47.247210 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:54:47.247118    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="af1c2bf7-1ada-4489-8084-d8a5fcf66492" containerName="istio-proxy"
Jul 06 14:54:47.249318 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:54:47.249301    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv"
Jul 06 14:54:47.252116 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:54:47.252097    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-ebef4e-openshift-default-dockercfg-w64qc\""
Jul 06 14:54:47.276255 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:54:47.276225    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv"]
Jul 06 14:54:47.428484 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:54:47.428446    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccf527ed-f614-48da-bb03-a75ffe955454-workload-socket\") pod \"e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv\" (UID: \"ccf527ed-f614-48da-bb03-a75ffe955454\") " pod="openshift-ingress/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv"
Jul 06 14:54:47.428685 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:54:47.428506    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ccf527ed-f614-48da-bb03-a75ffe955454-istio-token\") pod \"e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv\" (UID: \"ccf527ed-f614-48da-bb03-a75ffe955454\") " pod="openshift-ingress/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv"
Jul 06 14:54:47.428685 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:54:47.428577    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ccf527ed-f614-48da-bb03-a75ffe955454-istio-podinfo\") pod \"e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv\" (UID: \"ccf527ed-f614-48da-bb03-a75ffe955454\") " pod="openshift-ingress/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv"
Jul 06 14:54:47.428685 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:54:47.428624    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ccf527ed-f614-48da-bb03-a75ffe955454-workload-certs\") pod \"e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv\" (UID: \"ccf527ed-f614-48da-bb03-a75ffe955454\") " pod="openshift-ingress/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv"
Jul 06 14:54:47.428685 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:54:47.428663    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccf527ed-f614-48da-bb03-a75ffe955454-credential-socket\") pod \"e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv\" (UID: \"ccf527ed-f614-48da-bb03-a75ffe955454\") " pod="openshift-ingress/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv"
Jul 06 14:54:47.428685 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:54:47.428686    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ccf527ed-f614-48da-bb03-a75ffe955454-istiod-ca-cert\") pod \"e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv\" (UID: \"ccf527ed-f614-48da-bb03-a75ffe955454\") " pod="openshift-ingress/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv"
Jul 06 14:54:47.428911 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:54:47.428707    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nt95v\" (UniqueName: \"kubernetes.io/projected/ccf527ed-f614-48da-bb03-a75ffe955454-kube-api-access-nt95v\") pod \"e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv\" (UID: \"ccf527ed-f614-48da-bb03-a75ffe955454\") " pod="openshift-ingress/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv"
Jul 06 14:54:47.428911 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:54:47.428779    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ccf527ed-f614-48da-bb03-a75ffe955454-istio-data\") pod \"e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv\" (UID: \"ccf527ed-f614-48da-bb03-a75ffe955454\") " pod="openshift-ingress/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv"
Jul 06 14:54:47.428911 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:54:47.428823    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ccf527ed-f614-48da-bb03-a75ffe955454-istio-envoy\") pod \"e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv\" (UID: \"ccf527ed-f614-48da-bb03-a75ffe955454\") " pod="openshift-ingress/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv"
Jul 06 14:54:47.529520 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:54:47.529425    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nt95v\" (UniqueName: \"kubernetes.io/projected/ccf527ed-f614-48da-bb03-a75ffe955454-kube-api-access-nt95v\") pod \"e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv\" (UID: \"ccf527ed-f614-48da-bb03-a75ffe955454\") " pod="openshift-ingress/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv"
Jul 06 14:54:47.529520 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:54:47.529499    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ccf527ed-f614-48da-bb03-a75ffe955454-istio-data\") pod \"e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv\" (UID: \"ccf527ed-f614-48da-bb03-a75ffe955454\") " pod="openshift-ingress/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv"
Jul 06 14:54:47.529743 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:54:47.529543    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ccf527ed-f614-48da-bb03-a75ffe955454-istio-envoy\") pod \"e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv\" (UID: \"ccf527ed-f614-48da-bb03-a75ffe955454\") " pod="openshift-ingress/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv"
Jul 06 14:54:47.529743 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:54:47.529582    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccf527ed-f614-48da-bb03-a75ffe955454-workload-socket\") pod \"e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv\" (UID: \"ccf527ed-f614-48da-bb03-a75ffe955454\") " pod="openshift-ingress/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv"
Jul 06 14:54:47.529743 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:54:47.529634    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ccf527ed-f614-48da-bb03-a75ffe955454-istio-token\") pod \"e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv\" (UID: \"ccf527ed-f614-48da-bb03-a75ffe955454\") " pod="openshift-ingress/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv"
Jul 06 14:54:47.529743 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:54:47.529696    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ccf527ed-f614-48da-bb03-a75ffe955454-istio-podinfo\") pod \"e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv\" (UID: \"ccf527ed-f614-48da-bb03-a75ffe955454\") " pod="openshift-ingress/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv"
Jul 06 14:54:47.529743 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:54:47.529724    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ccf527ed-f614-48da-bb03-a75ffe955454-workload-certs\") pod \"e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv\" (UID: \"ccf527ed-f614-48da-bb03-a75ffe955454\") " pod="openshift-ingress/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv"
Jul 06 14:54:47.530007 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:54:47.529776    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccf527ed-f614-48da-bb03-a75ffe955454-credential-socket\") pod \"e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv\" (UID: \"ccf527ed-f614-48da-bb03-a75ffe955454\") " pod="openshift-ingress/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv"
Jul 06 14:54:47.530007 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:54:47.529838    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ccf527ed-f614-48da-bb03-a75ffe955454-istiod-ca-cert\") pod \"e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv\" (UID: \"ccf527ed-f614-48da-bb03-a75ffe955454\") " pod="openshift-ingress/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv"
Jul 06 14:54:47.530007 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:54:47.529963    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ccf527ed-f614-48da-bb03-a75ffe955454-istio-data\") pod \"e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv\" (UID: \"ccf527ed-f614-48da-bb03-a75ffe955454\") " pod="openshift-ingress/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv"
Jul 06 14:54:47.530168 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:54:47.530129    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ccf527ed-f614-48da-bb03-a75ffe955454-workload-certs\") pod \"e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv\" (UID: \"ccf527ed-f614-48da-bb03-a75ffe955454\") " pod="openshift-ingress/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv"
Jul 06 14:54:47.530168 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:54:47.530131    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccf527ed-f614-48da-bb03-a75ffe955454-workload-socket\") pod \"e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv\" (UID: \"ccf527ed-f614-48da-bb03-a75ffe955454\") " pod="openshift-ingress/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv"
Jul 06 14:54:47.530260 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:54:47.530164    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccf527ed-f614-48da-bb03-a75ffe955454-credential-socket\") pod \"e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv\" (UID: \"ccf527ed-f614-48da-bb03-a75ffe955454\") " pod="openshift-ingress/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv"
Jul 06 14:54:47.530546 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:54:47.530531    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ccf527ed-f614-48da-bb03-a75ffe955454-istiod-ca-cert\") pod \"e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv\" (UID: \"ccf527ed-f614-48da-bb03-a75ffe955454\") " pod="openshift-ingress/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv"
Jul 06 14:54:47.531811 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:54:47.531787    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ccf527ed-f614-48da-bb03-a75ffe955454-istio-envoy\") pod \"e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv\" (UID: \"ccf527ed-f614-48da-bb03-a75ffe955454\") " pod="openshift-ingress/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv"
Jul 06 14:54:47.532210 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:54:47.532188    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ccf527ed-f614-48da-bb03-a75ffe955454-istio-podinfo\") pod \"e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv\" (UID: \"ccf527ed-f614-48da-bb03-a75ffe955454\") " pod="openshift-ingress/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv"
Jul 06 14:54:47.538733 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:54:47.538712    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ccf527ed-f614-48da-bb03-a75ffe955454-istio-token\") pod \"e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv\" (UID: \"ccf527ed-f614-48da-bb03-a75ffe955454\") " pod="openshift-ingress/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv"
Jul 06 14:54:47.541499 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:54:47.541478    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nt95v\" (UniqueName: \"kubernetes.io/projected/ccf527ed-f614-48da-bb03-a75ffe955454-kube-api-access-nt95v\") pod \"e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv\" (UID: \"ccf527ed-f614-48da-bb03-a75ffe955454\") " pod="openshift-ingress/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv"
Jul 06 14:54:47.559422 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:54:47.559393    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv"
Jul 06 14:54:47.703303 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:54:47.703208    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv"]
Jul 06 14:54:47.705514 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:54:47.705474    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccf527ed_f614_48da_bb03_a75ffe955454.slice/crio-556fa717431fab56c41d2613f220ce9545a9a0998b7222bd167d81abe942009d WatchSource:0}: Error finding container 556fa717431fab56c41d2613f220ce9545a9a0998b7222bd167d81abe942009d: Status 404 returned error can't find the container with id 556fa717431fab56c41d2613f220ce9545a9a0998b7222bd167d81abe942009d
Jul 06 14:54:47.707893 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:54:47.707859    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:54:47.708000 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:54:47.707927    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:54:47.708000 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:54:47.707956    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:54:48.478503 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:54:48.478464    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv" event={"ID":"ccf527ed-f614-48da-bb03-a75ffe955454","Type":"ContainerStarted","Data":"45694cc6ac6dce53bd235f101b866cae38f2b376b8359d2a64fb692560b67754"}
Jul 06 14:54:48.478923 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:54:48.478528    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv" event={"ID":"ccf527ed-f614-48da-bb03-a75ffe955454","Type":"ContainerStarted","Data":"556fa717431fab56c41d2613f220ce9545a9a0998b7222bd167d81abe942009d"}
Jul 06 14:54:48.560411 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:54:48.560374    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv"
Jul 06 14:54:48.565241 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:54:48.565214    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv"
Jul 06 14:54:48.586758 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:54:48.586709    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv" podStartSLOduration=1.586691143 podStartE2EDuration="1.586691143s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:54:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:54:48.504152107 +0000 UTC m=+1891.682801154" watchObservedRunningTime="2026-07-06 14:54:48.586691143 +0000 UTC m=+1891.765340189"
Jul 06 14:54:49.485954 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:54:49.485924    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv"
Jul 06 14:54:49.486927 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:54:49.486903    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv"
Jul 06 14:55:05.528566 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:55:05.528512    2565 patch_prober.go:28] interesting pod/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 06 14:55:05.529005 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:55:05.528602    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv" podUID="ccf527ed-f614-48da-bb03-a75ffe955454" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 06 14:55:06.578826 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:55:06.578740    2565 generic.go:356] "Generic (PLEG): container finished" podID="ccf527ed-f614-48da-bb03-a75ffe955454" containerID="45694cc6ac6dce53bd235f101b866cae38f2b376b8359d2a64fb692560b67754" exitCode=0
Jul 06 14:55:06.578826 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:55:06.578791    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv" event={"ID":"ccf527ed-f614-48da-bb03-a75ffe955454","Type":"ContainerDied","Data":"45694cc6ac6dce53bd235f101b866cae38f2b376b8359d2a64fb692560b67754"}
Jul 06 14:55:06.579293 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:55:06.579209    2565 scope.go:117] "RemoveContainer" containerID="45694cc6ac6dce53bd235f101b866cae38f2b376b8359d2a64fb692560b67754"
Jul 06 14:55:06.580263 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:55:06.580231    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:55:06.580334 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:55:06.580303    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:55:06.580334 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:55:06.580333    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:55:07.589659 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:55:07.589616    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv" event={"ID":"ccf527ed-f614-48da-bb03-a75ffe955454","Type":"ContainerStarted","Data":"7eb0a5df402c641420f824eea8f4cd7f9e77838560562e100bafbe13d16ddbee"}
Jul 06 14:55:08.559711 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:55:08.559665    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv"
Jul 06 14:55:08.559964 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:55:08.559941    2565 patch_prober.go:28] interesting pod/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 06 14:55:08.560044 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:55:08.560025    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv" podUID="ccf527ed-f614-48da-bb03-a75ffe955454" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 06 14:55:09.560605 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:55:09.560558    2565 patch_prober.go:28] interesting pod/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 06 14:55:09.561097 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:55:09.560640    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv" podUID="ccf527ed-f614-48da-bb03-a75ffe955454" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 06 14:55:10.560515 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:55:10.560476    2565 patch_prober.go:28] interesting pod/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 06 14:55:10.560699 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:55:10.560547    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv" podUID="ccf527ed-f614-48da-bb03-a75ffe955454" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 06 14:55:11.563163 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:55:11.563130    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv"
Jul 06 14:55:11.563616 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:55:11.563372    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv"
Jul 06 14:55:11.563995 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:55:11.563977    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv"
Jul 06 14:55:57.069787 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:55:57.069635    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-139570/test-model-139570-kserve-679457c467-5hjrx"]
Jul 06 14:55:57.072923 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:55:57.072902    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-139570/test-model-139570-kserve-679457c467-5hjrx"
Jul 06 14:55:57.075537 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:55:57.075515    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-139570\"/\"kube-root-ca.crt\""
Jul 06 14:55:57.075663 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:55:57.075555    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-139570\"/\"default-dockercfg-8z977\""
Jul 06 14:55:57.075663 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:55:57.075558    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-139570\"/\"test-model-139570-kserve-self-signed-certs\""
Jul 06 14:55:57.075663 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:55:57.075563    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-139570\"/\"openshift-service-ca.crt\""
Jul 06 14:55:57.083332 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:55:57.083308    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-139570/test-model-139570-kserve-679457c467-5hjrx"]
Jul 06 14:55:57.155700 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:55:57.155664    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-949sn\" (UniqueName: \"kubernetes.io/projected/898e9d7c-1578-41ab-ab16-04aea5f45261-kube-api-access-949sn\") pod \"test-model-139570-kserve-679457c467-5hjrx\" (UID: \"898e9d7c-1578-41ab-ab16-04aea5f45261\") " pod="ai-tenant-e2e-inf-b-139570/test-model-139570-kserve-679457c467-5hjrx"
Jul 06 14:55:57.155700 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:55:57.155705    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/898e9d7c-1578-41ab-ab16-04aea5f45261-tls-certs\") pod \"test-model-139570-kserve-679457c467-5hjrx\" (UID: \"898e9d7c-1578-41ab-ab16-04aea5f45261\") " pod="ai-tenant-e2e-inf-b-139570/test-model-139570-kserve-679457c467-5hjrx"
Jul 06 14:55:57.155938 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:55:57.155788    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/898e9d7c-1578-41ab-ab16-04aea5f45261-model-cache\") pod \"test-model-139570-kserve-679457c467-5hjrx\" (UID: \"898e9d7c-1578-41ab-ab16-04aea5f45261\") " pod="ai-tenant-e2e-inf-b-139570/test-model-139570-kserve-679457c467-5hjrx"
Jul 06 14:55:57.155938 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:55:57.155805    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/898e9d7c-1578-41ab-ab16-04aea5f45261-home\") pod \"test-model-139570-kserve-679457c467-5hjrx\" (UID: \"898e9d7c-1578-41ab-ab16-04aea5f45261\") " pod="ai-tenant-e2e-inf-b-139570/test-model-139570-kserve-679457c467-5hjrx"
Jul 06 14:55:57.155938 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:55:57.155836    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/898e9d7c-1578-41ab-ab16-04aea5f45261-tmp-dir\") pod \"test-model-139570-kserve-679457c467-5hjrx\" (UID: \"898e9d7c-1578-41ab-ab16-04aea5f45261\") " pod="ai-tenant-e2e-inf-b-139570/test-model-139570-kserve-679457c467-5hjrx"
Jul 06 14:55:57.155938 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:55:57.155875    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/898e9d7c-1578-41ab-ab16-04aea5f45261-dshm\") pod \"test-model-139570-kserve-679457c467-5hjrx\" (UID: \"898e9d7c-1578-41ab-ab16-04aea5f45261\") " pod="ai-tenant-e2e-inf-b-139570/test-model-139570-kserve-679457c467-5hjrx"
Jul 06 14:55:57.256848 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:55:57.256806    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/898e9d7c-1578-41ab-ab16-04aea5f45261-model-cache\") pod \"test-model-139570-kserve-679457c467-5hjrx\" (UID: \"898e9d7c-1578-41ab-ab16-04aea5f45261\") " pod="ai-tenant-e2e-inf-b-139570/test-model-139570-kserve-679457c467-5hjrx"
Jul 06 14:55:57.256848 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:55:57.256848    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/898e9d7c-1578-41ab-ab16-04aea5f45261-home\") pod \"test-model-139570-kserve-679457c467-5hjrx\" (UID: \"898e9d7c-1578-41ab-ab16-04aea5f45261\") " pod="ai-tenant-e2e-inf-b-139570/test-model-139570-kserve-679457c467-5hjrx"
Jul 06 14:55:57.257112 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:55:57.256864    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/898e9d7c-1578-41ab-ab16-04aea5f45261-tmp-dir\") pod \"test-model-139570-kserve-679457c467-5hjrx\" (UID: \"898e9d7c-1578-41ab-ab16-04aea5f45261\") " pod="ai-tenant-e2e-inf-b-139570/test-model-139570-kserve-679457c467-5hjrx"
Jul 06 14:55:57.257112 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:55:57.256882    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/898e9d7c-1578-41ab-ab16-04aea5f45261-dshm\") pod \"test-model-139570-kserve-679457c467-5hjrx\" (UID: \"898e9d7c-1578-41ab-ab16-04aea5f45261\") " pod="ai-tenant-e2e-inf-b-139570/test-model-139570-kserve-679457c467-5hjrx"
Jul 06 14:55:57.257112 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:55:57.256971    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-949sn\" (UniqueName: \"kubernetes.io/projected/898e9d7c-1578-41ab-ab16-04aea5f45261-kube-api-access-949sn\") pod \"test-model-139570-kserve-679457c467-5hjrx\" (UID: \"898e9d7c-1578-41ab-ab16-04aea5f45261\") " pod="ai-tenant-e2e-inf-b-139570/test-model-139570-kserve-679457c467-5hjrx"
Jul 06 14:55:57.257112 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:55:57.256995    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/898e9d7c-1578-41ab-ab16-04aea5f45261-tls-certs\") pod \"test-model-139570-kserve-679457c467-5hjrx\" (UID: \"898e9d7c-1578-41ab-ab16-04aea5f45261\") " pod="ai-tenant-e2e-inf-b-139570/test-model-139570-kserve-679457c467-5hjrx"
Jul 06 14:55:57.257374 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:55:57.257247    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/898e9d7c-1578-41ab-ab16-04aea5f45261-tmp-dir\") pod \"test-model-139570-kserve-679457c467-5hjrx\" (UID: \"898e9d7c-1578-41ab-ab16-04aea5f45261\") " pod="ai-tenant-e2e-inf-b-139570/test-model-139570-kserve-679457c467-5hjrx"
Jul 06 14:55:57.257374 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:55:57.257304    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/898e9d7c-1578-41ab-ab16-04aea5f45261-home\") pod \"test-model-139570-kserve-679457c467-5hjrx\" (UID: \"898e9d7c-1578-41ab-ab16-04aea5f45261\") " pod="ai-tenant-e2e-inf-b-139570/test-model-139570-kserve-679457c467-5hjrx"
Jul 06 14:55:57.257482 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:55:57.257373    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/898e9d7c-1578-41ab-ab16-04aea5f45261-model-cache\") pod \"test-model-139570-kserve-679457c467-5hjrx\" (UID: \"898e9d7c-1578-41ab-ab16-04aea5f45261\") " pod="ai-tenant-e2e-inf-b-139570/test-model-139570-kserve-679457c467-5hjrx"
Jul 06 14:55:57.259332 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:55:57.259314    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/898e9d7c-1578-41ab-ab16-04aea5f45261-dshm\") pod \"test-model-139570-kserve-679457c467-5hjrx\" (UID: \"898e9d7c-1578-41ab-ab16-04aea5f45261\") " pod="ai-tenant-e2e-inf-b-139570/test-model-139570-kserve-679457c467-5hjrx"
Jul 06 14:55:57.259530 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:55:57.259515    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/898e9d7c-1578-41ab-ab16-04aea5f45261-tls-certs\") pod \"test-model-139570-kserve-679457c467-5hjrx\" (UID: \"898e9d7c-1578-41ab-ab16-04aea5f45261\") " pod="ai-tenant-e2e-inf-b-139570/test-model-139570-kserve-679457c467-5hjrx"
Jul 06 14:55:57.265726 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:55:57.265704    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-949sn\" (UniqueName: \"kubernetes.io/projected/898e9d7c-1578-41ab-ab16-04aea5f45261-kube-api-access-949sn\") pod \"test-model-139570-kserve-679457c467-5hjrx\" (UID: \"898e9d7c-1578-41ab-ab16-04aea5f45261\") " pod="ai-tenant-e2e-inf-b-139570/test-model-139570-kserve-679457c467-5hjrx"
Jul 06 14:55:57.383081 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:55:57.382994    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-139570/test-model-139570-kserve-679457c467-5hjrx"
Jul 06 14:55:57.522168 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:55:57.522140    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-139570/test-model-139570-kserve-679457c467-5hjrx"]
Jul 06 14:55:57.524208 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:55:57.524173    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod898e9d7c_1578_41ab_ab16_04aea5f45261.slice/crio-9b4e3d5e5b0a9da26bd9790bdfd10d41080a1bac2da4ccedf75d0bc3b691a246 WatchSource:0}: Error finding container 9b4e3d5e5b0a9da26bd9790bdfd10d41080a1bac2da4ccedf75d0bc3b691a246: Status 404 returned error can't find the container with id 9b4e3d5e5b0a9da26bd9790bdfd10d41080a1bac2da4ccedf75d0bc3b691a246
Jul 06 14:55:57.864524 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:55:57.864487    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-139570/test-model-139570-kserve-679457c467-5hjrx" event={"ID":"898e9d7c-1578-41ab-ab16-04aea5f45261","Type":"ContainerStarted","Data":"5e48ca14c0566bc71d4d98ec6afb22e8732b9760781954390d983d7ce30e2902"}
Jul 06 14:55:57.864706 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:55:57.864531    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-139570/test-model-139570-kserve-679457c467-5hjrx" event={"ID":"898e9d7c-1578-41ab-ab16-04aea5f45261","Type":"ContainerStarted","Data":"9b4e3d5e5b0a9da26bd9790bdfd10d41080a1bac2da4ccedf75d0bc3b691a246"}
Jul 06 14:55:57.884258 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:55:57.884198    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-139570/test-model-139570-kserve-679457c467-5hjrx" podStartSLOduration=0.884178077 podStartE2EDuration="884.178077ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:55:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:55:57.883185754 +0000 UTC m=+1961.061834800" watchObservedRunningTime="2026-07-06 14:55:57.884178077 +0000 UTC m=+1961.062827123"
Jul 06 14:56:07.383517 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:56:07.383469    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-139570/test-model-139570-kserve-679457c467-5hjrx"
Jul 06 14:56:07.383517 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:56:07.383535    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-139570/test-model-139570-kserve-679457c467-5hjrx"
Jul 06 14:56:07.396109 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:56:07.396083    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-139570/test-model-139570-kserve-679457c467-5hjrx"
Jul 06 14:56:07.927151 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:56:07.927124    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-139570/test-model-139570-kserve-679457c467-5hjrx"
Jul 06 14:56:18.673482 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:56:18.673319    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-139570/test-model-139570-kserve-679457c467-5hjrx"]
Jul 06 14:56:33.702067 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:56:33.702004    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-139570/test-model-139570-kserve-679457c467-5hjrx" podUID="898e9d7c-1578-41ab-ab16-04aea5f45261" containerName="main" containerID="cri-o://5e48ca14c0566bc71d4d98ec6afb22e8732b9760781954390d983d7ce30e2902" gracePeriod=45
Jul 06 14:56:33.963631 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:56:33.963561    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-139570/test-model-139570-kserve-679457c467-5hjrx"
Jul 06 14:56:34.051963 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:56:34.051929    2565 generic.go:356] "Generic (PLEG): container finished" podID="898e9d7c-1578-41ab-ab16-04aea5f45261" containerID="5e48ca14c0566bc71d4d98ec6afb22e8732b9760781954390d983d7ce30e2902" exitCode=0
Jul 06 14:56:34.052129 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:56:34.051970    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-139570/test-model-139570-kserve-679457c467-5hjrx"
Jul 06 14:56:34.052129 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:56:34.051971    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-139570/test-model-139570-kserve-679457c467-5hjrx" event={"ID":"898e9d7c-1578-41ab-ab16-04aea5f45261","Type":"ContainerDied","Data":"5e48ca14c0566bc71d4d98ec6afb22e8732b9760781954390d983d7ce30e2902"}
Jul 06 14:56:34.052129 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:56:34.052083    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-139570/test-model-139570-kserve-679457c467-5hjrx" event={"ID":"898e9d7c-1578-41ab-ab16-04aea5f45261","Type":"ContainerDied","Data":"9b4e3d5e5b0a9da26bd9790bdfd10d41080a1bac2da4ccedf75d0bc3b691a246"}
Jul 06 14:56:34.052129 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:56:34.052106    2565 scope.go:117] "RemoveContainer" containerID="5e48ca14c0566bc71d4d98ec6afb22e8732b9760781954390d983d7ce30e2902"
Jul 06 14:56:34.060740 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:56:34.060718    2565 scope.go:117] "RemoveContainer" containerID="5e48ca14c0566bc71d4d98ec6afb22e8732b9760781954390d983d7ce30e2902"
Jul 06 14:56:34.061010 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:56:34.060989    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e48ca14c0566bc71d4d98ec6afb22e8732b9760781954390d983d7ce30e2902\": container with ID starting with 5e48ca14c0566bc71d4d98ec6afb22e8732b9760781954390d983d7ce30e2902 not found: ID does not exist" containerID="5e48ca14c0566bc71d4d98ec6afb22e8732b9760781954390d983d7ce30e2902"
Jul 06 14:56:34.061077 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:56:34.061020    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e48ca14c0566bc71d4d98ec6afb22e8732b9760781954390d983d7ce30e2902"} err="failed to get container status \"5e48ca14c0566bc71d4d98ec6afb22e8732b9760781954390d983d7ce30e2902\": rpc error: code = NotFound desc = could not find container \"5e48ca14c0566bc71d4d98ec6afb22e8732b9760781954390d983d7ce30e2902\": container with ID starting with 5e48ca14c0566bc71d4d98ec6afb22e8732b9760781954390d983d7ce30e2902 not found: ID does not exist"
Jul 06 14:56:34.120938 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:56:34.120904    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/898e9d7c-1578-41ab-ab16-04aea5f45261-home\") pod \"898e9d7c-1578-41ab-ab16-04aea5f45261\" (UID: \"898e9d7c-1578-41ab-ab16-04aea5f45261\") "
Jul 06 14:56:34.121138 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:56:34.120952    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/898e9d7c-1578-41ab-ab16-04aea5f45261-tls-certs\") pod \"898e9d7c-1578-41ab-ab16-04aea5f45261\" (UID: \"898e9d7c-1578-41ab-ab16-04aea5f45261\") "
Jul 06 14:56:34.121138 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:56:34.120992    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/898e9d7c-1578-41ab-ab16-04aea5f45261-model-cache\") pod \"898e9d7c-1578-41ab-ab16-04aea5f45261\" (UID: \"898e9d7c-1578-41ab-ab16-04aea5f45261\") "
Jul 06 14:56:34.121138 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:56:34.121016    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/898e9d7c-1578-41ab-ab16-04aea5f45261-tmp-dir\") pod \"898e9d7c-1578-41ab-ab16-04aea5f45261\" (UID: \"898e9d7c-1578-41ab-ab16-04aea5f45261\") "
Jul 06 14:56:34.121138 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:56:34.121033    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-949sn\" (UniqueName: \"kubernetes.io/projected/898e9d7c-1578-41ab-ab16-04aea5f45261-kube-api-access-949sn\") pod \"898e9d7c-1578-41ab-ab16-04aea5f45261\" (UID: \"898e9d7c-1578-41ab-ab16-04aea5f45261\") "
Jul 06 14:56:34.121138 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:56:34.121047    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/898e9d7c-1578-41ab-ab16-04aea5f45261-dshm\") pod \"898e9d7c-1578-41ab-ab16-04aea5f45261\" (UID: \"898e9d7c-1578-41ab-ab16-04aea5f45261\") "
Jul 06 14:56:34.121455 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:56:34.121267    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/898e9d7c-1578-41ab-ab16-04aea5f45261-home" (OuterVolumeSpecName: "home") pod "898e9d7c-1578-41ab-ab16-04aea5f45261" (UID: "898e9d7c-1578-41ab-ab16-04aea5f45261"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:56:34.121455 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:56:34.121276    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/898e9d7c-1578-41ab-ab16-04aea5f45261-model-cache" (OuterVolumeSpecName: "model-cache") pod "898e9d7c-1578-41ab-ab16-04aea5f45261" (UID: "898e9d7c-1578-41ab-ab16-04aea5f45261"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:56:34.121455 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:56:34.121355    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/898e9d7c-1578-41ab-ab16-04aea5f45261-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "898e9d7c-1578-41ab-ab16-04aea5f45261" (UID: "898e9d7c-1578-41ab-ab16-04aea5f45261"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:56:34.121925 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:56:34.121818    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/898e9d7c-1578-41ab-ab16-04aea5f45261-home\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:56:34.121925 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:56:34.121843    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/898e9d7c-1578-41ab-ab16-04aea5f45261-model-cache\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:56:34.121925 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:56:34.121859    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/898e9d7c-1578-41ab-ab16-04aea5f45261-tmp-dir\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:56:34.123559 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:56:34.123534    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/898e9d7c-1578-41ab-ab16-04aea5f45261-kube-api-access-949sn" (OuterVolumeSpecName: "kube-api-access-949sn") pod "898e9d7c-1578-41ab-ab16-04aea5f45261" (UID: "898e9d7c-1578-41ab-ab16-04aea5f45261"). InnerVolumeSpecName "kube-api-access-949sn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:56:34.123662 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:56:34.123645    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/898e9d7c-1578-41ab-ab16-04aea5f45261-dshm" (OuterVolumeSpecName: "dshm") pod "898e9d7c-1578-41ab-ab16-04aea5f45261" (UID: "898e9d7c-1578-41ab-ab16-04aea5f45261"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:56:34.123728 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:56:34.123702    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/898e9d7c-1578-41ab-ab16-04aea5f45261-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "898e9d7c-1578-41ab-ab16-04aea5f45261" (UID: "898e9d7c-1578-41ab-ab16-04aea5f45261"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:56:34.222807 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:56:34.222718    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/898e9d7c-1578-41ab-ab16-04aea5f45261-tls-certs\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:56:34.222807 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:56:34.222750    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-949sn\" (UniqueName: \"kubernetes.io/projected/898e9d7c-1578-41ab-ab16-04aea5f45261-kube-api-access-949sn\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:56:34.222807 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:56:34.222759    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/898e9d7c-1578-41ab-ab16-04aea5f45261-dshm\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:56:34.377594 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:56:34.377567    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-139570/test-model-139570-kserve-679457c467-5hjrx"]
Jul 06 14:56:34.380408 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:56:34.380381    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-139570/test-model-139570-kserve-679457c467-5hjrx"]
Jul 06 14:56:35.954063 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:56:35.954029    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="898e9d7c-1578-41ab-ab16-04aea5f45261" path="/var/lib/kubelet/pods/898e9d7c-1578-41ab-ab16-04aea5f45261/volumes"
Jul 06 14:57:03.050778 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:03.050741    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv"]
Jul 06 14:57:03.051284 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:03.050995    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv" podUID="ccf527ed-f614-48da-bb03-a75ffe955454" containerName="istio-proxy" containerID="cri-o://7eb0a5df402c641420f824eea8f4cd7f9e77838560562e100bafbe13d16ddbee" gracePeriod=30
Jul 06 14:57:08.234098 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:08.234059    2565 generic.go:356] "Generic (PLEG): container finished" podID="ccf527ed-f614-48da-bb03-a75ffe955454" containerID="7eb0a5df402c641420f824eea8f4cd7f9e77838560562e100bafbe13d16ddbee" exitCode=0
Jul 06 14:57:08.234480 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:08.234119    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv" event={"ID":"ccf527ed-f614-48da-bb03-a75ffe955454","Type":"ContainerDied","Data":"7eb0a5df402c641420f824eea8f4cd7f9e77838560562e100bafbe13d16ddbee"}
Jul 06 14:57:08.234480 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:08.234194    2565 scope.go:117] "RemoveContainer" containerID="45694cc6ac6dce53bd235f101b866cae38f2b376b8359d2a64fb692560b67754"
Jul 06 14:57:08.320466 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:08.320407    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv"
Jul 06 14:57:08.475300 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:08.475264    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ccf527ed-f614-48da-bb03-a75ffe955454-istio-data\") pod \"ccf527ed-f614-48da-bb03-a75ffe955454\" (UID: \"ccf527ed-f614-48da-bb03-a75ffe955454\") "
Jul 06 14:57:08.475300 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:08.475297    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccf527ed-f614-48da-bb03-a75ffe955454-workload-socket\") pod \"ccf527ed-f614-48da-bb03-a75ffe955454\" (UID: \"ccf527ed-f614-48da-bb03-a75ffe955454\") "
Jul 06 14:57:08.475574 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:08.475359    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ccf527ed-f614-48da-bb03-a75ffe955454-istio-podinfo\") pod \"ccf527ed-f614-48da-bb03-a75ffe955454\" (UID: \"ccf527ed-f614-48da-bb03-a75ffe955454\") "
Jul 06 14:57:08.475574 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:08.475402    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccf527ed-f614-48da-bb03-a75ffe955454-credential-socket\") pod \"ccf527ed-f614-48da-bb03-a75ffe955454\" (UID: \"ccf527ed-f614-48da-bb03-a75ffe955454\") "
Jul 06 14:57:08.475574 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:08.475450    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ccf527ed-f614-48da-bb03-a75ffe955454-istiod-ca-cert\") pod \"ccf527ed-f614-48da-bb03-a75ffe955454\" (UID: \"ccf527ed-f614-48da-bb03-a75ffe955454\") "
Jul 06 14:57:08.475574 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:08.475495    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ccf527ed-f614-48da-bb03-a75ffe955454-workload-certs\") pod \"ccf527ed-f614-48da-bb03-a75ffe955454\" (UID: \"ccf527ed-f614-48da-bb03-a75ffe955454\") "
Jul 06 14:57:08.475574 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:08.475518    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nt95v\" (UniqueName: \"kubernetes.io/projected/ccf527ed-f614-48da-bb03-a75ffe955454-kube-api-access-nt95v\") pod \"ccf527ed-f614-48da-bb03-a75ffe955454\" (UID: \"ccf527ed-f614-48da-bb03-a75ffe955454\") "
Jul 06 14:57:08.475574 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:08.475562    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ccf527ed-f614-48da-bb03-a75ffe955454-istio-envoy\") pod \"ccf527ed-f614-48da-bb03-a75ffe955454\" (UID: \"ccf527ed-f614-48da-bb03-a75ffe955454\") "
Jul 06 14:57:08.475898 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:08.475605    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ccf527ed-f614-48da-bb03-a75ffe955454-istio-token\") pod \"ccf527ed-f614-48da-bb03-a75ffe955454\" (UID: \"ccf527ed-f614-48da-bb03-a75ffe955454\") "
Jul 06 14:57:08.475898 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:08.475853    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ccf527ed-f614-48da-bb03-a75ffe955454-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ccf527ed-f614-48da-bb03-a75ffe955454" (UID: "ccf527ed-f614-48da-bb03-a75ffe955454"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:57:08.475898 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:08.475864    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ccf527ed-f614-48da-bb03-a75ffe955454-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ccf527ed-f614-48da-bb03-a75ffe955454" (UID: "ccf527ed-f614-48da-bb03-a75ffe955454"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:57:08.476068 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:08.476049    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ccf527ed-f614-48da-bb03-a75ffe955454-istiod-ca-cert\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:57:08.476132 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:08.476075    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ccf527ed-f614-48da-bb03-a75ffe955454-workload-certs\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:57:08.476433 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:08.476409    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ccf527ed-f614-48da-bb03-a75ffe955454-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ccf527ed-f614-48da-bb03-a75ffe955454" (UID: "ccf527ed-f614-48da-bb03-a75ffe955454"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:57:08.476614 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:08.476590    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ccf527ed-f614-48da-bb03-a75ffe955454-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ccf527ed-f614-48da-bb03-a75ffe955454" (UID: "ccf527ed-f614-48da-bb03-a75ffe955454"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:57:08.476728 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:08.476531    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ccf527ed-f614-48da-bb03-a75ffe955454-istio-data" (OuterVolumeSpecName: "istio-data") pod "ccf527ed-f614-48da-bb03-a75ffe955454" (UID: "ccf527ed-f614-48da-bb03-a75ffe955454"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:57:08.478417 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:08.478330    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ccf527ed-f614-48da-bb03-a75ffe955454-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ccf527ed-f614-48da-bb03-a75ffe955454" (UID: "ccf527ed-f614-48da-bb03-a75ffe955454"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:57:08.478417 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:08.478377    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ccf527ed-f614-48da-bb03-a75ffe955454-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ccf527ed-f614-48da-bb03-a75ffe955454" (UID: "ccf527ed-f614-48da-bb03-a75ffe955454"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 14:57:08.478417 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:08.478391    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccf527ed-f614-48da-bb03-a75ffe955454-kube-api-access-nt95v" (OuterVolumeSpecName: "kube-api-access-nt95v") pod "ccf527ed-f614-48da-bb03-a75ffe955454" (UID: "ccf527ed-f614-48da-bb03-a75ffe955454"). InnerVolumeSpecName "kube-api-access-nt95v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:57:08.478618 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:08.478435    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccf527ed-f614-48da-bb03-a75ffe955454-istio-token" (OuterVolumeSpecName: "istio-token") pod "ccf527ed-f614-48da-bb03-a75ffe955454" (UID: "ccf527ed-f614-48da-bb03-a75ffe955454"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:57:08.576869 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:08.576775    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ccf527ed-f614-48da-bb03-a75ffe955454-istio-data\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:57:08.576869 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:08.576810    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccf527ed-f614-48da-bb03-a75ffe955454-workload-socket\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:57:08.576869 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:08.576820    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ccf527ed-f614-48da-bb03-a75ffe955454-istio-podinfo\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:57:08.576869 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:08.576828    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccf527ed-f614-48da-bb03-a75ffe955454-credential-socket\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:57:08.576869 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:08.576837    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nt95v\" (UniqueName: \"kubernetes.io/projected/ccf527ed-f614-48da-bb03-a75ffe955454-kube-api-access-nt95v\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:57:08.576869 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:08.576846    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ccf527ed-f614-48da-bb03-a75ffe955454-istio-envoy\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:57:08.576869 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:08.576854    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ccf527ed-f614-48da-bb03-a75ffe955454-istio-token\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:57:09.239959 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:09.239928    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv"
Jul 06 14:57:09.240489 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:09.239957    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv" event={"ID":"ccf527ed-f614-48da-bb03-a75ffe955454","Type":"ContainerDied","Data":"556fa717431fab56c41d2613f220ce9545a9a0998b7222bd167d81abe942009d"}
Jul 06 14:57:09.240489 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:09.240044    2565 scope.go:117] "RemoveContainer" containerID="7eb0a5df402c641420f824eea8f4cd7f9e77838560562e100bafbe13d16ddbee"
Jul 06 14:57:09.262555 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:09.262519    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv"]
Jul 06 14:57:09.267923 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:09.267897    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-ebef4e-openshift-default-6dc6b78499-8b5tv"]
Jul 06 14:57:09.954572 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:09.954540    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ccf527ed-f614-48da-bb03-a75ffe955454" path="/var/lib/kubelet/pods/ccf527ed-f614-48da-bb03-a75ffe955454/volumes"
Jul 06 14:57:11.954321 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:11.954292    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x"]
Jul 06 14:57:11.954759 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:11.954702    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccf527ed-f614-48da-bb03-a75ffe955454" containerName="istio-proxy"
Jul 06 14:57:11.954759 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:11.954714    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccf527ed-f614-48da-bb03-a75ffe955454" containerName="istio-proxy"
Jul 06 14:57:11.954759 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:11.954728    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="898e9d7c-1578-41ab-ab16-04aea5f45261" containerName="main"
Jul 06 14:57:11.954759 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:11.954733    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="898e9d7c-1578-41ab-ab16-04aea5f45261" containerName="main"
Jul 06 14:57:11.954759 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:11.954751    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccf527ed-f614-48da-bb03-a75ffe955454" containerName="istio-proxy"
Jul 06 14:57:11.954759 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:11.954756    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccf527ed-f614-48da-bb03-a75ffe955454" containerName="istio-proxy"
Jul 06 14:57:11.954964 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:11.954811    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ccf527ed-f614-48da-bb03-a75ffe955454" containerName="istio-proxy"
Jul 06 14:57:11.954964 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:11.954820    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="898e9d7c-1578-41ab-ab16-04aea5f45261" containerName="main"
Jul 06 14:57:11.958699 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:11.958683    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x"
Jul 06 14:57:11.962008 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:11.961994    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-7ed418-openshift-default-dockercfg-f8j2p\""
Jul 06 14:57:11.995909 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:11.995874    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x"]
Jul 06 14:57:12.113278 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:12.113243    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/038b65e5-79d9-4404-abf4-33fe594ac87b-istiod-ca-cert\") pod \"e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x\" (UID: \"038b65e5-79d9-4404-abf4-33fe594ac87b\") " pod="openshift-ingress/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x"
Jul 06 14:57:12.113278 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:12.113288    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/038b65e5-79d9-4404-abf4-33fe594ac87b-istio-envoy\") pod \"e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x\" (UID: \"038b65e5-79d9-4404-abf4-33fe594ac87b\") " pod="openshift-ingress/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x"
Jul 06 14:57:12.113540 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:12.113309    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/038b65e5-79d9-4404-abf4-33fe594ac87b-workload-socket\") pod \"e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x\" (UID: \"038b65e5-79d9-4404-abf4-33fe594ac87b\") " pod="openshift-ingress/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x"
Jul 06 14:57:12.113540 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:12.113387    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/038b65e5-79d9-4404-abf4-33fe594ac87b-istio-podinfo\") pod \"e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x\" (UID: \"038b65e5-79d9-4404-abf4-33fe594ac87b\") " pod="openshift-ingress/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x"
Jul 06 14:57:12.113540 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:12.113426    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/038b65e5-79d9-4404-abf4-33fe594ac87b-istio-token\") pod \"e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x\" (UID: \"038b65e5-79d9-4404-abf4-33fe594ac87b\") " pod="openshift-ingress/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x"
Jul 06 14:57:12.113540 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:12.113499    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/038b65e5-79d9-4404-abf4-33fe594ac87b-istio-data\") pod \"e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x\" (UID: \"038b65e5-79d9-4404-abf4-33fe594ac87b\") " pod="openshift-ingress/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x"
Jul 06 14:57:12.113540 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:12.113528    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/038b65e5-79d9-4404-abf4-33fe594ac87b-credential-socket\") pod \"e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x\" (UID: \"038b65e5-79d9-4404-abf4-33fe594ac87b\") " pod="openshift-ingress/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x"
Jul 06 14:57:12.113718 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:12.113558    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqzhm\" (UniqueName: \"kubernetes.io/projected/038b65e5-79d9-4404-abf4-33fe594ac87b-kube-api-access-bqzhm\") pod \"e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x\" (UID: \"038b65e5-79d9-4404-abf4-33fe594ac87b\") " pod="openshift-ingress/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x"
Jul 06 14:57:12.113718 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:12.113627    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/038b65e5-79d9-4404-abf4-33fe594ac87b-workload-certs\") pod \"e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x\" (UID: \"038b65e5-79d9-4404-abf4-33fe594ac87b\") " pod="openshift-ingress/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x"
Jul 06 14:57:12.214810 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:12.214716    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/038b65e5-79d9-4404-abf4-33fe594ac87b-istio-data\") pod \"e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x\" (UID: \"038b65e5-79d9-4404-abf4-33fe594ac87b\") " pod="openshift-ingress/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x"
Jul 06 14:57:12.214810 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:12.214764    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/038b65e5-79d9-4404-abf4-33fe594ac87b-credential-socket\") pod \"e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x\" (UID: \"038b65e5-79d9-4404-abf4-33fe594ac87b\") " pod="openshift-ingress/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x"
Jul 06 14:57:12.214810 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:12.214791    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqzhm\" (UniqueName: \"kubernetes.io/projected/038b65e5-79d9-4404-abf4-33fe594ac87b-kube-api-access-bqzhm\") pod \"e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x\" (UID: \"038b65e5-79d9-4404-abf4-33fe594ac87b\") " pod="openshift-ingress/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x"
Jul 06 14:57:12.215103 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:12.214825    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/038b65e5-79d9-4404-abf4-33fe594ac87b-workload-certs\") pod \"e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x\" (UID: \"038b65e5-79d9-4404-abf4-33fe594ac87b\") " pod="openshift-ingress/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x"
Jul 06 14:57:12.215103 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:12.214852    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/038b65e5-79d9-4404-abf4-33fe594ac87b-istiod-ca-cert\") pod \"e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x\" (UID: \"038b65e5-79d9-4404-abf4-33fe594ac87b\") " pod="openshift-ingress/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x"
Jul 06 14:57:12.215103 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:12.214875    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/038b65e5-79d9-4404-abf4-33fe594ac87b-istio-envoy\") pod \"e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x\" (UID: \"038b65e5-79d9-4404-abf4-33fe594ac87b\") " pod="openshift-ingress/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x"
Jul 06 14:57:12.215103 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:12.214894    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/038b65e5-79d9-4404-abf4-33fe594ac87b-workload-socket\") pod \"e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x\" (UID: \"038b65e5-79d9-4404-abf4-33fe594ac87b\") " pod="openshift-ingress/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x"
Jul 06 14:57:12.215103 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:12.214917    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/038b65e5-79d9-4404-abf4-33fe594ac87b-istio-podinfo\") pod \"e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x\" (UID: \"038b65e5-79d9-4404-abf4-33fe594ac87b\") " pod="openshift-ingress/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x"
Jul 06 14:57:12.215103 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:12.214940    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/038b65e5-79d9-4404-abf4-33fe594ac87b-istio-token\") pod \"e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x\" (UID: \"038b65e5-79d9-4404-abf4-33fe594ac87b\") " pod="openshift-ingress/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x"
Jul 06 14:57:12.215330 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:12.215173    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/038b65e5-79d9-4404-abf4-33fe594ac87b-istio-data\") pod \"e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x\" (UID: \"038b65e5-79d9-4404-abf4-33fe594ac87b\") " pod="openshift-ingress/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x"
Jul 06 14:57:12.215398 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:12.215324    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/038b65e5-79d9-4404-abf4-33fe594ac87b-workload-certs\") pod \"e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x\" (UID: \"038b65e5-79d9-4404-abf4-33fe594ac87b\") " pod="openshift-ingress/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x"
Jul 06 14:57:12.215398 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:12.215375    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/038b65e5-79d9-4404-abf4-33fe594ac87b-credential-socket\") pod \"e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x\" (UID: \"038b65e5-79d9-4404-abf4-33fe594ac87b\") " pod="openshift-ingress/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x"
Jul 06 14:57:12.215569 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:12.215543    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/038b65e5-79d9-4404-abf4-33fe594ac87b-workload-socket\") pod \"e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x\" (UID: \"038b65e5-79d9-4404-abf4-33fe594ac87b\") " pod="openshift-ingress/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x"
Jul 06 14:57:12.215808 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:12.215789    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/038b65e5-79d9-4404-abf4-33fe594ac87b-istiod-ca-cert\") pod \"e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x\" (UID: \"038b65e5-79d9-4404-abf4-33fe594ac87b\") " pod="openshift-ingress/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x"
Jul 06 14:57:12.217183 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:12.217148    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/038b65e5-79d9-4404-abf4-33fe594ac87b-istio-envoy\") pod \"e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x\" (UID: \"038b65e5-79d9-4404-abf4-33fe594ac87b\") " pod="openshift-ingress/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x"
Jul 06 14:57:12.217462 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:12.217444    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/038b65e5-79d9-4404-abf4-33fe594ac87b-istio-podinfo\") pod \"e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x\" (UID: \"038b65e5-79d9-4404-abf4-33fe594ac87b\") " pod="openshift-ingress/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x"
Jul 06 14:57:12.222672 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:12.222645    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/038b65e5-79d9-4404-abf4-33fe594ac87b-istio-token\") pod \"e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x\" (UID: \"038b65e5-79d9-4404-abf4-33fe594ac87b\") " pod="openshift-ingress/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x"
Jul 06 14:57:12.222772 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:12.222763    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqzhm\" (UniqueName: \"kubernetes.io/projected/038b65e5-79d9-4404-abf4-33fe594ac87b-kube-api-access-bqzhm\") pod \"e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x\" (UID: \"038b65e5-79d9-4404-abf4-33fe594ac87b\") " pod="openshift-ingress/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x"
Jul 06 14:57:12.268844 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:12.268810    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x"
Jul 06 14:57:12.412801 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:12.412770    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x"]
Jul 06 14:57:12.415528 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:57:12.415498    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod038b65e5_79d9_4404_abf4_33fe594ac87b.slice/crio-29983ecbbae9712310cbdad695c1617827b28cdb6ee5a2cdcbd315612a208d97 WatchSource:0}: Error finding container 29983ecbbae9712310cbdad695c1617827b28cdb6ee5a2cdcbd315612a208d97: Status 404 returned error can't find the container with id 29983ecbbae9712310cbdad695c1617827b28cdb6ee5a2cdcbd315612a208d97
Jul 06 14:57:12.417746 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:12.417706    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:57:12.417817 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:12.417801    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:57:12.417859 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:12.417848    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:57:13.265182 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:13.265149    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x" event={"ID":"038b65e5-79d9-4404-abf4-33fe594ac87b","Type":"ContainerStarted","Data":"1b7c517efe9d9f8491b510ac7f331bc53859834fbf151a1482a76fc06bd204f7"}
Jul 06 14:57:13.265628 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:13.265210    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x" event={"ID":"038b65e5-79d9-4404-abf4-33fe594ac87b","Type":"ContainerStarted","Data":"29983ecbbae9712310cbdad695c1617827b28cdb6ee5a2cdcbd315612a208d97"}
Jul 06 14:57:13.269412 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:13.269390    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x"
Jul 06 14:57:13.274263 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:13.274239    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x"
Jul 06 14:57:13.292167 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:13.292106    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x" podStartSLOduration=2.292083622 podStartE2EDuration="2.292083622s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:57:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:57:13.285108228 +0000 UTC m=+2036.463757277" watchObservedRunningTime="2026-07-06 14:57:13.292083622 +0000 UTC m=+2036.470732668"
Jul 06 14:57:14.270474 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:14.270440    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x"
Jul 06 14:57:14.271425 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:14.271407    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x"
Jul 06 14:57:29.271266 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:29.271232    2565 patch_prober.go:28] interesting pod/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 06 14:57:29.271707 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:29.271297    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x" podUID="038b65e5-79d9-4404-abf4-33fe594ac87b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 06 14:57:29.355418 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:29.355382    2565 generic.go:356] "Generic (PLEG): container finished" podID="038b65e5-79d9-4404-abf4-33fe594ac87b" containerID="1b7c517efe9d9f8491b510ac7f331bc53859834fbf151a1482a76fc06bd204f7" exitCode=0
Jul 06 14:57:29.355589 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:29.355461    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x" event={"ID":"038b65e5-79d9-4404-abf4-33fe594ac87b","Type":"ContainerDied","Data":"1b7c517efe9d9f8491b510ac7f331bc53859834fbf151a1482a76fc06bd204f7"}
Jul 06 14:57:29.355903 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:29.355889    2565 scope.go:117] "RemoveContainer" containerID="1b7c517efe9d9f8491b510ac7f331bc53859834fbf151a1482a76fc06bd204f7"
Jul 06 14:57:29.357047 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:29.357018    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:57:29.357108 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:29.357091    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:57:29.357192 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:29.357128    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:57:30.363313 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:30.363276    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x" event={"ID":"038b65e5-79d9-4404-abf4-33fe594ac87b","Type":"ContainerStarted","Data":"d609a03edf65ec144d1e70eab76ee4f2f6b7a1d6c6f6abf1f81a4185425ebd2e"}
Jul 06 14:57:31.269426 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:31.269380    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x"
Jul 06 14:57:31.269659 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:31.269631    2565 patch_prober.go:28] interesting pod/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 06 14:57:31.269746 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:31.269693    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x" podUID="038b65e5-79d9-4404-abf4-33fe594ac87b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 06 14:57:32.269479 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:32.269437    2565 patch_prober.go:28] interesting pod/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 06 14:57:32.269964 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:32.269504    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x" podUID="038b65e5-79d9-4404-abf4-33fe594ac87b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 06 14:57:33.269514 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:33.269473    2565 patch_prober.go:28] interesting pod/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 06 14:57:33.269991 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:33.269549    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x" podUID="038b65e5-79d9-4404-abf4-33fe594ac87b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 06 14:57:34.291571 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:34.291543    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x"
Jul 06 14:57:34.292014 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:34.291826    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x"
Jul 06 14:57:34.292635 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:34.292618    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x"
Jul 06 14:57:43.532200 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:43.532121    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x"]
Jul 06 14:57:43.532714 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:43.532373    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x" podUID="038b65e5-79d9-4404-abf4-33fe594ac87b" containerName="istio-proxy" containerID="cri-o://d609a03edf65ec144d1e70eab76ee4f2f6b7a1d6c6f6abf1f81a4185425ebd2e" gracePeriod=30
Jul 06 14:57:48.790059 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:48.789999    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x"
Jul 06 14:57:48.888644 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:48.888600    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bqzhm\" (UniqueName: \"kubernetes.io/projected/038b65e5-79d9-4404-abf4-33fe594ac87b-kube-api-access-bqzhm\") pod \"038b65e5-79d9-4404-abf4-33fe594ac87b\" (UID: \"038b65e5-79d9-4404-abf4-33fe594ac87b\") "
Jul 06 14:57:48.888644 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:48.888657    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/038b65e5-79d9-4404-abf4-33fe594ac87b-istio-envoy\") pod \"038b65e5-79d9-4404-abf4-33fe594ac87b\" (UID: \"038b65e5-79d9-4404-abf4-33fe594ac87b\") "
Jul 06 14:57:48.888901 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:48.888688    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/038b65e5-79d9-4404-abf4-33fe594ac87b-credential-socket\") pod \"038b65e5-79d9-4404-abf4-33fe594ac87b\" (UID: \"038b65e5-79d9-4404-abf4-33fe594ac87b\") "
Jul 06 14:57:48.888901 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:48.888722    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/038b65e5-79d9-4404-abf4-33fe594ac87b-istio-data\") pod \"038b65e5-79d9-4404-abf4-33fe594ac87b\" (UID: \"038b65e5-79d9-4404-abf4-33fe594ac87b\") "
Jul 06 14:57:48.888901 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:48.888771    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/038b65e5-79d9-4404-abf4-33fe594ac87b-istio-podinfo\") pod \"038b65e5-79d9-4404-abf4-33fe594ac87b\" (UID: \"038b65e5-79d9-4404-abf4-33fe594ac87b\") "
Jul 06 14:57:48.888901 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:48.888803    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/038b65e5-79d9-4404-abf4-33fe594ac87b-workload-certs\") pod \"038b65e5-79d9-4404-abf4-33fe594ac87b\" (UID: \"038b65e5-79d9-4404-abf4-33fe594ac87b\") "
Jul 06 14:57:48.888901 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:48.888844    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/038b65e5-79d9-4404-abf4-33fe594ac87b-istiod-ca-cert\") pod \"038b65e5-79d9-4404-abf4-33fe594ac87b\" (UID: \"038b65e5-79d9-4404-abf4-33fe594ac87b\") "
Jul 06 14:57:48.888901 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:48.888883    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/038b65e5-79d9-4404-abf4-33fe594ac87b-workload-socket\") pod \"038b65e5-79d9-4404-abf4-33fe594ac87b\" (UID: \"038b65e5-79d9-4404-abf4-33fe594ac87b\") "
Jul 06 14:57:48.889204 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:48.888916    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/038b65e5-79d9-4404-abf4-33fe594ac87b-istio-token\") pod \"038b65e5-79d9-4404-abf4-33fe594ac87b\" (UID: \"038b65e5-79d9-4404-abf4-33fe594ac87b\") "
Jul 06 14:57:48.889204 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:48.889050    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/038b65e5-79d9-4404-abf4-33fe594ac87b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "038b65e5-79d9-4404-abf4-33fe594ac87b" (UID: "038b65e5-79d9-4404-abf4-33fe594ac87b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:57:48.889306 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:48.889265    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/038b65e5-79d9-4404-abf4-33fe594ac87b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "038b65e5-79d9-4404-abf4-33fe594ac87b" (UID: "038b65e5-79d9-4404-abf4-33fe594ac87b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:57:48.889306 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:48.889286    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/038b65e5-79d9-4404-abf4-33fe594ac87b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "038b65e5-79d9-4404-abf4-33fe594ac87b" (UID: "038b65e5-79d9-4404-abf4-33fe594ac87b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:57:48.889498 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:48.889334    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/038b65e5-79d9-4404-abf4-33fe594ac87b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "038b65e5-79d9-4404-abf4-33fe594ac87b" (UID: "038b65e5-79d9-4404-abf4-33fe594ac87b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:57:48.889498 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:48.889437    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/038b65e5-79d9-4404-abf4-33fe594ac87b-credential-socket\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:57:48.889692 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:48.889504    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/038b65e5-79d9-4404-abf4-33fe594ac87b-workload-certs\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:57:48.889909 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:48.889878    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/038b65e5-79d9-4404-abf4-33fe594ac87b-istio-data" (OuterVolumeSpecName: "istio-data") pod "038b65e5-79d9-4404-abf4-33fe594ac87b" (UID: "038b65e5-79d9-4404-abf4-33fe594ac87b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:57:48.891016 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:48.890994    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/038b65e5-79d9-4404-abf4-33fe594ac87b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "038b65e5-79d9-4404-abf4-33fe594ac87b" (UID: "038b65e5-79d9-4404-abf4-33fe594ac87b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:57:48.891242 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:48.891227    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/038b65e5-79d9-4404-abf4-33fe594ac87b-istio-token" (OuterVolumeSpecName: "istio-token") pod "038b65e5-79d9-4404-abf4-33fe594ac87b" (UID: "038b65e5-79d9-4404-abf4-33fe594ac87b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:57:48.891326 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:48.891312    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/038b65e5-79d9-4404-abf4-33fe594ac87b-kube-api-access-bqzhm" (OuterVolumeSpecName: "kube-api-access-bqzhm") pod "038b65e5-79d9-4404-abf4-33fe594ac87b" (UID: "038b65e5-79d9-4404-abf4-33fe594ac87b"). InnerVolumeSpecName "kube-api-access-bqzhm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:57:48.891567 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:48.891543    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/038b65e5-79d9-4404-abf4-33fe594ac87b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "038b65e5-79d9-4404-abf4-33fe594ac87b" (UID: "038b65e5-79d9-4404-abf4-33fe594ac87b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 14:57:48.990736 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:48.990700    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/038b65e5-79d9-4404-abf4-33fe594ac87b-workload-socket\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:57:48.990736 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:48.990729    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/038b65e5-79d9-4404-abf4-33fe594ac87b-istio-token\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:57:48.990736 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:48.990739    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqzhm\" (UniqueName: \"kubernetes.io/projected/038b65e5-79d9-4404-abf4-33fe594ac87b-kube-api-access-bqzhm\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:57:48.990974 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:48.990749    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/038b65e5-79d9-4404-abf4-33fe594ac87b-istio-envoy\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:57:48.990974 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:48.990757    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/038b65e5-79d9-4404-abf4-33fe594ac87b-istio-data\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:57:48.990974 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:48.990764    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/038b65e5-79d9-4404-abf4-33fe594ac87b-istio-podinfo\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:57:48.990974 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:48.990771    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/038b65e5-79d9-4404-abf4-33fe594ac87b-istiod-ca-cert\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 14:57:49.473319 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:49.473284    2565 generic.go:356] "Generic (PLEG): container finished" podID="038b65e5-79d9-4404-abf4-33fe594ac87b" containerID="d609a03edf65ec144d1e70eab76ee4f2f6b7a1d6c6f6abf1f81a4185425ebd2e" exitCode=0
Jul 06 14:57:49.473515 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:49.473365    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x" event={"ID":"038b65e5-79d9-4404-abf4-33fe594ac87b","Type":"ContainerDied","Data":"d609a03edf65ec144d1e70eab76ee4f2f6b7a1d6c6f6abf1f81a4185425ebd2e"}
Jul 06 14:57:49.473515 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:49.473372    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x"
Jul 06 14:57:49.473515 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:49.473432    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x" event={"ID":"038b65e5-79d9-4404-abf4-33fe594ac87b","Type":"ContainerDied","Data":"29983ecbbae9712310cbdad695c1617827b28cdb6ee5a2cdcbd315612a208d97"}
Jul 06 14:57:49.473515 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:49.473454    2565 scope.go:117] "RemoveContainer" containerID="d609a03edf65ec144d1e70eab76ee4f2f6b7a1d6c6f6abf1f81a4185425ebd2e"
Jul 06 14:57:49.483274 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:49.483252    2565 scope.go:117] "RemoveContainer" containerID="1b7c517efe9d9f8491b510ac7f331bc53859834fbf151a1482a76fc06bd204f7"
Jul 06 14:57:49.492558 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:49.492540    2565 scope.go:117] "RemoveContainer" containerID="d609a03edf65ec144d1e70eab76ee4f2f6b7a1d6c6f6abf1f81a4185425ebd2e"
Jul 06 14:57:49.492781 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:57:49.492762    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d609a03edf65ec144d1e70eab76ee4f2f6b7a1d6c6f6abf1f81a4185425ebd2e\": container with ID starting with d609a03edf65ec144d1e70eab76ee4f2f6b7a1d6c6f6abf1f81a4185425ebd2e not found: ID does not exist" containerID="d609a03edf65ec144d1e70eab76ee4f2f6b7a1d6c6f6abf1f81a4185425ebd2e"
Jul 06 14:57:49.492851 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:49.492790    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d609a03edf65ec144d1e70eab76ee4f2f6b7a1d6c6f6abf1f81a4185425ebd2e"} err="failed to get container status \"d609a03edf65ec144d1e70eab76ee4f2f6b7a1d6c6f6abf1f81a4185425ebd2e\": rpc error: code = NotFound desc = could not find container \"d609a03edf65ec144d1e70eab76ee4f2f6b7a1d6c6f6abf1f81a4185425ebd2e\": container with ID starting with d609a03edf65ec144d1e70eab76ee4f2f6b7a1d6c6f6abf1f81a4185425ebd2e not found: ID does not exist"
Jul 06 14:57:49.492851 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:49.492812    2565 scope.go:117] "RemoveContainer" containerID="1b7c517efe9d9f8491b510ac7f331bc53859834fbf151a1482a76fc06bd204f7"
Jul 06 14:57:49.493048 ip-10-0-138-90 kubenswrapper[2565]: E0706 14:57:49.493028    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b7c517efe9d9f8491b510ac7f331bc53859834fbf151a1482a76fc06bd204f7\": container with ID starting with 1b7c517efe9d9f8491b510ac7f331bc53859834fbf151a1482a76fc06bd204f7 not found: ID does not exist" containerID="1b7c517efe9d9f8491b510ac7f331bc53859834fbf151a1482a76fc06bd204f7"
Jul 06 14:57:49.493099 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:49.493053    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b7c517efe9d9f8491b510ac7f331bc53859834fbf151a1482a76fc06bd204f7"} err="failed to get container status \"1b7c517efe9d9f8491b510ac7f331bc53859834fbf151a1482a76fc06bd204f7\": rpc error: code = NotFound desc = could not find container \"1b7c517efe9d9f8491b510ac7f331bc53859834fbf151a1482a76fc06bd204f7\": container with ID starting with 1b7c517efe9d9f8491b510ac7f331bc53859834fbf151a1482a76fc06bd204f7 not found: ID does not exist"
Jul 06 14:57:49.514190 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:49.514166    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x"]
Jul 06 14:57:49.526617 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:49.526595    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-7ed418-openshift-default-cf58b986f-rk74x"]
Jul 06 14:57:49.954493 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:49.954460    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="038b65e5-79d9-4404-abf4-33fe594ac87b" path="/var/lib/kubelet/pods/038b65e5-79d9-4404-abf4-33fe594ac87b/volumes"
Jul 06 14:57:51.852040 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:51.852003    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w"]
Jul 06 14:57:51.852468 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:51.852452    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="038b65e5-79d9-4404-abf4-33fe594ac87b" containerName="istio-proxy"
Jul 06 14:57:51.852468 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:51.852465    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="038b65e5-79d9-4404-abf4-33fe594ac87b" containerName="istio-proxy"
Jul 06 14:57:51.852552 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:51.852472    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="038b65e5-79d9-4404-abf4-33fe594ac87b" containerName="istio-proxy"
Jul 06 14:57:51.852552 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:51.852478    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="038b65e5-79d9-4404-abf4-33fe594ac87b" containerName="istio-proxy"
Jul 06 14:57:51.852552 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:51.852545    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="038b65e5-79d9-4404-abf4-33fe594ac87b" containerName="istio-proxy"
Jul 06 14:57:51.852660 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:51.852554    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="038b65e5-79d9-4404-abf4-33fe594ac87b" containerName="istio-proxy"
Jul 06 14:57:51.852660 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:51.852561    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ccf527ed-f614-48da-bb03-a75ffe955454" containerName="istio-proxy"
Jul 06 14:57:51.854577 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:51.854562    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w"
Jul 06 14:57:51.857073 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:51.857055    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-58d9da-openshift-default-dockercfg-5j5b7\""
Jul 06 14:57:51.885066 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:51.885038    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w"]
Jul 06 14:57:51.916556 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:51.916532    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18bb667b-61b6-474b-b76f-125036eb2c16-workload-socket\") pod \"e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w\" (UID: \"18bb667b-61b6-474b-b76f-125036eb2c16\") " pod="openshift-ingress/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w"
Jul 06 14:57:51.916697 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:51.916561    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18bb667b-61b6-474b-b76f-125036eb2c16-workload-certs\") pod \"e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w\" (UID: \"18bb667b-61b6-474b-b76f-125036eb2c16\") " pod="openshift-ingress/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w"
Jul 06 14:57:51.916697 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:51.916586    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18bb667b-61b6-474b-b76f-125036eb2c16-istio-token\") pod \"e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w\" (UID: \"18bb667b-61b6-474b-b76f-125036eb2c16\") " pod="openshift-ingress/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w"
Jul 06 14:57:51.916697 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:51.916671    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18bb667b-61b6-474b-b76f-125036eb2c16-credential-socket\") pod \"e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w\" (UID: \"18bb667b-61b6-474b-b76f-125036eb2c16\") " pod="openshift-ingress/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w"
Jul 06 14:57:51.916697 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:51.916689    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18bb667b-61b6-474b-b76f-125036eb2c16-istio-envoy\") pod \"e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w\" (UID: \"18bb667b-61b6-474b-b76f-125036eb2c16\") " pod="openshift-ingress/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w"
Jul 06 14:57:51.916841 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:51.916740    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18bb667b-61b6-474b-b76f-125036eb2c16-istio-podinfo\") pod \"e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w\" (UID: \"18bb667b-61b6-474b-b76f-125036eb2c16\") " pod="openshift-ingress/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w"
Jul 06 14:57:51.916841 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:51.916768    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh66r\" (UniqueName: \"kubernetes.io/projected/18bb667b-61b6-474b-b76f-125036eb2c16-kube-api-access-gh66r\") pod \"e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w\" (UID: \"18bb667b-61b6-474b-b76f-125036eb2c16\") " pod="openshift-ingress/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w"
Jul 06 14:57:51.916841 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:51.916794    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18bb667b-61b6-474b-b76f-125036eb2c16-istiod-ca-cert\") pod \"e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w\" (UID: \"18bb667b-61b6-474b-b76f-125036eb2c16\") " pod="openshift-ingress/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w"
Jul 06 14:57:51.916934 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:51.916891    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18bb667b-61b6-474b-b76f-125036eb2c16-istio-data\") pod \"e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w\" (UID: \"18bb667b-61b6-474b-b76f-125036eb2c16\") " pod="openshift-ingress/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w"
Jul 06 14:57:52.018203 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:52.018175    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18bb667b-61b6-474b-b76f-125036eb2c16-credential-socket\") pod \"e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w\" (UID: \"18bb667b-61b6-474b-b76f-125036eb2c16\") " pod="openshift-ingress/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w"
Jul 06 14:57:52.018203 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:52.018206    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18bb667b-61b6-474b-b76f-125036eb2c16-istio-envoy\") pod \"e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w\" (UID: \"18bb667b-61b6-474b-b76f-125036eb2c16\") " pod="openshift-ingress/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w"
Jul 06 14:57:52.018497 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:52.018236    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18bb667b-61b6-474b-b76f-125036eb2c16-istio-podinfo\") pod \"e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w\" (UID: \"18bb667b-61b6-474b-b76f-125036eb2c16\") " pod="openshift-ingress/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w"
Jul 06 14:57:52.018497 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:52.018380    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh66r\" (UniqueName: \"kubernetes.io/projected/18bb667b-61b6-474b-b76f-125036eb2c16-kube-api-access-gh66r\") pod \"e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w\" (UID: \"18bb667b-61b6-474b-b76f-125036eb2c16\") " pod="openshift-ingress/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w"
Jul 06 14:57:52.018497 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:52.018410    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18bb667b-61b6-474b-b76f-125036eb2c16-istiod-ca-cert\") pod \"e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w\" (UID: \"18bb667b-61b6-474b-b76f-125036eb2c16\") " pod="openshift-ingress/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w"
Jul 06 14:57:52.018675 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:52.018506    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18bb667b-61b6-474b-b76f-125036eb2c16-istio-data\") pod \"e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w\" (UID: \"18bb667b-61b6-474b-b76f-125036eb2c16\") " pod="openshift-ingress/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w"
Jul 06 14:57:52.018675 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:52.018539    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18bb667b-61b6-474b-b76f-125036eb2c16-workload-socket\") pod \"e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w\" (UID: \"18bb667b-61b6-474b-b76f-125036eb2c16\") " pod="openshift-ingress/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w"
Jul 06 14:57:52.018675 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:52.018564    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18bb667b-61b6-474b-b76f-125036eb2c16-workload-certs\") pod \"e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w\" (UID: \"18bb667b-61b6-474b-b76f-125036eb2c16\") " pod="openshift-ingress/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w"
Jul 06 14:57:52.018675 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:52.018603    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18bb667b-61b6-474b-b76f-125036eb2c16-istio-token\") pod \"e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w\" (UID: \"18bb667b-61b6-474b-b76f-125036eb2c16\") " pod="openshift-ingress/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w"
Jul 06 14:57:52.018885 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:52.018810    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18bb667b-61b6-474b-b76f-125036eb2c16-istio-data\") pod \"e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w\" (UID: \"18bb667b-61b6-474b-b76f-125036eb2c16\") " pod="openshift-ingress/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w"
Jul 06 14:57:52.018885 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:52.018861    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18bb667b-61b6-474b-b76f-125036eb2c16-workload-socket\") pod \"e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w\" (UID: \"18bb667b-61b6-474b-b76f-125036eb2c16\") " pod="openshift-ingress/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w"
Jul 06 14:57:52.018996 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:52.018924    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18bb667b-61b6-474b-b76f-125036eb2c16-credential-socket\") pod \"e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w\" (UID: \"18bb667b-61b6-474b-b76f-125036eb2c16\") " pod="openshift-ingress/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w"
Jul 06 14:57:52.018996 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:52.018941    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18bb667b-61b6-474b-b76f-125036eb2c16-workload-certs\") pod \"e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w\" (UID: \"18bb667b-61b6-474b-b76f-125036eb2c16\") " pod="openshift-ingress/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w"
Jul 06 14:57:52.019127 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:52.019109    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18bb667b-61b6-474b-b76f-125036eb2c16-istiod-ca-cert\") pod \"e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w\" (UID: \"18bb667b-61b6-474b-b76f-125036eb2c16\") " pod="openshift-ingress/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w"
Jul 06 14:57:52.020666 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:52.020637    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18bb667b-61b6-474b-b76f-125036eb2c16-istio-envoy\") pod \"e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w\" (UID: \"18bb667b-61b6-474b-b76f-125036eb2c16\") " pod="openshift-ingress/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w"
Jul 06 14:57:52.020780 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:52.020707    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18bb667b-61b6-474b-b76f-125036eb2c16-istio-podinfo\") pod \"e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w\" (UID: \"18bb667b-61b6-474b-b76f-125036eb2c16\") " pod="openshift-ingress/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w"
Jul 06 14:57:52.029608 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:52.029590    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18bb667b-61b6-474b-b76f-125036eb2c16-istio-token\") pod \"e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w\" (UID: \"18bb667b-61b6-474b-b76f-125036eb2c16\") " pod="openshift-ingress/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w"
Jul 06 14:57:52.030072 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:52.030053    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh66r\" (UniqueName: \"kubernetes.io/projected/18bb667b-61b6-474b-b76f-125036eb2c16-kube-api-access-gh66r\") pod \"e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w\" (UID: \"18bb667b-61b6-474b-b76f-125036eb2c16\") " pod="openshift-ingress/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w"
Jul 06 14:57:52.165373 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:52.165318    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w"
Jul 06 14:57:52.341263 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:52.341239    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w"]
Jul 06 14:57:52.343430 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:57:52.343407    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18bb667b_61b6_474b_b76f_125036eb2c16.slice/crio-9063b9b341b89ad70a69e6e3585a78bfc8278c939cc19db9e45d83029b8eb6c4 WatchSource:0}: Error finding container 9063b9b341b89ad70a69e6e3585a78bfc8278c939cc19db9e45d83029b8eb6c4: Status 404 returned error can't find the container with id 9063b9b341b89ad70a69e6e3585a78bfc8278c939cc19db9e45d83029b8eb6c4
Jul 06 14:57:52.345685 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:52.345653    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:57:52.345757 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:52.345716    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:57:52.345757 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:52.345741    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:57:52.491802 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:52.491702    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w" event={"ID":"18bb667b-61b6-474b-b76f-125036eb2c16","Type":"ContainerStarted","Data":"3f09150441185f5bde4530a80df0eb69761ad9e57410f5f52b78c37d45f090fb"}
Jul 06 14:57:52.491802 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:52.491775    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w" event={"ID":"18bb667b-61b6-474b-b76f-125036eb2c16","Type":"ContainerStarted","Data":"9063b9b341b89ad70a69e6e3585a78bfc8278c939cc19db9e45d83029b8eb6c4"}
Jul 06 14:57:52.525556 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:52.525512    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w" podStartSLOduration=1.525495932 podStartE2EDuration="1.525495932s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:57:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:57:52.524552147 +0000 UTC m=+2075.703201198" watchObservedRunningTime="2026-07-06 14:57:52.525495932 +0000 UTC m=+2075.704144978"
Jul 06 14:57:53.166220 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:53.166190    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w"
Jul 06 14:57:53.171104 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:53.171081    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w"
Jul 06 14:57:53.498328 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:53.498244    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w"
Jul 06 14:57:53.499122 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:57:53.499102    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w"
Jul 06 14:58:08.567753 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:58:08.567133    2565 patch_prober.go:28] interesting pod/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": read tcp 10.134.0.2:38446->10.134.0.50:15021: read: connection reset by peer" start-of-body=
Jul 06 14:58:08.567753 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:58:08.567201    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w" podUID="18bb667b-61b6-474b-b76f-125036eb2c16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": read tcp 10.134.0.2:38446->10.134.0.50:15021: read: connection reset by peer"
Jul 06 14:58:09.588489 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:58:09.588454    2565 generic.go:356] "Generic (PLEG): container finished" podID="18bb667b-61b6-474b-b76f-125036eb2c16" containerID="3f09150441185f5bde4530a80df0eb69761ad9e57410f5f52b78c37d45f090fb" exitCode=0
Jul 06 14:58:09.588859 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:58:09.588505    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w" event={"ID":"18bb667b-61b6-474b-b76f-125036eb2c16","Type":"ContainerDied","Data":"3f09150441185f5bde4530a80df0eb69761ad9e57410f5f52b78c37d45f090fb"}
Jul 06 14:58:09.588919 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:58:09.588875    2565 scope.go:117] "RemoveContainer" containerID="3f09150441185f5bde4530a80df0eb69761ad9e57410f5f52b78c37d45f090fb"
Jul 06 14:58:09.590030 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:58:09.589996    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:58:09.590113 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:58:09.590084    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:58:09.590149 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:58:09.590129    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:58:10.599445 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:58:10.599412    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w" event={"ID":"18bb667b-61b6-474b-b76f-125036eb2c16","Type":"ContainerStarted","Data":"a736f7ceafa0932f2e4c34ef72d289d6ce7bd7ad46bdf02d241d0884b3e4b6f1"}
Jul 06 14:58:11.166157 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:58:11.166121    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w"
Jul 06 14:58:11.166400 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:58:11.166354    2565 patch_prober.go:28] interesting pod/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Jul 06 14:58:11.166488 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:58:11.166423    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w" podUID="18bb667b-61b6-474b-b76f-125036eb2c16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Jul 06 14:58:12.166174 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:58:12.166137    2565 patch_prober.go:28] interesting pod/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Jul 06 14:58:12.166603 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:58:12.166194    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w" podUID="18bb667b-61b6-474b-b76f-125036eb2c16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Jul 06 14:58:13.166511 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:58:13.166473    2565 patch_prober.go:28] interesting pod/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Jul 06 14:58:13.166941 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:58:13.166532    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w" podUID="18bb667b-61b6-474b-b76f-125036eb2c16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Jul 06 14:58:14.166540 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:58:14.166498    2565 patch_prober.go:28] interesting pod/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Jul 06 14:58:14.167073 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:58:14.166576    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w" podUID="18bb667b-61b6-474b-b76f-125036eb2c16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Jul 06 14:58:15.170463 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:58:15.170432    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w"
Jul 06 14:58:15.171020 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:58:15.170838    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w"
Jul 06 14:58:15.171596 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:58:15.171575    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w"
Jul 06 14:58:30.934639 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:58:30.934604    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-58d9da/auth-test-model-58d9da-kserve-76d66f55c5-7s6jb"]
Jul 06 14:58:30.938461 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:58:30.938439    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-58d9da/auth-test-model-58d9da-kserve-76d66f55c5-7s6jb"
Jul 06 14:58:30.940560 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:58:30.940531    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-58d9da\"/\"openshift-service-ca.crt\""
Jul 06 14:58:30.941264 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:58:30.941243    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-58d9da\"/\"kube-root-ca.crt\""
Jul 06 14:58:30.941403 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:58:30.941278    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-58d9da\"/\"auth-test-model-58d9da-kserve-self-signed-certs\""
Jul 06 14:58:30.941403 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:58:30.941250    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-58d9da\"/\"default-dockercfg-xgm5p\""
Jul 06 14:58:30.947602 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:58:30.947393    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-58d9da/auth-test-model-58d9da-kserve-76d66f55c5-7s6jb"]
Jul 06 14:58:30.998056 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:58:30.998015    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/758a5aab-4815-48e5-b6ba-528cb1c98157-dshm\") pod \"auth-test-model-58d9da-kserve-76d66f55c5-7s6jb\" (UID: \"758a5aab-4815-48e5-b6ba-528cb1c98157\") " pod="ai-tenant-e2e-shared-a-58d9da/auth-test-model-58d9da-kserve-76d66f55c5-7s6jb"
Jul 06 14:58:30.998227 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:58:30.998089    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/758a5aab-4815-48e5-b6ba-528cb1c98157-model-cache\") pod \"auth-test-model-58d9da-kserve-76d66f55c5-7s6jb\" (UID: \"758a5aab-4815-48e5-b6ba-528cb1c98157\") " pod="ai-tenant-e2e-shared-a-58d9da/auth-test-model-58d9da-kserve-76d66f55c5-7s6jb"
Jul 06 14:58:30.998227 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:58:30.998128    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/758a5aab-4815-48e5-b6ba-528cb1c98157-tls-certs\") pod \"auth-test-model-58d9da-kserve-76d66f55c5-7s6jb\" (UID: \"758a5aab-4815-48e5-b6ba-528cb1c98157\") " pod="ai-tenant-e2e-shared-a-58d9da/auth-test-model-58d9da-kserve-76d66f55c5-7s6jb"
Jul 06 14:58:30.998227 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:58:30.998211    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/758a5aab-4815-48e5-b6ba-528cb1c98157-home\") pod \"auth-test-model-58d9da-kserve-76d66f55c5-7s6jb\" (UID: \"758a5aab-4815-48e5-b6ba-528cb1c98157\") " pod="ai-tenant-e2e-shared-a-58d9da/auth-test-model-58d9da-kserve-76d66f55c5-7s6jb"
Jul 06 14:58:30.998371 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:58:30.998249    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/758a5aab-4815-48e5-b6ba-528cb1c98157-tmp-dir\") pod \"auth-test-model-58d9da-kserve-76d66f55c5-7s6jb\" (UID: \"758a5aab-4815-48e5-b6ba-528cb1c98157\") " pod="ai-tenant-e2e-shared-a-58d9da/auth-test-model-58d9da-kserve-76d66f55c5-7s6jb"
Jul 06 14:58:30.998371 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:58:30.998299    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x86j4\" (UniqueName: \"kubernetes.io/projected/758a5aab-4815-48e5-b6ba-528cb1c98157-kube-api-access-x86j4\") pod \"auth-test-model-58d9da-kserve-76d66f55c5-7s6jb\" (UID: \"758a5aab-4815-48e5-b6ba-528cb1c98157\") " pod="ai-tenant-e2e-shared-a-58d9da/auth-test-model-58d9da-kserve-76d66f55c5-7s6jb"
Jul 06 14:58:31.099289 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:58:31.099252    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/758a5aab-4815-48e5-b6ba-528cb1c98157-model-cache\") pod \"auth-test-model-58d9da-kserve-76d66f55c5-7s6jb\" (UID: \"758a5aab-4815-48e5-b6ba-528cb1c98157\") " pod="ai-tenant-e2e-shared-a-58d9da/auth-test-model-58d9da-kserve-76d66f55c5-7s6jb"
Jul 06 14:58:31.099289 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:58:31.099296    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/758a5aab-4815-48e5-b6ba-528cb1c98157-tls-certs\") pod \"auth-test-model-58d9da-kserve-76d66f55c5-7s6jb\" (UID: \"758a5aab-4815-48e5-b6ba-528cb1c98157\") " pod="ai-tenant-e2e-shared-a-58d9da/auth-test-model-58d9da-kserve-76d66f55c5-7s6jb"
Jul 06 14:58:31.099577 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:58:31.099404    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/758a5aab-4815-48e5-b6ba-528cb1c98157-home\") pod \"auth-test-model-58d9da-kserve-76d66f55c5-7s6jb\" (UID: \"758a5aab-4815-48e5-b6ba-528cb1c98157\") " pod="ai-tenant-e2e-shared-a-58d9da/auth-test-model-58d9da-kserve-76d66f55c5-7s6jb"
Jul 06 14:58:31.099577 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:58:31.099444    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/758a5aab-4815-48e5-b6ba-528cb1c98157-tmp-dir\") pod \"auth-test-model-58d9da-kserve-76d66f55c5-7s6jb\" (UID: \"758a5aab-4815-48e5-b6ba-528cb1c98157\") " pod="ai-tenant-e2e-shared-a-58d9da/auth-test-model-58d9da-kserve-76d66f55c5-7s6jb"
Jul 06 14:58:31.099577 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:58:31.099496    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x86j4\" (UniqueName: \"kubernetes.io/projected/758a5aab-4815-48e5-b6ba-528cb1c98157-kube-api-access-x86j4\") pod \"auth-test-model-58d9da-kserve-76d66f55c5-7s6jb\" (UID: \"758a5aab-4815-48e5-b6ba-528cb1c98157\") " pod="ai-tenant-e2e-shared-a-58d9da/auth-test-model-58d9da-kserve-76d66f55c5-7s6jb"
Jul 06 14:58:31.099800 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:58:31.099729    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/758a5aab-4815-48e5-b6ba-528cb1c98157-dshm\") pod \"auth-test-model-58d9da-kserve-76d66f55c5-7s6jb\" (UID: \"758a5aab-4815-48e5-b6ba-528cb1c98157\") " pod="ai-tenant-e2e-shared-a-58d9da/auth-test-model-58d9da-kserve-76d66f55c5-7s6jb"
Jul 06 14:58:31.099857 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:58:31.099792    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/758a5aab-4815-48e5-b6ba-528cb1c98157-model-cache\") pod \"auth-test-model-58d9da-kserve-76d66f55c5-7s6jb\" (UID: \"758a5aab-4815-48e5-b6ba-528cb1c98157\") " pod="ai-tenant-e2e-shared-a-58d9da/auth-test-model-58d9da-kserve-76d66f55c5-7s6jb"
Jul 06 14:58:31.099857 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:58:31.099811    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/758a5aab-4815-48e5-b6ba-528cb1c98157-home\") pod \"auth-test-model-58d9da-kserve-76d66f55c5-7s6jb\" (UID: \"758a5aab-4815-48e5-b6ba-528cb1c98157\") " pod="ai-tenant-e2e-shared-a-58d9da/auth-test-model-58d9da-kserve-76d66f55c5-7s6jb"
Jul 06 14:58:31.099946 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:58:31.099852    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/758a5aab-4815-48e5-b6ba-528cb1c98157-tmp-dir\") pod \"auth-test-model-58d9da-kserve-76d66f55c5-7s6jb\" (UID: \"758a5aab-4815-48e5-b6ba-528cb1c98157\") " pod="ai-tenant-e2e-shared-a-58d9da/auth-test-model-58d9da-kserve-76d66f55c5-7s6jb"
Jul 06 14:58:31.102050 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:58:31.102018    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/758a5aab-4815-48e5-b6ba-528cb1c98157-tls-certs\") pod \"auth-test-model-58d9da-kserve-76d66f55c5-7s6jb\" (UID: \"758a5aab-4815-48e5-b6ba-528cb1c98157\") " pod="ai-tenant-e2e-shared-a-58d9da/auth-test-model-58d9da-kserve-76d66f55c5-7s6jb"
Jul 06 14:58:31.102262 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:58:31.102246    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/758a5aab-4815-48e5-b6ba-528cb1c98157-dshm\") pod \"auth-test-model-58d9da-kserve-76d66f55c5-7s6jb\" (UID: \"758a5aab-4815-48e5-b6ba-528cb1c98157\") " pod="ai-tenant-e2e-shared-a-58d9da/auth-test-model-58d9da-kserve-76d66f55c5-7s6jb"
Jul 06 14:58:31.108693 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:58:31.108676    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x86j4\" (UniqueName: \"kubernetes.io/projected/758a5aab-4815-48e5-b6ba-528cb1c98157-kube-api-access-x86j4\") pod \"auth-test-model-58d9da-kserve-76d66f55c5-7s6jb\" (UID: \"758a5aab-4815-48e5-b6ba-528cb1c98157\") " pod="ai-tenant-e2e-shared-a-58d9da/auth-test-model-58d9da-kserve-76d66f55c5-7s6jb"
Jul 06 14:58:31.249935 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:58:31.249835    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-58d9da/auth-test-model-58d9da-kserve-76d66f55c5-7s6jb"
Jul 06 14:58:31.390474 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:58:31.390448    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-58d9da/auth-test-model-58d9da-kserve-76d66f55c5-7s6jb"]
Jul 06 14:58:31.393317 ip-10-0-138-90 kubenswrapper[2565]: W0706 14:58:31.393286    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod758a5aab_4815_48e5_b6ba_528cb1c98157.slice/crio-5df1c1586191581160fa073c5d35218fe455824d0a63ebd379215065060c94c8 WatchSource:0}: Error finding container 5df1c1586191581160fa073c5d35218fe455824d0a63ebd379215065060c94c8: Status 404 returned error can't find the container with id 5df1c1586191581160fa073c5d35218fe455824d0a63ebd379215065060c94c8
Jul 06 14:58:31.713404 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:58:31.713367    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-58d9da/auth-test-model-58d9da-kserve-76d66f55c5-7s6jb" event={"ID":"758a5aab-4815-48e5-b6ba-528cb1c98157","Type":"ContainerStarted","Data":"b7cb584e5db19dfc46c5131fd1ef2e3a2ee6d62d480c3e9e8fc7c7314b9bd21c"}
Jul 06 14:58:31.713611 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:58:31.713411    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-58d9da/auth-test-model-58d9da-kserve-76d66f55c5-7s6jb" event={"ID":"758a5aab-4815-48e5-b6ba-528cb1c98157","Type":"ContainerStarted","Data":"5df1c1586191581160fa073c5d35218fe455824d0a63ebd379215065060c94c8"}
Jul 06 14:58:31.732626 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:58:31.732576    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-58d9da/auth-test-model-58d9da-kserve-76d66f55c5-7s6jb" podStartSLOduration=1.7325605419999999 podStartE2EDuration="1.732560542s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:58:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:58:31.731011197 +0000 UTC m=+2114.909660244" watchObservedRunningTime="2026-07-06 14:58:31.732560542 +0000 UTC m=+2114.911209588"
Jul 06 14:58:41.250417 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:58:41.250374    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-58d9da/auth-test-model-58d9da-kserve-76d66f55c5-7s6jb"
Jul 06 14:58:41.250417 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:58:41.250424    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-58d9da/auth-test-model-58d9da-kserve-76d66f55c5-7s6jb"
Jul 06 14:58:41.262827 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:58:41.262800    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-58d9da/auth-test-model-58d9da-kserve-76d66f55c5-7s6jb"
Jul 06 14:58:41.777745 ip-10-0-138-90 kubenswrapper[2565]: I0706 14:58:41.777712    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-58d9da/auth-test-model-58d9da-kserve-76d66f55c5-7s6jb"
Jul 06 15:00:47.727971 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:00:47.727893    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-58d9da/auth-test-model-58d9da-kserve-76d66f55c5-7s6jb"]
Jul 06 15:01:00.492631 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:00.492603    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-58d9da/sub-test-model-58d9da-kserve-55c68757cc-c6lh8"]
Jul 06 15:01:00.502543 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:00.502519    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-58d9da/sub-test-model-58d9da-kserve-55c68757cc-c6lh8"
Jul 06 15:01:00.505315 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:00.505289    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-58d9da\"/\"sub-test-model-58d9da-kserve-self-signed-certs\""
Jul 06 15:01:00.508465 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:00.508439    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-58d9da/sub-test-model-58d9da-kserve-55c68757cc-c6lh8"]
Jul 06 15:01:00.572236 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:00.572201    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qt4j6\" (UniqueName: \"kubernetes.io/projected/e42aa398-2800-4ac6-b97c-4a5c2f324c83-kube-api-access-qt4j6\") pod \"sub-test-model-58d9da-kserve-55c68757cc-c6lh8\" (UID: \"e42aa398-2800-4ac6-b97c-4a5c2f324c83\") " pod="ai-tenant-e2e-shared-a-58d9da/sub-test-model-58d9da-kserve-55c68757cc-c6lh8"
Jul 06 15:01:00.572236 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:00.572235    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e42aa398-2800-4ac6-b97c-4a5c2f324c83-model-cache\") pod \"sub-test-model-58d9da-kserve-55c68757cc-c6lh8\" (UID: \"e42aa398-2800-4ac6-b97c-4a5c2f324c83\") " pod="ai-tenant-e2e-shared-a-58d9da/sub-test-model-58d9da-kserve-55c68757cc-c6lh8"
Jul 06 15:01:00.572462 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:00.572365    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e42aa398-2800-4ac6-b97c-4a5c2f324c83-tmp-dir\") pod \"sub-test-model-58d9da-kserve-55c68757cc-c6lh8\" (UID: \"e42aa398-2800-4ac6-b97c-4a5c2f324c83\") " pod="ai-tenant-e2e-shared-a-58d9da/sub-test-model-58d9da-kserve-55c68757cc-c6lh8"
Jul 06 15:01:00.572462 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:00.572406    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e42aa398-2800-4ac6-b97c-4a5c2f324c83-home\") pod \"sub-test-model-58d9da-kserve-55c68757cc-c6lh8\" (UID: \"e42aa398-2800-4ac6-b97c-4a5c2f324c83\") " pod="ai-tenant-e2e-shared-a-58d9da/sub-test-model-58d9da-kserve-55c68757cc-c6lh8"
Jul 06 15:01:00.572462 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:00.572445    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e42aa398-2800-4ac6-b97c-4a5c2f324c83-dshm\") pod \"sub-test-model-58d9da-kserve-55c68757cc-c6lh8\" (UID: \"e42aa398-2800-4ac6-b97c-4a5c2f324c83\") " pod="ai-tenant-e2e-shared-a-58d9da/sub-test-model-58d9da-kserve-55c68757cc-c6lh8"
Jul 06 15:01:00.572567 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:00.572534    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e42aa398-2800-4ac6-b97c-4a5c2f324c83-tls-certs\") pod \"sub-test-model-58d9da-kserve-55c68757cc-c6lh8\" (UID: \"e42aa398-2800-4ac6-b97c-4a5c2f324c83\") " pod="ai-tenant-e2e-shared-a-58d9da/sub-test-model-58d9da-kserve-55c68757cc-c6lh8"
Jul 06 15:01:00.673972 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:00.673938    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e42aa398-2800-4ac6-b97c-4a5c2f324c83-dshm\") pod \"sub-test-model-58d9da-kserve-55c68757cc-c6lh8\" (UID: \"e42aa398-2800-4ac6-b97c-4a5c2f324c83\") " pod="ai-tenant-e2e-shared-a-58d9da/sub-test-model-58d9da-kserve-55c68757cc-c6lh8"
Jul 06 15:01:00.674135 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:00.674083    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e42aa398-2800-4ac6-b97c-4a5c2f324c83-tls-certs\") pod \"sub-test-model-58d9da-kserve-55c68757cc-c6lh8\" (UID: \"e42aa398-2800-4ac6-b97c-4a5c2f324c83\") " pod="ai-tenant-e2e-shared-a-58d9da/sub-test-model-58d9da-kserve-55c68757cc-c6lh8"
Jul 06 15:01:00.674135 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:00.674109    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qt4j6\" (UniqueName: \"kubernetes.io/projected/e42aa398-2800-4ac6-b97c-4a5c2f324c83-kube-api-access-qt4j6\") pod \"sub-test-model-58d9da-kserve-55c68757cc-c6lh8\" (UID: \"e42aa398-2800-4ac6-b97c-4a5c2f324c83\") " pod="ai-tenant-e2e-shared-a-58d9da/sub-test-model-58d9da-kserve-55c68757cc-c6lh8"
Jul 06 15:01:00.674135 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:00.674126    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e42aa398-2800-4ac6-b97c-4a5c2f324c83-model-cache\") pod \"sub-test-model-58d9da-kserve-55c68757cc-c6lh8\" (UID: \"e42aa398-2800-4ac6-b97c-4a5c2f324c83\") " pod="ai-tenant-e2e-shared-a-58d9da/sub-test-model-58d9da-kserve-55c68757cc-c6lh8"
Jul 06 15:01:00.674300 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:00.674257    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e42aa398-2800-4ac6-b97c-4a5c2f324c83-tmp-dir\") pod \"sub-test-model-58d9da-kserve-55c68757cc-c6lh8\" (UID: \"e42aa398-2800-4ac6-b97c-4a5c2f324c83\") " pod="ai-tenant-e2e-shared-a-58d9da/sub-test-model-58d9da-kserve-55c68757cc-c6lh8"
Jul 06 15:01:00.674300 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:00.674279    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e42aa398-2800-4ac6-b97c-4a5c2f324c83-home\") pod \"sub-test-model-58d9da-kserve-55c68757cc-c6lh8\" (UID: \"e42aa398-2800-4ac6-b97c-4a5c2f324c83\") " pod="ai-tenant-e2e-shared-a-58d9da/sub-test-model-58d9da-kserve-55c68757cc-c6lh8"
Jul 06 15:01:00.674595 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:00.674569    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e42aa398-2800-4ac6-b97c-4a5c2f324c83-model-cache\") pod \"sub-test-model-58d9da-kserve-55c68757cc-c6lh8\" (UID: \"e42aa398-2800-4ac6-b97c-4a5c2f324c83\") " pod="ai-tenant-e2e-shared-a-58d9da/sub-test-model-58d9da-kserve-55c68757cc-c6lh8"
Jul 06 15:01:00.674721 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:00.674652    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e42aa398-2800-4ac6-b97c-4a5c2f324c83-tmp-dir\") pod \"sub-test-model-58d9da-kserve-55c68757cc-c6lh8\" (UID: \"e42aa398-2800-4ac6-b97c-4a5c2f324c83\") " pod="ai-tenant-e2e-shared-a-58d9da/sub-test-model-58d9da-kserve-55c68757cc-c6lh8"
Jul 06 15:01:00.674721 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:00.674676    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e42aa398-2800-4ac6-b97c-4a5c2f324c83-home\") pod \"sub-test-model-58d9da-kserve-55c68757cc-c6lh8\" (UID: \"e42aa398-2800-4ac6-b97c-4a5c2f324c83\") " pod="ai-tenant-e2e-shared-a-58d9da/sub-test-model-58d9da-kserve-55c68757cc-c6lh8"
Jul 06 15:01:00.676274 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:00.676254    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e42aa398-2800-4ac6-b97c-4a5c2f324c83-dshm\") pod \"sub-test-model-58d9da-kserve-55c68757cc-c6lh8\" (UID: \"e42aa398-2800-4ac6-b97c-4a5c2f324c83\") " pod="ai-tenant-e2e-shared-a-58d9da/sub-test-model-58d9da-kserve-55c68757cc-c6lh8"
Jul 06 15:01:00.676441 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:00.676424    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e42aa398-2800-4ac6-b97c-4a5c2f324c83-tls-certs\") pod \"sub-test-model-58d9da-kserve-55c68757cc-c6lh8\" (UID: \"e42aa398-2800-4ac6-b97c-4a5c2f324c83\") " pod="ai-tenant-e2e-shared-a-58d9da/sub-test-model-58d9da-kserve-55c68757cc-c6lh8"
Jul 06 15:01:00.688503 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:00.688473    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qt4j6\" (UniqueName: \"kubernetes.io/projected/e42aa398-2800-4ac6-b97c-4a5c2f324c83-kube-api-access-qt4j6\") pod \"sub-test-model-58d9da-kserve-55c68757cc-c6lh8\" (UID: \"e42aa398-2800-4ac6-b97c-4a5c2f324c83\") " pod="ai-tenant-e2e-shared-a-58d9da/sub-test-model-58d9da-kserve-55c68757cc-c6lh8"
Jul 06 15:01:00.814598 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:00.814505    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-58d9da/sub-test-model-58d9da-kserve-55c68757cc-c6lh8"
Jul 06 15:01:00.966808 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:00.966733    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-58d9da/sub-test-model-58d9da-kserve-55c68757cc-c6lh8"]
Jul 06 15:01:00.969319 ip-10-0-138-90 kubenswrapper[2565]: W0706 15:01:00.969287    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode42aa398_2800_4ac6_b97c_4a5c2f324c83.slice/crio-9c8a976ffdd381f8695da515821f69670ad2c6c6d2ef7ca9d4d670f4c6362d25 WatchSource:0}: Error finding container 9c8a976ffdd381f8695da515821f69670ad2c6c6d2ef7ca9d4d670f4c6362d25: Status 404 returned error can't find the container with id 9c8a976ffdd381f8695da515821f69670ad2c6c6d2ef7ca9d4d670f4c6362d25
Jul 06 15:01:01.494800 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:01.494764    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-58d9da/sub-test-model-58d9da-kserve-55c68757cc-c6lh8" event={"ID":"e42aa398-2800-4ac6-b97c-4a5c2f324c83","Type":"ContainerStarted","Data":"b54249c9246e7a008a648db7660ef0bbf126c24628aa3097eeec6c0bbea5f086"}
Jul 06 15:01:01.495186 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:01.494809    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-58d9da/sub-test-model-58d9da-kserve-55c68757cc-c6lh8" event={"ID":"e42aa398-2800-4ac6-b97c-4a5c2f324c83","Type":"ContainerStarted","Data":"9c8a976ffdd381f8695da515821f69670ad2c6c6d2ef7ca9d4d670f4c6362d25"}
Jul 06 15:01:01.541984 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:01.541935    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-58d9da/sub-test-model-58d9da-kserve-55c68757cc-c6lh8" podStartSLOduration=1.541918807 podStartE2EDuration="1.541918807s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:01:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:01:01.540906833 +0000 UTC m=+2264.719555880" watchObservedRunningTime="2026-07-06 15:01:01.541918807 +0000 UTC m=+2264.720567858"
Jul 06 15:01:02.748003 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:02.747941    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-58d9da/auth-test-model-58d9da-kserve-76d66f55c5-7s6jb" podUID="758a5aab-4815-48e5-b6ba-528cb1c98157" containerName="main" containerID="cri-o://b7cb584e5db19dfc46c5131fd1ef2e3a2ee6d62d480c3e9e8fc7c7314b9bd21c" gracePeriod=45
Jul 06 15:01:03.008451 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:03.008391    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-58d9da/auth-test-model-58d9da-kserve-76d66f55c5-7s6jb"
Jul 06 15:01:03.101703 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:03.101672    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/758a5aab-4815-48e5-b6ba-528cb1c98157-dshm\") pod \"758a5aab-4815-48e5-b6ba-528cb1c98157\" (UID: \"758a5aab-4815-48e5-b6ba-528cb1c98157\") "
Jul 06 15:01:03.101703 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:03.101708    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/758a5aab-4815-48e5-b6ba-528cb1c98157-model-cache\") pod \"758a5aab-4815-48e5-b6ba-528cb1c98157\" (UID: \"758a5aab-4815-48e5-b6ba-528cb1c98157\") "
Jul 06 15:01:03.101908 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:03.101726    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/758a5aab-4815-48e5-b6ba-528cb1c98157-tls-certs\") pod \"758a5aab-4815-48e5-b6ba-528cb1c98157\" (UID: \"758a5aab-4815-48e5-b6ba-528cb1c98157\") "
Jul 06 15:01:03.101908 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:03.101772    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/758a5aab-4815-48e5-b6ba-528cb1c98157-home\") pod \"758a5aab-4815-48e5-b6ba-528cb1c98157\" (UID: \"758a5aab-4815-48e5-b6ba-528cb1c98157\") "
Jul 06 15:01:03.101908 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:03.101815    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x86j4\" (UniqueName: \"kubernetes.io/projected/758a5aab-4815-48e5-b6ba-528cb1c98157-kube-api-access-x86j4\") pod \"758a5aab-4815-48e5-b6ba-528cb1c98157\" (UID: \"758a5aab-4815-48e5-b6ba-528cb1c98157\") "
Jul 06 15:01:03.101908 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:03.101877    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/758a5aab-4815-48e5-b6ba-528cb1c98157-tmp-dir\") pod \"758a5aab-4815-48e5-b6ba-528cb1c98157\" (UID: \"758a5aab-4815-48e5-b6ba-528cb1c98157\") "
Jul 06 15:01:03.102120 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:03.101993    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/758a5aab-4815-48e5-b6ba-528cb1c98157-model-cache" (OuterVolumeSpecName: "model-cache") pod "758a5aab-4815-48e5-b6ba-528cb1c98157" (UID: "758a5aab-4815-48e5-b6ba-528cb1c98157"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:01:03.102120 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:03.102074    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/758a5aab-4815-48e5-b6ba-528cb1c98157-home" (OuterVolumeSpecName: "home") pod "758a5aab-4815-48e5-b6ba-528cb1c98157" (UID: "758a5aab-4815-48e5-b6ba-528cb1c98157"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:01:03.102256 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:03.102202    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/758a5aab-4815-48e5-b6ba-528cb1c98157-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "758a5aab-4815-48e5-b6ba-528cb1c98157" (UID: "758a5aab-4815-48e5-b6ba-528cb1c98157"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:01:03.102331 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:03.102253    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/758a5aab-4815-48e5-b6ba-528cb1c98157-model-cache\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 15:01:03.102331 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:03.102270    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/758a5aab-4815-48e5-b6ba-528cb1c98157-home\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 15:01:03.104045 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:03.104021    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/758a5aab-4815-48e5-b6ba-528cb1c98157-dshm" (OuterVolumeSpecName: "dshm") pod "758a5aab-4815-48e5-b6ba-528cb1c98157" (UID: "758a5aab-4815-48e5-b6ba-528cb1c98157"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:01:03.104163 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:03.104099    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/758a5aab-4815-48e5-b6ba-528cb1c98157-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "758a5aab-4815-48e5-b6ba-528cb1c98157" (UID: "758a5aab-4815-48e5-b6ba-528cb1c98157"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 15:01:03.104217 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:03.104161    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/758a5aab-4815-48e5-b6ba-528cb1c98157-kube-api-access-x86j4" (OuterVolumeSpecName: "kube-api-access-x86j4") pod "758a5aab-4815-48e5-b6ba-528cb1c98157" (UID: "758a5aab-4815-48e5-b6ba-528cb1c98157"). InnerVolumeSpecName "kube-api-access-x86j4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 15:01:03.203375 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:03.203319    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/758a5aab-4815-48e5-b6ba-528cb1c98157-tmp-dir\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 15:01:03.203375 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:03.203368    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/758a5aab-4815-48e5-b6ba-528cb1c98157-dshm\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 15:01:03.203375 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:03.203377    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/758a5aab-4815-48e5-b6ba-528cb1c98157-tls-certs\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 15:01:03.203609 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:03.203389    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x86j4\" (UniqueName: \"kubernetes.io/projected/758a5aab-4815-48e5-b6ba-528cb1c98157-kube-api-access-x86j4\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 15:01:03.505831 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:03.505791    2565 generic.go:356] "Generic (PLEG): container finished" podID="758a5aab-4815-48e5-b6ba-528cb1c98157" containerID="b7cb584e5db19dfc46c5131fd1ef2e3a2ee6d62d480c3e9e8fc7c7314b9bd21c" exitCode=0
Jul 06 15:01:03.505831 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:03.505836    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-58d9da/auth-test-model-58d9da-kserve-76d66f55c5-7s6jb"
Jul 06 15:01:03.506063 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:03.505876    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-58d9da/auth-test-model-58d9da-kserve-76d66f55c5-7s6jb" event={"ID":"758a5aab-4815-48e5-b6ba-528cb1c98157","Type":"ContainerDied","Data":"b7cb584e5db19dfc46c5131fd1ef2e3a2ee6d62d480c3e9e8fc7c7314b9bd21c"}
Jul 06 15:01:03.506063 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:03.505922    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-58d9da/auth-test-model-58d9da-kserve-76d66f55c5-7s6jb" event={"ID":"758a5aab-4815-48e5-b6ba-528cb1c98157","Type":"ContainerDied","Data":"5df1c1586191581160fa073c5d35218fe455824d0a63ebd379215065060c94c8"}
Jul 06 15:01:03.506063 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:03.505940    2565 scope.go:117] "RemoveContainer" containerID="b7cb584e5db19dfc46c5131fd1ef2e3a2ee6d62d480c3e9e8fc7c7314b9bd21c"
Jul 06 15:01:03.515046 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:03.515028    2565 scope.go:117] "RemoveContainer" containerID="b7cb584e5db19dfc46c5131fd1ef2e3a2ee6d62d480c3e9e8fc7c7314b9bd21c"
Jul 06 15:01:03.515305 ip-10-0-138-90 kubenswrapper[2565]: E0706 15:01:03.515283    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7cb584e5db19dfc46c5131fd1ef2e3a2ee6d62d480c3e9e8fc7c7314b9bd21c\": container with ID starting with b7cb584e5db19dfc46c5131fd1ef2e3a2ee6d62d480c3e9e8fc7c7314b9bd21c not found: ID does not exist" containerID="b7cb584e5db19dfc46c5131fd1ef2e3a2ee6d62d480c3e9e8fc7c7314b9bd21c"
Jul 06 15:01:03.515389 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:03.515312    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7cb584e5db19dfc46c5131fd1ef2e3a2ee6d62d480c3e9e8fc7c7314b9bd21c"} err="failed to get container status \"b7cb584e5db19dfc46c5131fd1ef2e3a2ee6d62d480c3e9e8fc7c7314b9bd21c\": rpc error: code = NotFound desc = could not find container \"b7cb584e5db19dfc46c5131fd1ef2e3a2ee6d62d480c3e9e8fc7c7314b9bd21c\": container with ID starting with b7cb584e5db19dfc46c5131fd1ef2e3a2ee6d62d480c3e9e8fc7c7314b9bd21c not found: ID does not exist"
Jul 06 15:01:03.533898 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:03.533871    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-58d9da/auth-test-model-58d9da-kserve-76d66f55c5-7s6jb"]
Jul 06 15:01:03.537983 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:03.537961    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-58d9da/auth-test-model-58d9da-kserve-76d66f55c5-7s6jb"]
Jul 06 15:01:03.955820 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:03.955781    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="758a5aab-4815-48e5-b6ba-528cb1c98157" path="/var/lib/kubelet/pods/758a5aab-4815-48e5-b6ba-528cb1c98157/volumes"
Jul 06 15:01:10.815026 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:10.814991    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-58d9da/sub-test-model-58d9da-kserve-55c68757cc-c6lh8"
Jul 06 15:01:10.815426 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:10.815044    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-58d9da/sub-test-model-58d9da-kserve-55c68757cc-c6lh8"
Jul 06 15:01:10.827424 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:10.827400    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-58d9da/sub-test-model-58d9da-kserve-55c68757cc-c6lh8"
Jul 06 15:01:11.559432 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:01:11.559397    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-58d9da/sub-test-model-58d9da-kserve-55c68757cc-c6lh8"
Jul 06 15:02:26.146487 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:26.146452    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-58d9da/sub-test-model-58d9da-kserve-55c68757cc-c6lh8"]
Jul 06 15:02:41.166413 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:41.166325    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-58d9da/sub-test-model-58d9da-kserve-55c68757cc-c6lh8" podUID="e42aa398-2800-4ac6-b97c-4a5c2f324c83" containerName="main" containerID="cri-o://b54249c9246e7a008a648db7660ef0bbf126c24628aa3097eeec6c0bbea5f086" gracePeriod=45
Jul 06 15:02:41.416114 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:41.416088    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-58d9da/sub-test-model-58d9da-kserve-55c68757cc-c6lh8"
Jul 06 15:02:41.481107 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:41.481032    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qt4j6\" (UniqueName: \"kubernetes.io/projected/e42aa398-2800-4ac6-b97c-4a5c2f324c83-kube-api-access-qt4j6\") pod \"e42aa398-2800-4ac6-b97c-4a5c2f324c83\" (UID: \"e42aa398-2800-4ac6-b97c-4a5c2f324c83\") "
Jul 06 15:02:41.481107 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:41.481070    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e42aa398-2800-4ac6-b97c-4a5c2f324c83-model-cache\") pod \"e42aa398-2800-4ac6-b97c-4a5c2f324c83\" (UID: \"e42aa398-2800-4ac6-b97c-4a5c2f324c83\") "
Jul 06 15:02:41.481107 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:41.481097    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e42aa398-2800-4ac6-b97c-4a5c2f324c83-tmp-dir\") pod \"e42aa398-2800-4ac6-b97c-4a5c2f324c83\" (UID: \"e42aa398-2800-4ac6-b97c-4a5c2f324c83\") "
Jul 06 15:02:41.481362 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:41.481136    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e42aa398-2800-4ac6-b97c-4a5c2f324c83-home\") pod \"e42aa398-2800-4ac6-b97c-4a5c2f324c83\" (UID: \"e42aa398-2800-4ac6-b97c-4a5c2f324c83\") "
Jul 06 15:02:41.481362 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:41.481156    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e42aa398-2800-4ac6-b97c-4a5c2f324c83-tls-certs\") pod \"e42aa398-2800-4ac6-b97c-4a5c2f324c83\" (UID: \"e42aa398-2800-4ac6-b97c-4a5c2f324c83\") "
Jul 06 15:02:41.481362 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:41.481263    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e42aa398-2800-4ac6-b97c-4a5c2f324c83-dshm\") pod \"e42aa398-2800-4ac6-b97c-4a5c2f324c83\" (UID: \"e42aa398-2800-4ac6-b97c-4a5c2f324c83\") "
Jul 06 15:02:41.481547 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:41.481373    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e42aa398-2800-4ac6-b97c-4a5c2f324c83-model-cache" (OuterVolumeSpecName: "model-cache") pod "e42aa398-2800-4ac6-b97c-4a5c2f324c83" (UID: "e42aa398-2800-4ac6-b97c-4a5c2f324c83"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:02:41.481547 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:41.481470    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e42aa398-2800-4ac6-b97c-4a5c2f324c83-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e42aa398-2800-4ac6-b97c-4a5c2f324c83" (UID: "e42aa398-2800-4ac6-b97c-4a5c2f324c83"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:02:41.481547 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:41.481484    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e42aa398-2800-4ac6-b97c-4a5c2f324c83-home" (OuterVolumeSpecName: "home") pod "e42aa398-2800-4ac6-b97c-4a5c2f324c83" (UID: "e42aa398-2800-4ac6-b97c-4a5c2f324c83"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:02:41.481693 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:41.481620    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e42aa398-2800-4ac6-b97c-4a5c2f324c83-model-cache\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 15:02:41.481693 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:41.481661    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e42aa398-2800-4ac6-b97c-4a5c2f324c83-tmp-dir\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 15:02:41.481693 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:41.481674    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e42aa398-2800-4ac6-b97c-4a5c2f324c83-home\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 15:02:41.483414 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:41.483387    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e42aa398-2800-4ac6-b97c-4a5c2f324c83-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e42aa398-2800-4ac6-b97c-4a5c2f324c83" (UID: "e42aa398-2800-4ac6-b97c-4a5c2f324c83"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 15:02:41.483619 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:41.483600    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e42aa398-2800-4ac6-b97c-4a5c2f324c83-dshm" (OuterVolumeSpecName: "dshm") pod "e42aa398-2800-4ac6-b97c-4a5c2f324c83" (UID: "e42aa398-2800-4ac6-b97c-4a5c2f324c83"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:02:41.483734 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:41.483668    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e42aa398-2800-4ac6-b97c-4a5c2f324c83-kube-api-access-qt4j6" (OuterVolumeSpecName: "kube-api-access-qt4j6") pod "e42aa398-2800-4ac6-b97c-4a5c2f324c83" (UID: "e42aa398-2800-4ac6-b97c-4a5c2f324c83"). InnerVolumeSpecName "kube-api-access-qt4j6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 15:02:41.582948 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:41.582914    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e42aa398-2800-4ac6-b97c-4a5c2f324c83-dshm\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 15:02:41.582948 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:41.582944    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qt4j6\" (UniqueName: \"kubernetes.io/projected/e42aa398-2800-4ac6-b97c-4a5c2f324c83-kube-api-access-qt4j6\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 15:02:41.582948 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:41.582955    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e42aa398-2800-4ac6-b97c-4a5c2f324c83-tls-certs\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 15:02:42.011893 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:42.011860    2565 generic.go:356] "Generic (PLEG): container finished" podID="e42aa398-2800-4ac6-b97c-4a5c2f324c83" containerID="b54249c9246e7a008a648db7660ef0bbf126c24628aa3097eeec6c0bbea5f086" exitCode=0
Jul 06 15:02:42.012052 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:42.011898    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-58d9da/sub-test-model-58d9da-kserve-55c68757cc-c6lh8"
Jul 06 15:02:42.012052 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:42.011921    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-58d9da/sub-test-model-58d9da-kserve-55c68757cc-c6lh8" event={"ID":"e42aa398-2800-4ac6-b97c-4a5c2f324c83","Type":"ContainerDied","Data":"b54249c9246e7a008a648db7660ef0bbf126c24628aa3097eeec6c0bbea5f086"}
Jul 06 15:02:42.012052 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:42.011956    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-58d9da/sub-test-model-58d9da-kserve-55c68757cc-c6lh8" event={"ID":"e42aa398-2800-4ac6-b97c-4a5c2f324c83","Type":"ContainerDied","Data":"9c8a976ffdd381f8695da515821f69670ad2c6c6d2ef7ca9d4d670f4c6362d25"}
Jul 06 15:02:42.012052 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:42.011973    2565 scope.go:117] "RemoveContainer" containerID="b54249c9246e7a008a648db7660ef0bbf126c24628aa3097eeec6c0bbea5f086"
Jul 06 15:02:42.020630 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:42.020609    2565 scope.go:117] "RemoveContainer" containerID="b54249c9246e7a008a648db7660ef0bbf126c24628aa3097eeec6c0bbea5f086"
Jul 06 15:02:42.020913 ip-10-0-138-90 kubenswrapper[2565]: E0706 15:02:42.020892    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b54249c9246e7a008a648db7660ef0bbf126c24628aa3097eeec6c0bbea5f086\": container with ID starting with b54249c9246e7a008a648db7660ef0bbf126c24628aa3097eeec6c0bbea5f086 not found: ID does not exist" containerID="b54249c9246e7a008a648db7660ef0bbf126c24628aa3097eeec6c0bbea5f086"
Jul 06 15:02:42.020975 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:42.020921    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b54249c9246e7a008a648db7660ef0bbf126c24628aa3097eeec6c0bbea5f086"} err="failed to get container status \"b54249c9246e7a008a648db7660ef0bbf126c24628aa3097eeec6c0bbea5f086\": rpc error: code = NotFound desc = could not find container \"b54249c9246e7a008a648db7660ef0bbf126c24628aa3097eeec6c0bbea5f086\": container with ID starting with b54249c9246e7a008a648db7660ef0bbf126c24628aa3097eeec6c0bbea5f086 not found: ID does not exist"
Jul 06 15:02:42.043194 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:42.043162    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-58d9da/sub-test-model-58d9da-kserve-55c68757cc-c6lh8"]
Jul 06 15:02:42.051771 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:42.051750    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-58d9da/sub-test-model-58d9da-kserve-55c68757cc-c6lh8"]
Jul 06 15:02:43.954256 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:43.954179    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e42aa398-2800-4ac6-b97c-4a5c2f324c83" path="/var/lib/kubelet/pods/e42aa398-2800-4ac6-b97c-4a5c2f324c83/volumes"
Jul 06 15:02:52.457676 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:52.457636    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-a38db2/rate-test-model-a38db2-kserve-64f4f5f5c9-bskj4"]
Jul 06 15:02:52.458293 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:52.458277    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="758a5aab-4815-48e5-b6ba-528cb1c98157" containerName="main"
Jul 06 15:02:52.458356 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:52.458298    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="758a5aab-4815-48e5-b6ba-528cb1c98157" containerName="main"
Jul 06 15:02:52.458356 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:52.458313    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e42aa398-2800-4ac6-b97c-4a5c2f324c83" containerName="main"
Jul 06 15:02:52.458356 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:52.458321    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e42aa398-2800-4ac6-b97c-4a5c2f324c83" containerName="main"
Jul 06 15:02:52.458456 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:52.458429    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="758a5aab-4815-48e5-b6ba-528cb1c98157" containerName="main"
Jul 06 15:02:52.458456 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:52.458446    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e42aa398-2800-4ac6-b97c-4a5c2f324c83" containerName="main"
Jul 06 15:02:52.461974 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:52.461957    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a38db2/rate-test-model-a38db2-kserve-64f4f5f5c9-bskj4"
Jul 06 15:02:52.464791 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:52.464766    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a38db2\"/\"openshift-service-ca.crt\""
Jul 06 15:02:52.464937 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:52.464809    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a38db2\"/\"kube-root-ca.crt\""
Jul 06 15:02:52.465011 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:52.464825    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a38db2\"/\"default-dockercfg-9l59j\""
Jul 06 15:02:52.465011 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:52.464840    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a38db2\"/\"rate-test-model-a38db2-kserve-self-signed-certs\""
Jul 06 15:02:52.478213 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:52.478186    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a38db2/rate-test-model-a38db2-kserve-64f4f5f5c9-bskj4"]
Jul 06 15:02:52.592237 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:52.592199    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a77c1747-e947-452b-8d15-cded9aee25ad-tls-certs\") pod \"rate-test-model-a38db2-kserve-64f4f5f5c9-bskj4\" (UID: \"a77c1747-e947-452b-8d15-cded9aee25ad\") " pod="ai-tenant-e2e-shared-b-a38db2/rate-test-model-a38db2-kserve-64f4f5f5c9-bskj4"
Jul 06 15:02:52.592439 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:52.592252    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zccg8\" (UniqueName: \"kubernetes.io/projected/a77c1747-e947-452b-8d15-cded9aee25ad-kube-api-access-zccg8\") pod \"rate-test-model-a38db2-kserve-64f4f5f5c9-bskj4\" (UID: \"a77c1747-e947-452b-8d15-cded9aee25ad\") " pod="ai-tenant-e2e-shared-b-a38db2/rate-test-model-a38db2-kserve-64f4f5f5c9-bskj4"
Jul 06 15:02:52.592439 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:52.592306    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a77c1747-e947-452b-8d15-cded9aee25ad-home\") pod \"rate-test-model-a38db2-kserve-64f4f5f5c9-bskj4\" (UID: \"a77c1747-e947-452b-8d15-cded9aee25ad\") " pod="ai-tenant-e2e-shared-b-a38db2/rate-test-model-a38db2-kserve-64f4f5f5c9-bskj4"
Jul 06 15:02:52.592439 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:52.592368    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a77c1747-e947-452b-8d15-cded9aee25ad-tmp-dir\") pod \"rate-test-model-a38db2-kserve-64f4f5f5c9-bskj4\" (UID: \"a77c1747-e947-452b-8d15-cded9aee25ad\") " pod="ai-tenant-e2e-shared-b-a38db2/rate-test-model-a38db2-kserve-64f4f5f5c9-bskj4"
Jul 06 15:02:52.592439 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:52.592394    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a77c1747-e947-452b-8d15-cded9aee25ad-dshm\") pod \"rate-test-model-a38db2-kserve-64f4f5f5c9-bskj4\" (UID: \"a77c1747-e947-452b-8d15-cded9aee25ad\") " pod="ai-tenant-e2e-shared-b-a38db2/rate-test-model-a38db2-kserve-64f4f5f5c9-bskj4"
Jul 06 15:02:52.592595 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:52.592485    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a77c1747-e947-452b-8d15-cded9aee25ad-model-cache\") pod \"rate-test-model-a38db2-kserve-64f4f5f5c9-bskj4\" (UID: \"a77c1747-e947-452b-8d15-cded9aee25ad\") " pod="ai-tenant-e2e-shared-b-a38db2/rate-test-model-a38db2-kserve-64f4f5f5c9-bskj4"
Jul 06 15:02:52.693268 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:52.693222    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a77c1747-e947-452b-8d15-cded9aee25ad-model-cache\") pod \"rate-test-model-a38db2-kserve-64f4f5f5c9-bskj4\" (UID: \"a77c1747-e947-452b-8d15-cded9aee25ad\") " pod="ai-tenant-e2e-shared-b-a38db2/rate-test-model-a38db2-kserve-64f4f5f5c9-bskj4"
Jul 06 15:02:52.693505 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:52.693278    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a77c1747-e947-452b-8d15-cded9aee25ad-tls-certs\") pod \"rate-test-model-a38db2-kserve-64f4f5f5c9-bskj4\" (UID: \"a77c1747-e947-452b-8d15-cded9aee25ad\") " pod="ai-tenant-e2e-shared-b-a38db2/rate-test-model-a38db2-kserve-64f4f5f5c9-bskj4"
Jul 06 15:02:52.693505 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:52.693312    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zccg8\" (UniqueName: \"kubernetes.io/projected/a77c1747-e947-452b-8d15-cded9aee25ad-kube-api-access-zccg8\") pod \"rate-test-model-a38db2-kserve-64f4f5f5c9-bskj4\" (UID: \"a77c1747-e947-452b-8d15-cded9aee25ad\") " pod="ai-tenant-e2e-shared-b-a38db2/rate-test-model-a38db2-kserve-64f4f5f5c9-bskj4"
Jul 06 15:02:52.693505 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:52.693367    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a77c1747-e947-452b-8d15-cded9aee25ad-home\") pod \"rate-test-model-a38db2-kserve-64f4f5f5c9-bskj4\" (UID: \"a77c1747-e947-452b-8d15-cded9aee25ad\") " pod="ai-tenant-e2e-shared-b-a38db2/rate-test-model-a38db2-kserve-64f4f5f5c9-bskj4"
Jul 06 15:02:52.693505 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:52.693418    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a77c1747-e947-452b-8d15-cded9aee25ad-tmp-dir\") pod \"rate-test-model-a38db2-kserve-64f4f5f5c9-bskj4\" (UID: \"a77c1747-e947-452b-8d15-cded9aee25ad\") " pod="ai-tenant-e2e-shared-b-a38db2/rate-test-model-a38db2-kserve-64f4f5f5c9-bskj4"
Jul 06 15:02:52.693505 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:52.693452    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a77c1747-e947-452b-8d15-cded9aee25ad-dshm\") pod \"rate-test-model-a38db2-kserve-64f4f5f5c9-bskj4\" (UID: \"a77c1747-e947-452b-8d15-cded9aee25ad\") " pod="ai-tenant-e2e-shared-b-a38db2/rate-test-model-a38db2-kserve-64f4f5f5c9-bskj4"
Jul 06 15:02:52.693858 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:52.693773    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a77c1747-e947-452b-8d15-cded9aee25ad-model-cache\") pod \"rate-test-model-a38db2-kserve-64f4f5f5c9-bskj4\" (UID: \"a77c1747-e947-452b-8d15-cded9aee25ad\") " pod="ai-tenant-e2e-shared-b-a38db2/rate-test-model-a38db2-kserve-64f4f5f5c9-bskj4"
Jul 06 15:02:52.693858 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:52.693786    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a77c1747-e947-452b-8d15-cded9aee25ad-home\") pod \"rate-test-model-a38db2-kserve-64f4f5f5c9-bskj4\" (UID: \"a77c1747-e947-452b-8d15-cded9aee25ad\") " pod="ai-tenant-e2e-shared-b-a38db2/rate-test-model-a38db2-kserve-64f4f5f5c9-bskj4"
Jul 06 15:02:52.693939 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:52.693918    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a77c1747-e947-452b-8d15-cded9aee25ad-tmp-dir\") pod \"rate-test-model-a38db2-kserve-64f4f5f5c9-bskj4\" (UID: \"a77c1747-e947-452b-8d15-cded9aee25ad\") " pod="ai-tenant-e2e-shared-b-a38db2/rate-test-model-a38db2-kserve-64f4f5f5c9-bskj4"
Jul 06 15:02:52.695724 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:52.695703    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a77c1747-e947-452b-8d15-cded9aee25ad-dshm\") pod \"rate-test-model-a38db2-kserve-64f4f5f5c9-bskj4\" (UID: \"a77c1747-e947-452b-8d15-cded9aee25ad\") " pod="ai-tenant-e2e-shared-b-a38db2/rate-test-model-a38db2-kserve-64f4f5f5c9-bskj4"
Jul 06 15:02:52.695862 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:52.695845    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a77c1747-e947-452b-8d15-cded9aee25ad-tls-certs\") pod \"rate-test-model-a38db2-kserve-64f4f5f5c9-bskj4\" (UID: \"a77c1747-e947-452b-8d15-cded9aee25ad\") " pod="ai-tenant-e2e-shared-b-a38db2/rate-test-model-a38db2-kserve-64f4f5f5c9-bskj4"
Jul 06 15:02:52.706413 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:52.706385    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zccg8\" (UniqueName: \"kubernetes.io/projected/a77c1747-e947-452b-8d15-cded9aee25ad-kube-api-access-zccg8\") pod \"rate-test-model-a38db2-kserve-64f4f5f5c9-bskj4\" (UID: \"a77c1747-e947-452b-8d15-cded9aee25ad\") " pod="ai-tenant-e2e-shared-b-a38db2/rate-test-model-a38db2-kserve-64f4f5f5c9-bskj4"
Jul 06 15:02:52.772407 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:52.772314    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a38db2/rate-test-model-a38db2-kserve-64f4f5f5c9-bskj4"
Jul 06 15:02:52.909292 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:52.909260    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a38db2/rate-test-model-a38db2-kserve-64f4f5f5c9-bskj4"]
Jul 06 15:02:52.911884 ip-10-0-138-90 kubenswrapper[2565]: W0706 15:02:52.911857    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda77c1747_e947_452b_8d15_cded9aee25ad.slice/crio-facd02bf376ce313bdcce5c355321f359e63064cfeab0c55db5ed11c36580c4c WatchSource:0}: Error finding container facd02bf376ce313bdcce5c355321f359e63064cfeab0c55db5ed11c36580c4c: Status 404 returned error can't find the container with id facd02bf376ce313bdcce5c355321f359e63064cfeab0c55db5ed11c36580c4c
Jul 06 15:02:53.069628 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:53.069549    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a38db2/rate-test-model-a38db2-kserve-64f4f5f5c9-bskj4" event={"ID":"a77c1747-e947-452b-8d15-cded9aee25ad","Type":"ContainerStarted","Data":"3e0504760e386c60540ef06f242e680217e481407810092323b3505843bf0fb3"}
Jul 06 15:02:53.069628 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:53.069587    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a38db2/rate-test-model-a38db2-kserve-64f4f5f5c9-bskj4" event={"ID":"a77c1747-e947-452b-8d15-cded9aee25ad","Type":"ContainerStarted","Data":"facd02bf376ce313bdcce5c355321f359e63064cfeab0c55db5ed11c36580c4c"}
Jul 06 15:02:53.097426 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:02:53.097363    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-a38db2/rate-test-model-a38db2-kserve-64f4f5f5c9-bskj4" podStartSLOduration=1.097328131 podStartE2EDuration="1.097328131s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:02:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:02:53.095176617 +0000 UTC m=+2376.273825662" watchObservedRunningTime="2026-07-06 15:02:53.097328131 +0000 UTC m=+2376.275977177"
Jul 06 15:03:02.772594 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:03:02.772561    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-a38db2/rate-test-model-a38db2-kserve-64f4f5f5c9-bskj4"
Jul 06 15:03:02.773075 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:03:02.772615    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-a38db2/rate-test-model-a38db2-kserve-64f4f5f5c9-bskj4"
Jul 06 15:03:02.785542 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:03:02.785519    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-a38db2/rate-test-model-a38db2-kserve-64f4f5f5c9-bskj4"
Jul 06 15:03:03.135703 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:03:03.135624    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-a38db2/rate-test-model-a38db2-kserve-64f4f5f5c9-bskj4"
Jul 06 15:03:42.190518 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:03:42.190442    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a38db2/rate-test-model-a38db2-kserve-64f4f5f5c9-bskj4"]
Jul 06 15:03:57.210901 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:03:57.210836    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-a38db2/rate-test-model-a38db2-kserve-64f4f5f5c9-bskj4" podUID="a77c1747-e947-452b-8d15-cded9aee25ad" containerName="main" containerID="cri-o://3e0504760e386c60540ef06f242e680217e481407810092323b3505843bf0fb3" gracePeriod=45
Jul 06 15:03:57.407379 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:03:57.407325    2565 generic.go:356] "Generic (PLEG): container finished" podID="a77c1747-e947-452b-8d15-cded9aee25ad" containerID="3e0504760e386c60540ef06f242e680217e481407810092323b3505843bf0fb3" exitCode=0
Jul 06 15:03:57.407549 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:03:57.407374    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a38db2/rate-test-model-a38db2-kserve-64f4f5f5c9-bskj4" event={"ID":"a77c1747-e947-452b-8d15-cded9aee25ad","Type":"ContainerDied","Data":"3e0504760e386c60540ef06f242e680217e481407810092323b3505843bf0fb3"}
Jul 06 15:03:57.466247 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:03:57.466187    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a38db2/rate-test-model-a38db2-kserve-64f4f5f5c9-bskj4"
Jul 06 15:03:57.557473 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:03:57.557439    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zccg8\" (UniqueName: \"kubernetes.io/projected/a77c1747-e947-452b-8d15-cded9aee25ad-kube-api-access-zccg8\") pod \"a77c1747-e947-452b-8d15-cded9aee25ad\" (UID: \"a77c1747-e947-452b-8d15-cded9aee25ad\") "
Jul 06 15:03:57.557662 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:03:57.557550    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a77c1747-e947-452b-8d15-cded9aee25ad-tmp-dir\") pod \"a77c1747-e947-452b-8d15-cded9aee25ad\" (UID: \"a77c1747-e947-452b-8d15-cded9aee25ad\") "
Jul 06 15:03:57.557662 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:03:57.557598    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a77c1747-e947-452b-8d15-cded9aee25ad-home\") pod \"a77c1747-e947-452b-8d15-cded9aee25ad\" (UID: \"a77c1747-e947-452b-8d15-cded9aee25ad\") "
Jul 06 15:03:57.557662 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:03:57.557625    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a77c1747-e947-452b-8d15-cded9aee25ad-dshm\") pod \"a77c1747-e947-452b-8d15-cded9aee25ad\" (UID: \"a77c1747-e947-452b-8d15-cded9aee25ad\") "
Jul 06 15:03:57.557831 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:03:57.557674    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a77c1747-e947-452b-8d15-cded9aee25ad-tls-certs\") pod \"a77c1747-e947-452b-8d15-cded9aee25ad\" (UID: \"a77c1747-e947-452b-8d15-cded9aee25ad\") "
Jul 06 15:03:57.557831 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:03:57.557718    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a77c1747-e947-452b-8d15-cded9aee25ad-model-cache\") pod \"a77c1747-e947-452b-8d15-cded9aee25ad\" (UID: \"a77c1747-e947-452b-8d15-cded9aee25ad\") "
Jul 06 15:03:57.557831 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:03:57.557816    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a77c1747-e947-452b-8d15-cded9aee25ad-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a77c1747-e947-452b-8d15-cded9aee25ad" (UID: "a77c1747-e947-452b-8d15-cded9aee25ad"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:03:57.557987 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:03:57.557835    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a77c1747-e947-452b-8d15-cded9aee25ad-home" (OuterVolumeSpecName: "home") pod "a77c1747-e947-452b-8d15-cded9aee25ad" (UID: "a77c1747-e947-452b-8d15-cded9aee25ad"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:03:57.558061 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:03:57.558040    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a77c1747-e947-452b-8d15-cded9aee25ad-model-cache" (OuterVolumeSpecName: "model-cache") pod "a77c1747-e947-452b-8d15-cded9aee25ad" (UID: "a77c1747-e947-452b-8d15-cded9aee25ad"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:03:57.558167 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:03:57.558153    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a77c1747-e947-452b-8d15-cded9aee25ad-tmp-dir\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 15:03:57.558220 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:03:57.558172    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a77c1747-e947-452b-8d15-cded9aee25ad-home\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 15:03:57.558220 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:03:57.558185    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a77c1747-e947-452b-8d15-cded9aee25ad-model-cache\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 15:03:57.559824 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:03:57.559758    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a77c1747-e947-452b-8d15-cded9aee25ad-kube-api-access-zccg8" (OuterVolumeSpecName: "kube-api-access-zccg8") pod "a77c1747-e947-452b-8d15-cded9aee25ad" (UID: "a77c1747-e947-452b-8d15-cded9aee25ad"). InnerVolumeSpecName "kube-api-access-zccg8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 15:03:57.559824 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:03:57.559798    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a77c1747-e947-452b-8d15-cded9aee25ad-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a77c1747-e947-452b-8d15-cded9aee25ad" (UID: "a77c1747-e947-452b-8d15-cded9aee25ad"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 15:03:57.559979 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:03:57.559848    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a77c1747-e947-452b-8d15-cded9aee25ad-dshm" (OuterVolumeSpecName: "dshm") pod "a77c1747-e947-452b-8d15-cded9aee25ad" (UID: "a77c1747-e947-452b-8d15-cded9aee25ad"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:03:57.659131 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:03:57.659091    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a77c1747-e947-452b-8d15-cded9aee25ad-tls-certs\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 15:03:57.659131 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:03:57.659125    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zccg8\" (UniqueName: \"kubernetes.io/projected/a77c1747-e947-452b-8d15-cded9aee25ad-kube-api-access-zccg8\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 15:03:57.659131 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:03:57.659135    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a77c1747-e947-452b-8d15-cded9aee25ad-dshm\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 15:03:58.413515 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:03:58.413474    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a38db2/rate-test-model-a38db2-kserve-64f4f5f5c9-bskj4" event={"ID":"a77c1747-e947-452b-8d15-cded9aee25ad","Type":"ContainerDied","Data":"facd02bf376ce313bdcce5c355321f359e63064cfeab0c55db5ed11c36580c4c"}
Jul 06 15:03:58.413925 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:03:58.413526    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a38db2/rate-test-model-a38db2-kserve-64f4f5f5c9-bskj4"
Jul 06 15:03:58.413925 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:03:58.413537    2565 scope.go:117] "RemoveContainer" containerID="3e0504760e386c60540ef06f242e680217e481407810092323b3505843bf0fb3"
Jul 06 15:03:58.435464 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:03:58.435435    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a38db2/rate-test-model-a38db2-kserve-64f4f5f5c9-bskj4"]
Jul 06 15:03:58.440667 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:03:58.440640    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-a38db2/rate-test-model-a38db2-kserve-64f4f5f5c9-bskj4"]
Jul 06 15:03:59.954233 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:03:59.954191    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a77c1747-e947-452b-8d15-cded9aee25ad" path="/var/lib/kubelet/pods/a77c1747-e947-452b-8d15-cded9aee25ad/volumes"
Jul 06 15:04:08.045884 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:08.045849    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w"]
Jul 06 15:04:08.046465 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:08.046147    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w" podUID="18bb667b-61b6-474b-b76f-125036eb2c16" containerName="istio-proxy" containerID="cri-o://a736f7ceafa0932f2e4c34ef72d289d6ce7bd7ad46bdf02d241d0884b3e4b6f1" gracePeriod=30
Jul 06 15:04:13.306441 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:13.306334    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w"
Jul 06 15:04:13.411671 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:13.411637    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18bb667b-61b6-474b-b76f-125036eb2c16-istio-podinfo\") pod \"18bb667b-61b6-474b-b76f-125036eb2c16\" (UID: \"18bb667b-61b6-474b-b76f-125036eb2c16\") "
Jul 06 15:04:13.411845 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:13.411690    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18bb667b-61b6-474b-b76f-125036eb2c16-istio-data\") pod \"18bb667b-61b6-474b-b76f-125036eb2c16\" (UID: \"18bb667b-61b6-474b-b76f-125036eb2c16\") "
Jul 06 15:04:13.411845 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:13.411720    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18bb667b-61b6-474b-b76f-125036eb2c16-istio-token\") pod \"18bb667b-61b6-474b-b76f-125036eb2c16\" (UID: \"18bb667b-61b6-474b-b76f-125036eb2c16\") "
Jul 06 15:04:13.411845 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:13.411757    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18bb667b-61b6-474b-b76f-125036eb2c16-istio-envoy\") pod \"18bb667b-61b6-474b-b76f-125036eb2c16\" (UID: \"18bb667b-61b6-474b-b76f-125036eb2c16\") "
Jul 06 15:04:13.411845 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:13.411817    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18bb667b-61b6-474b-b76f-125036eb2c16-workload-socket\") pod \"18bb667b-61b6-474b-b76f-125036eb2c16\" (UID: \"18bb667b-61b6-474b-b76f-125036eb2c16\") "
Jul 06 15:04:13.412068 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:13.411849    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gh66r\" (UniqueName: \"kubernetes.io/projected/18bb667b-61b6-474b-b76f-125036eb2c16-kube-api-access-gh66r\") pod \"18bb667b-61b6-474b-b76f-125036eb2c16\" (UID: \"18bb667b-61b6-474b-b76f-125036eb2c16\") "
Jul 06 15:04:13.412068 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:13.411915    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18bb667b-61b6-474b-b76f-125036eb2c16-workload-certs\") pod \"18bb667b-61b6-474b-b76f-125036eb2c16\" (UID: \"18bb667b-61b6-474b-b76f-125036eb2c16\") "
Jul 06 15:04:13.412068 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:13.411961    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18bb667b-61b6-474b-b76f-125036eb2c16-credential-socket\") pod \"18bb667b-61b6-474b-b76f-125036eb2c16\" (UID: \"18bb667b-61b6-474b-b76f-125036eb2c16\") "
Jul 06 15:04:13.412227 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:13.412190    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18bb667b-61b6-474b-b76f-125036eb2c16-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "18bb667b-61b6-474b-b76f-125036eb2c16" (UID: "18bb667b-61b6-474b-b76f-125036eb2c16"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:04:13.412227 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:13.412211    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18bb667b-61b6-474b-b76f-125036eb2c16-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "18bb667b-61b6-474b-b76f-125036eb2c16" (UID: "18bb667b-61b6-474b-b76f-125036eb2c16"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:04:13.412379 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:13.412251    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18bb667b-61b6-474b-b76f-125036eb2c16-istiod-ca-cert\") pod \"18bb667b-61b6-474b-b76f-125036eb2c16\" (UID: \"18bb667b-61b6-474b-b76f-125036eb2c16\") "
Jul 06 15:04:13.412467 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:13.412443    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18bb667b-61b6-474b-b76f-125036eb2c16-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "18bb667b-61b6-474b-b76f-125036eb2c16" (UID: "18bb667b-61b6-474b-b76f-125036eb2c16"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:04:13.412640 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:13.412601    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18bb667b-61b6-474b-b76f-125036eb2c16-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "18bb667b-61b6-474b-b76f-125036eb2c16" (UID: "18bb667b-61b6-474b-b76f-125036eb2c16"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 15:04:13.412776 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:13.412713    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18bb667b-61b6-474b-b76f-125036eb2c16-istio-data" (OuterVolumeSpecName: "istio-data") pod "18bb667b-61b6-474b-b76f-125036eb2c16" (UID: "18bb667b-61b6-474b-b76f-125036eb2c16"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:04:13.413034 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:13.413016    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18bb667b-61b6-474b-b76f-125036eb2c16-workload-certs\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 15:04:13.413103 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:13.413039    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18bb667b-61b6-474b-b76f-125036eb2c16-credential-socket\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 15:04:13.413103 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:13.413053    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18bb667b-61b6-474b-b76f-125036eb2c16-istiod-ca-cert\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 15:04:13.413103 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:13.413066    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18bb667b-61b6-474b-b76f-125036eb2c16-istio-data\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 15:04:13.413103 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:13.413078    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18bb667b-61b6-474b-b76f-125036eb2c16-workload-socket\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 15:04:13.414120 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:13.414086    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18bb667b-61b6-474b-b76f-125036eb2c16-kube-api-access-gh66r" (OuterVolumeSpecName: "kube-api-access-gh66r") pod "18bb667b-61b6-474b-b76f-125036eb2c16" (UID: "18bb667b-61b6-474b-b76f-125036eb2c16"). InnerVolumeSpecName "kube-api-access-gh66r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 15:04:13.414224 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:13.414118    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18bb667b-61b6-474b-b76f-125036eb2c16-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "18bb667b-61b6-474b-b76f-125036eb2c16" (UID: "18bb667b-61b6-474b-b76f-125036eb2c16"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:04:13.414374 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:13.414354    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/18bb667b-61b6-474b-b76f-125036eb2c16-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "18bb667b-61b6-474b-b76f-125036eb2c16" (UID: "18bb667b-61b6-474b-b76f-125036eb2c16"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 15:04:13.414424 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:13.414410    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18bb667b-61b6-474b-b76f-125036eb2c16-istio-token" (OuterVolumeSpecName: "istio-token") pod "18bb667b-61b6-474b-b76f-125036eb2c16" (UID: "18bb667b-61b6-474b-b76f-125036eb2c16"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 15:04:13.497934 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:13.497898    2565 generic.go:356] "Generic (PLEG): container finished" podID="18bb667b-61b6-474b-b76f-125036eb2c16" containerID="a736f7ceafa0932f2e4c34ef72d289d6ce7bd7ad46bdf02d241d0884b3e4b6f1" exitCode=0
Jul 06 15:04:13.498139 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:13.497944    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w"
Jul 06 15:04:13.498139 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:13.497948    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w" event={"ID":"18bb667b-61b6-474b-b76f-125036eb2c16","Type":"ContainerDied","Data":"a736f7ceafa0932f2e4c34ef72d289d6ce7bd7ad46bdf02d241d0884b3e4b6f1"}
Jul 06 15:04:13.498139 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:13.498001    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w" event={"ID":"18bb667b-61b6-474b-b76f-125036eb2c16","Type":"ContainerDied","Data":"9063b9b341b89ad70a69e6e3585a78bfc8278c939cc19db9e45d83029b8eb6c4"}
Jul 06 15:04:13.498139 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:13.498029    2565 scope.go:117] "RemoveContainer" containerID="a736f7ceafa0932f2e4c34ef72d289d6ce7bd7ad46bdf02d241d0884b3e4b6f1"
Jul 06 15:04:13.507150 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:13.507116    2565 scope.go:117] "RemoveContainer" containerID="3f09150441185f5bde4530a80df0eb69761ad9e57410f5f52b78c37d45f090fb"
Jul 06 15:04:13.514137 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:13.514114    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gh66r\" (UniqueName: \"kubernetes.io/projected/18bb667b-61b6-474b-b76f-125036eb2c16-kube-api-access-gh66r\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 15:04:13.514231 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:13.514141    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18bb667b-61b6-474b-b76f-125036eb2c16-istio-podinfo\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 15:04:13.514231 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:13.514157    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18bb667b-61b6-474b-b76f-125036eb2c16-istio-token\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 15:04:13.514231 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:13.514169    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18bb667b-61b6-474b-b76f-125036eb2c16-istio-envoy\") on node \"ip-10-0-138-90.ec2.internal\" DevicePath \"\""
Jul 06 15:04:13.515355 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:13.515317    2565 scope.go:117] "RemoveContainer" containerID="a736f7ceafa0932f2e4c34ef72d289d6ce7bd7ad46bdf02d241d0884b3e4b6f1"
Jul 06 15:04:13.515613 ip-10-0-138-90 kubenswrapper[2565]: E0706 15:04:13.515594    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a736f7ceafa0932f2e4c34ef72d289d6ce7bd7ad46bdf02d241d0884b3e4b6f1\": container with ID starting with a736f7ceafa0932f2e4c34ef72d289d6ce7bd7ad46bdf02d241d0884b3e4b6f1 not found: ID does not exist" containerID="a736f7ceafa0932f2e4c34ef72d289d6ce7bd7ad46bdf02d241d0884b3e4b6f1"
Jul 06 15:04:13.515658 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:13.515623    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a736f7ceafa0932f2e4c34ef72d289d6ce7bd7ad46bdf02d241d0884b3e4b6f1"} err="failed to get container status \"a736f7ceafa0932f2e4c34ef72d289d6ce7bd7ad46bdf02d241d0884b3e4b6f1\": rpc error: code = NotFound desc = could not find container \"a736f7ceafa0932f2e4c34ef72d289d6ce7bd7ad46bdf02d241d0884b3e4b6f1\": container with ID starting with a736f7ceafa0932f2e4c34ef72d289d6ce7bd7ad46bdf02d241d0884b3e4b6f1 not found: ID does not exist"
Jul 06 15:04:13.515658 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:13.515641    2565 scope.go:117] "RemoveContainer" containerID="3f09150441185f5bde4530a80df0eb69761ad9e57410f5f52b78c37d45f090fb"
Jul 06 15:04:13.515897 ip-10-0-138-90 kubenswrapper[2565]: E0706 15:04:13.515879    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f09150441185f5bde4530a80df0eb69761ad9e57410f5f52b78c37d45f090fb\": container with ID starting with 3f09150441185f5bde4530a80df0eb69761ad9e57410f5f52b78c37d45f090fb not found: ID does not exist" containerID="3f09150441185f5bde4530a80df0eb69761ad9e57410f5f52b78c37d45f090fb"
Jul 06 15:04:13.515951 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:13.515901    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f09150441185f5bde4530a80df0eb69761ad9e57410f5f52b78c37d45f090fb"} err="failed to get container status \"3f09150441185f5bde4530a80df0eb69761ad9e57410f5f52b78c37d45f090fb\": rpc error: code = NotFound desc = could not find container \"3f09150441185f5bde4530a80df0eb69761ad9e57410f5f52b78c37d45f090fb\": container with ID starting with 3f09150441185f5bde4530a80df0eb69761ad9e57410f5f52b78c37d45f090fb not found: ID does not exist"
Jul 06 15:04:13.519430 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:13.519409    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w"]
Jul 06 15:04:13.523065 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:13.523048    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-58d9da-openshift-default-678dd4fc59-5kg8w"]
Jul 06 15:04:13.954654 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:13.954623    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18bb667b-61b6-474b-b76f-125036eb2c16" path="/var/lib/kubelet/pods/18bb667b-61b6-474b-b76f-125036eb2c16/volumes"
Jul 06 15:04:20.825206 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:20.825170    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-gd6t8_454203ee-b935-4ce1-9d37-1a23fb2e09c7/manager/0.log"
Jul 06 15:04:21.950398 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:21.950373    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-557ddcc9b5-whk5m_a774d71b-e43c-4680-a5ba-3bd61ec58ed5/copy-manifests/0.log"
Jul 06 15:04:21.958372 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:21.958331    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-557ddcc9b5-whk5m_a774d71b-e43c-4680-a5ba-3bd61ec58ed5/manager/0.log"
Jul 06 15:04:23.452916 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:23.452846    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-xg6r7_2202a142-8ef8-4fbf-b9dd-1f35fb237b32/manager/0.log"
Jul 06 15:04:23.562968 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:23.562940    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-mr2n7_3d290cb8-d34c-4089-bd40-b4fec2830544/manager/0.log"
Jul 06 15:04:23.779379 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:23.779287    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-x84ml_f619aa20-51b7-4f7e-a26d-993b9dcff70f/registry-server/0.log"
Jul 06 15:04:23.894150 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:23.894121    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-wqmf2_10465b0f-f261-44a5-8579-bc4924a27fcf/manager/0.log"
Jul 06 15:04:24.118518 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:24.118447    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-b8rnd_3cee5e9e-063a-4902-bf6b-c2ee206c0b78/manager/0.log"
Jul 06 15:04:24.460958 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:24.460926    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf456sjm_dad63f33-db42-439e-b9ac-4fa5b9eef818/istio-proxy/0.log"
Jul 06 15:04:25.731554 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:25.731520    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-lgnq7_6a5b2b75-685e-4c29-8925-3624272551e3/main/0.log"
Jul 06 15:04:26.192556 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:26.192526    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-cfnb4_d8eee5ff-710f-4165-a183-95b73a0f03d1/main/0.log"
Jul 06 15:04:34.813833 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:34.813805    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bgtbf_a6c6da04-8e16-45a3-b8bc-e6dfa6ede872/global-pull-secret-syncer/0.log"
Jul 06 15:04:34.991217 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:34.991184    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-p8t94_b717a842-24ed-4b29-ace1-7a1e9cde682d/konnectivity-agent/0.log"
Jul 06 15:04:35.040330 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:35.040301    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-90.ec2.internal_d0f234e3101ecdfbdf1e54df6d4f5e57/haproxy/0.log"
Jul 06 15:04:39.973546 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:39.973512    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-xg6r7_2202a142-8ef8-4fbf-b9dd-1f35fb237b32/manager/0.log"
Jul 06 15:04:40.017558 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:40.017531    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-mr2n7_3d290cb8-d34c-4089-bd40-b4fec2830544/manager/0.log"
Jul 06 15:04:40.086651 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:40.086625    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-x84ml_f619aa20-51b7-4f7e-a26d-993b9dcff70f/registry-server/0.log"
Jul 06 15:04:40.177489 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:40.177461    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-wqmf2_10465b0f-f261-44a5-8579-bc4924a27fcf/manager/0.log"
Jul 06 15:04:40.285197 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:40.285160    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-b8rnd_3cee5e9e-063a-4902-bf6b-c2ee206c0b78/manager/0.log"
Jul 06 15:04:42.089153 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:42.089131    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c70001e2-0301-4442-a512-157dbc801d78/alertmanager/0.log"
Jul 06 15:04:42.119433 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:42.119407    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c70001e2-0301-4442-a512-157dbc801d78/config-reloader/0.log"
Jul 06 15:04:42.147500 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:42.147477    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c70001e2-0301-4442-a512-157dbc801d78/kube-rbac-proxy-web/0.log"
Jul 06 15:04:42.174584 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:42.174563    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c70001e2-0301-4442-a512-157dbc801d78/kube-rbac-proxy/0.log"
Jul 06 15:04:42.197035 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:42.197016    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c70001e2-0301-4442-a512-157dbc801d78/kube-rbac-proxy-metric/0.log"
Jul 06 15:04:42.223006 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:42.222984    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c70001e2-0301-4442-a512-157dbc801d78/prom-label-proxy/0.log"
Jul 06 15:04:42.247503 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:42.247481    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c70001e2-0301-4442-a512-157dbc801d78/init-config-reloader/0.log"
Jul 06 15:04:42.325959 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:42.325882    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-dsmqp_493ba4e0-525e-469c-8734-6f95bed71371/kube-state-metrics/0.log"
Jul 06 15:04:42.345579 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:42.345550    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-dsmqp_493ba4e0-525e-469c-8734-6f95bed71371/kube-rbac-proxy-main/0.log"
Jul 06 15:04:42.368812 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:42.368787    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-dsmqp_493ba4e0-525e-469c-8734-6f95bed71371/kube-rbac-proxy-self/0.log"
Jul 06 15:04:42.400136 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:42.400112    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6d9f795f4-4xmd4_af9ca10d-2cae-467d-b45d-f605eeadbfda/metrics-server/0.log"
Jul 06 15:04:42.430494 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:42.430472    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-nqv2w_77876daa-2753-4e1a-884c-6eaa8f8ba59e/monitoring-plugin/0.log"
Jul 06 15:04:42.587056 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:42.586974    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gsgv7_c9f1193d-c182-4701-a021-4bc4f2d8b344/node-exporter/0.log"
Jul 06 15:04:42.613742 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:42.613719    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gsgv7_c9f1193d-c182-4701-a021-4bc4f2d8b344/kube-rbac-proxy/0.log"
Jul 06 15:04:42.647069 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:42.647046    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gsgv7_c9f1193d-c182-4701-a021-4bc4f2d8b344/init-textfile/0.log"
Jul 06 15:04:42.799230 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:42.799199    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-tfwrt_680e4718-1d23-4146-b8b2-bf8970690dfd/kube-rbac-proxy-main/0.log"
Jul 06 15:04:42.822874 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:42.822847    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-tfwrt_680e4718-1d23-4146-b8b2-bf8970690dfd/kube-rbac-proxy-self/0.log"
Jul 06 15:04:42.868389 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:42.868304    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-tfwrt_680e4718-1d23-4146-b8b2-bf8970690dfd/openshift-state-metrics/0.log"
Jul 06 15:04:42.928327 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:42.928298    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1dfd4274-1208-423f-a366-46495dab9e02/prometheus/0.log"
Jul 06 15:04:42.970044 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:42.970021    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1dfd4274-1208-423f-a366-46495dab9e02/config-reloader/0.log"
Jul 06 15:04:42.999350 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:42.999324    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1dfd4274-1208-423f-a366-46495dab9e02/thanos-sidecar/0.log"
Jul 06 15:04:43.031503 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:43.031475    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1dfd4274-1208-423f-a366-46495dab9e02/kube-rbac-proxy-web/0.log"
Jul 06 15:04:43.058317 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:43.058289    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1dfd4274-1208-423f-a366-46495dab9e02/kube-rbac-proxy/0.log"
Jul 06 15:04:43.084911 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:43.084887    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1dfd4274-1208-423f-a366-46495dab9e02/kube-rbac-proxy-thanos/0.log"
Jul 06 15:04:43.111928 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:43.111904    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1dfd4274-1208-423f-a366-46495dab9e02/init-config-reloader/0.log"
Jul 06 15:04:43.168327 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:43.168301    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-j9899_f73cfe28-7220-4535-8486-d9d6a363d23e/prometheus-operator/0.log"
Jul 06 15:04:43.201813 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:43.201790    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-j9899_f73cfe28-7220-4535-8486-d9d6a363d23e/kube-rbac-proxy/0.log"
Jul 06 15:04:43.231933 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:43.231912    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-ct2gw_f4bce6b1-da2c-4584-89c5-072da3205aee/prometheus-operator-admission-webhook/0.log"
Jul 06 15:04:43.271345 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:43.271323    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-56674667cd-4rr65_a92c4838-38b6-4666-a40b-f7ac40aa1d0a/telemeter-client/0.log"
Jul 06 15:04:43.297348 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:43.297323    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-56674667cd-4rr65_a92c4838-38b6-4666-a40b-f7ac40aa1d0a/reload/0.log"
Jul 06 15:04:43.329680 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:43.329654    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-56674667cd-4rr65_a92c4838-38b6-4666-a40b-f7ac40aa1d0a/kube-rbac-proxy/0.log"
Jul 06 15:04:43.366985 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:43.366958    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64f8bfddbc-gvc4g_c986fb5f-f4bc-4c56-a960-823736801496/thanos-query/0.log"
Jul 06 15:04:43.400755 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:43.400732    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64f8bfddbc-gvc4g_c986fb5f-f4bc-4c56-a960-823736801496/kube-rbac-proxy-web/0.log"
Jul 06 15:04:43.439691 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:43.439564    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64f8bfddbc-gvc4g_c986fb5f-f4bc-4c56-a960-823736801496/kube-rbac-proxy/0.log"
Jul 06 15:04:43.478465 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:43.478439    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64f8bfddbc-gvc4g_c986fb5f-f4bc-4c56-a960-823736801496/prom-label-proxy/0.log"
Jul 06 15:04:43.509695 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:43.509671    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64f8bfddbc-gvc4g_c986fb5f-f4bc-4c56-a960-823736801496/kube-rbac-proxy-rules/0.log"
Jul 06 15:04:43.539376 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:43.539333    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64f8bfddbc-gvc4g_c986fb5f-f4bc-4c56-a960-823736801496/kube-rbac-proxy-metrics/0.log"
Jul 06 15:04:44.647059 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:44.647026    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gbbmr/perf-node-gather-daemonset-kzszl"]
Jul 06 15:04:44.647642 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:44.647622    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18bb667b-61b6-474b-b76f-125036eb2c16" containerName="istio-proxy"
Jul 06 15:04:44.647733 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:44.647644    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="18bb667b-61b6-474b-b76f-125036eb2c16" containerName="istio-proxy"
Jul 06 15:04:44.647733 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:44.647667    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18bb667b-61b6-474b-b76f-125036eb2c16" containerName="istio-proxy"
Jul 06 15:04:44.647733 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:44.647675    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="18bb667b-61b6-474b-b76f-125036eb2c16" containerName="istio-proxy"
Jul 06 15:04:44.647733 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:44.647704    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a77c1747-e947-452b-8d15-cded9aee25ad" containerName="main"
Jul 06 15:04:44.647733 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:44.647713    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a77c1747-e947-452b-8d15-cded9aee25ad" containerName="main"
Jul 06 15:04:44.647969 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:44.647824    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="18bb667b-61b6-474b-b76f-125036eb2c16" containerName="istio-proxy"
Jul 06 15:04:44.647969 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:44.647840    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="18bb667b-61b6-474b-b76f-125036eb2c16" containerName="istio-proxy"
Jul 06 15:04:44.647969 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:44.647849    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a77c1747-e947-452b-8d15-cded9aee25ad" containerName="main"
Jul 06 15:04:44.650861 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:44.650839    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gbbmr/perf-node-gather-daemonset-kzszl"
Jul 06 15:04:44.652904 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:44.652879    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gbbmr\"/\"default-dockercfg-5wsdq\""
Jul 06 15:04:44.653034 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:44.652937    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gbbmr\"/\"kube-root-ca.crt\""
Jul 06 15:04:44.653034 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:44.652962    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gbbmr\"/\"openshift-service-ca.crt\""
Jul 06 15:04:44.661533 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:44.661512    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gbbmr/perf-node-gather-daemonset-kzszl"]
Jul 06 15:04:44.807220 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:44.807178    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/aa24fb68-fe4f-4d03-85d8-b58e50dcd96c-proc\") pod \"perf-node-gather-daemonset-kzszl\" (UID: \"aa24fb68-fe4f-4d03-85d8-b58e50dcd96c\") " pod="openshift-must-gather-gbbmr/perf-node-gather-daemonset-kzszl"
Jul 06 15:04:44.807418 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:44.807238    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aa24fb68-fe4f-4d03-85d8-b58e50dcd96c-lib-modules\") pod \"perf-node-gather-daemonset-kzszl\" (UID: \"aa24fb68-fe4f-4d03-85d8-b58e50dcd96c\") " pod="openshift-must-gather-gbbmr/perf-node-gather-daemonset-kzszl"
Jul 06 15:04:44.807418 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:44.807260    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/aa24fb68-fe4f-4d03-85d8-b58e50dcd96c-podres\") pod \"perf-node-gather-daemonset-kzszl\" (UID: \"aa24fb68-fe4f-4d03-85d8-b58e50dcd96c\") " pod="openshift-must-gather-gbbmr/perf-node-gather-daemonset-kzszl"
Jul 06 15:04:44.807418 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:44.807277    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aa24fb68-fe4f-4d03-85d8-b58e50dcd96c-sys\") pod \"perf-node-gather-daemonset-kzszl\" (UID: \"aa24fb68-fe4f-4d03-85d8-b58e50dcd96c\") " pod="openshift-must-gather-gbbmr/perf-node-gather-daemonset-kzszl"
Jul 06 15:04:44.807418 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:44.807316    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfncx\" (UniqueName: \"kubernetes.io/projected/aa24fb68-fe4f-4d03-85d8-b58e50dcd96c-kube-api-access-tfncx\") pod \"perf-node-gather-daemonset-kzszl\" (UID: \"aa24fb68-fe4f-4d03-85d8-b58e50dcd96c\") " pod="openshift-must-gather-gbbmr/perf-node-gather-daemonset-kzszl"
Jul 06 15:04:44.908553 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:44.908463    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/aa24fb68-fe4f-4d03-85d8-b58e50dcd96c-proc\") pod \"perf-node-gather-daemonset-kzszl\" (UID: \"aa24fb68-fe4f-4d03-85d8-b58e50dcd96c\") " pod="openshift-must-gather-gbbmr/perf-node-gather-daemonset-kzszl"
Jul 06 15:04:44.908704 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:44.908552    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aa24fb68-fe4f-4d03-85d8-b58e50dcd96c-lib-modules\") pod \"perf-node-gather-daemonset-kzszl\" (UID: \"aa24fb68-fe4f-4d03-85d8-b58e50dcd96c\") " pod="openshift-must-gather-gbbmr/perf-node-gather-daemonset-kzszl"
Jul 06 15:04:44.908704 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:44.908592    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/aa24fb68-fe4f-4d03-85d8-b58e50dcd96c-podres\") pod \"perf-node-gather-daemonset-kzszl\" (UID: \"aa24fb68-fe4f-4d03-85d8-b58e50dcd96c\") " pod="openshift-must-gather-gbbmr/perf-node-gather-daemonset-kzszl"
Jul 06 15:04:44.908704 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:44.908632    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aa24fb68-fe4f-4d03-85d8-b58e50dcd96c-sys\") pod \"perf-node-gather-daemonset-kzszl\" (UID: \"aa24fb68-fe4f-4d03-85d8-b58e50dcd96c\") " pod="openshift-must-gather-gbbmr/perf-node-gather-daemonset-kzszl"
Jul 06 15:04:44.908704 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:44.908559    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/aa24fb68-fe4f-4d03-85d8-b58e50dcd96c-proc\") pod \"perf-node-gather-daemonset-kzszl\" (UID: \"aa24fb68-fe4f-4d03-85d8-b58e50dcd96c\") " pod="openshift-must-gather-gbbmr/perf-node-gather-daemonset-kzszl"
Jul 06 15:04:44.908704 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:44.908646    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aa24fb68-fe4f-4d03-85d8-b58e50dcd96c-lib-modules\") pod \"perf-node-gather-daemonset-kzszl\" (UID: \"aa24fb68-fe4f-4d03-85d8-b58e50dcd96c\") " pod="openshift-must-gather-gbbmr/perf-node-gather-daemonset-kzszl"
Jul 06 15:04:44.908873 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:44.908706    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfncx\" (UniqueName: \"kubernetes.io/projected/aa24fb68-fe4f-4d03-85d8-b58e50dcd96c-kube-api-access-tfncx\") pod \"perf-node-gather-daemonset-kzszl\" (UID: \"aa24fb68-fe4f-4d03-85d8-b58e50dcd96c\") " pod="openshift-must-gather-gbbmr/perf-node-gather-daemonset-kzszl"
Jul 06 15:04:44.908873 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:44.908714    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aa24fb68-fe4f-4d03-85d8-b58e50dcd96c-sys\") pod \"perf-node-gather-daemonset-kzszl\" (UID: \"aa24fb68-fe4f-4d03-85d8-b58e50dcd96c\") " pod="openshift-must-gather-gbbmr/perf-node-gather-daemonset-kzszl"
Jul 06 15:04:44.908873 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:44.908740    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/aa24fb68-fe4f-4d03-85d8-b58e50dcd96c-podres\") pod \"perf-node-gather-daemonset-kzszl\" (UID: \"aa24fb68-fe4f-4d03-85d8-b58e50dcd96c\") " pod="openshift-must-gather-gbbmr/perf-node-gather-daemonset-kzszl"
Jul 06 15:04:44.921175 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:44.921141    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfncx\" (UniqueName: \"kubernetes.io/projected/aa24fb68-fe4f-4d03-85d8-b58e50dcd96c-kube-api-access-tfncx\") pod \"perf-node-gather-daemonset-kzszl\" (UID: \"aa24fb68-fe4f-4d03-85d8-b58e50dcd96c\") " pod="openshift-must-gather-gbbmr/perf-node-gather-daemonset-kzszl"
Jul 06 15:04:44.961568 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:44.961533    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gbbmr/perf-node-gather-daemonset-kzszl"
Jul 06 15:04:45.093854 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:45.093832    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gbbmr/perf-node-gather-daemonset-kzszl"]
Jul 06 15:04:45.095768 ip-10-0-138-90 kubenswrapper[2565]: W0706 15:04:45.095739    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podaa24fb68_fe4f_4d03_85d8_b58e50dcd96c.slice/crio-6b7aed44b51d3f3a72ce65c98daa822c4d42655d30b6a56577065fdb3edd34b7 WatchSource:0}: Error finding container 6b7aed44b51d3f3a72ce65c98daa822c4d42655d30b6a56577065fdb3edd34b7: Status 404 returned error can't find the container with id 6b7aed44b51d3f3a72ce65c98daa822c4d42655d30b6a56577065fdb3edd34b7
Jul 06 15:04:45.656565 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:45.656526    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gbbmr/perf-node-gather-daemonset-kzszl" event={"ID":"aa24fb68-fe4f-4d03-85d8-b58e50dcd96c","Type":"ContainerStarted","Data":"e77769ecaa95d882d8e0dec2f5fb09639bf0e7cd1beceb424e9cf651747e9bed"}
Jul 06 15:04:45.657029 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:45.656605    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gbbmr/perf-node-gather-daemonset-kzszl" event={"ID":"aa24fb68-fe4f-4d03-85d8-b58e50dcd96c","Type":"ContainerStarted","Data":"6b7aed44b51d3f3a72ce65c98daa822c4d42655d30b6a56577065fdb3edd34b7"}
Jul 06 15:04:45.657029 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:45.656643    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gbbmr/perf-node-gather-daemonset-kzszl"
Jul 06 15:04:45.673454 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:45.673249    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gbbmr/perf-node-gather-daemonset-kzszl" podStartSLOduration=1.67322942 podStartE2EDuration="1.67322942s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:04:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:04:45.672699342 +0000 UTC m=+2488.851348412" watchObservedRunningTime="2026-07-06 15:04:45.67322942 +0000 UTC m=+2488.851878468"
Jul 06 15:04:45.902499 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:45.902472    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5d8cff6dbf-6j7t6_7c046ceb-9a6a-4857-88ee-8cbca22fa1a6/console/0.log"
Jul 06 15:04:47.648015 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:47.647981    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-n95sc_1ea88141-d7f6-4ab0-9541-ff9471ac3c5e/dns/0.log"
Jul 06 15:04:47.674121 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:47.674093    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-n95sc_1ea88141-d7f6-4ab0-9541-ff9471ac3c5e/kube-rbac-proxy/0.log"
Jul 06 15:04:47.699091 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:47.699062    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-487gs_ab8aa9ec-dfe2-450f-ad33-41ac93232eb5/dns-node-resolver/0.log"
Jul 06 15:04:48.341333 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:48.341305    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bqxgr_d3b974e0-a207-4976-8b28-07d878302459/node-ca/0.log"
Jul 06 15:04:49.310055 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:49.310014    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf456sjm_dad63f33-db42-439e-b9ac-4fa5b9eef818/istio-proxy/0.log"
Jul 06 15:04:50.367509 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:50.367471    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lg447_56bf0c61-4788-4eef-bc06-c4be35b8d420/serve-healthcheck-canary/0.log"
Jul 06 15:04:50.920129 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:50.920101    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-csd7r_a8bbde3e-29b5-4dc5-8543-d255cd3779fe/kube-rbac-proxy/0.log"
Jul 06 15:04:50.945123 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:50.945098    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-csd7r_a8bbde3e-29b5-4dc5-8543-d255cd3779fe/exporter/0.log"
Jul 06 15:04:50.973477 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:50.973450    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-csd7r_a8bbde3e-29b5-4dc5-8543-d255cd3779fe/extractor/0.log"
Jul 06 15:04:51.672103 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:51.672077    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gbbmr/perf-node-gather-daemonset-kzszl"
Jul 06 15:04:53.882702 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:53.882631    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-gd6t8_454203ee-b935-4ce1-9d37-1a23fb2e09c7/manager/0.log"
Jul 06 15:04:54.386238 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:54.386214    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-557ddcc9b5-whk5m_a774d71b-e43c-4680-a5ba-3bd61ec58ed5/manager/0.log"
Jul 06 15:04:54.410435 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:54.410413    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-557ddcc9b5-whk5m_a774d71b-e43c-4680-a5ba-3bd61ec58ed5/copy-manifests/0.log"
Jul 06 15:04:55.192964 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:55.192926    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf456sjm_dad63f33-db42-439e-b9ac-4fa5b9eef818/istio-proxy/0.log"
Jul 06 15:04:55.829682 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:55.829656    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-66c4cbf4f4-klj5b_e06ea3ab-bbe9-4f80-a127-5b58f5350556/manager/0.log"
Jul 06 15:04:55.854499 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:55.854473    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-d5nxp_edf0456f-d17c-4a39-a1ef-469fd0e301b4/openshift-lws-operator/0.log"
Jul 06 15:04:56.708902 ip-10-0-138-90 kubenswrapper[2565]: I0706 15:04:56.708872    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf456sjm_dad63f33-db42-439e-b9ac-4fa5b9eef818/istio-proxy/0.log"