Jul 20 12:44:47.119379 ip-10-0-139-1 systemd[1]: Starting Kubernetes Kubelet...
Jul 20 12:44:47.553674 ip-10-0-139-1 kubenswrapper[2570]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 12:44:47.553674 ip-10-0-139-1 kubenswrapper[2570]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 20 12:44:47.553674 ip-10-0-139-1 kubenswrapper[2570]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 12:44:47.553674 ip-10-0-139-1 kubenswrapper[2570]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 20 12:44:47.553674 ip-10-0-139-1 kubenswrapper[2570]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 12:44:47.553674 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.530330    2570 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 20 12:44:47.553674 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537541    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 12:44:47.553674 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537557    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 12:44:47.553674 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537562    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 12:44:47.553674 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537566    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 12:44:47.553674 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537571    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 12:44:47.553674 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537575    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 12:44:47.553674 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537579    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 12:44:47.553674 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537583    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 12:44:47.554740 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537587    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 12:44:47.554740 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537591    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 12:44:47.554740 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537594    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 12:44:47.554740 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537598    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 12:44:47.554740 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537601    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 12:44:47.554740 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537607    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 12:44:47.554740 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537613    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 12:44:47.554740 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537617    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 12:44:47.554740 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537626    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 12:44:47.554740 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537630    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 12:44:47.554740 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537634    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 12:44:47.554740 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537638    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 12:44:47.554740 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537642    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 12:44:47.554740 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537646    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 12:44:47.554740 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537649    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 12:44:47.554740 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537653    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 12:44:47.554740 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537657    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 12:44:47.554740 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537660    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 12:44:47.554740 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537664    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 12:44:47.554740 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537670    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 12:44:47.555365 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537673    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 12:44:47.555365 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537677    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 12:44:47.555365 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537680    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 12:44:47.555365 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537684    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 12:44:47.555365 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537688    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 12:44:47.555365 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537692    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 12:44:47.555365 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537695    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 12:44:47.555365 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537699    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 12:44:47.555365 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537703    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 12:44:47.555365 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537708    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 12:44:47.555365 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537714    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 12:44:47.555365 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537718    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 12:44:47.555365 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537722    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 12:44:47.555365 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537726    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 12:44:47.555365 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537729    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 12:44:47.555365 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537733    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 12:44:47.555365 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537737    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 12:44:47.555365 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537740    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 12:44:47.555365 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537745    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 12:44:47.555988 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537750    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 12:44:47.555988 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537756    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 12:44:47.555988 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537760    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 12:44:47.555988 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537764    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 12:44:47.555988 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537768    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 12:44:47.555988 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537772    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 12:44:47.555988 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537775    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 12:44:47.555988 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537779    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 12:44:47.555988 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537783    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 12:44:47.555988 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537786    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 12:44:47.555988 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537790    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 12:44:47.555988 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537794    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 12:44:47.555988 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537798    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 12:44:47.555988 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537802    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 12:44:47.555988 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537805    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 12:44:47.555988 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537810    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 12:44:47.555988 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537814    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 12:44:47.555988 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537818    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 12:44:47.555988 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537822    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 12:44:47.555988 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537825    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 12:44:47.556602 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537830    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 12:44:47.556602 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537834    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 12:44:47.556602 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537838    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 12:44:47.556602 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537842    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 12:44:47.556602 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537848    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 12:44:47.556602 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537852    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 12:44:47.556602 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537856    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 12:44:47.556602 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537859    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 12:44:47.556602 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537863    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 12:44:47.556602 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537867    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 12:44:47.556602 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537871    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 12:44:47.556602 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537875    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 12:44:47.556602 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537878    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 12:44:47.556602 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537882    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 12:44:47.556602 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537886    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 12:44:47.556602 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537890    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 12:44:47.556602 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537893    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 12:44:47.556602 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537897    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 12:44:47.556602 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537900    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 12:44:47.557177 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537904    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 12:44:47.557177 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537907    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 12:44:47.557177 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537911    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 12:44:47.557177 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537915    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 12:44:47.557177 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537919    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 12:44:47.557177 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537923    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 12:44:47.557177 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537927    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 12:44:47.557177 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537931    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 12:44:47.557177 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537935    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 12:44:47.557177 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537939    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 12:44:47.557177 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537943    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 12:44:47.557177 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537947    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 12:44:47.557177 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.537950    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 12:44:47.557177 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539000    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 12:44:47.557177 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539008    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 12:44:47.557177 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539013    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 12:44:47.557177 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539017    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 12:44:47.557177 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539021    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 12:44:47.557177 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539026    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 12:44:47.557177 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539030    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 12:44:47.557687 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539034    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 12:44:47.557687 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539038    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 12:44:47.557687 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539042    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 12:44:47.557687 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539046    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 12:44:47.557687 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539050    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 12:44:47.557687 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539054    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 12:44:47.557687 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539057    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 12:44:47.557687 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539061    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 12:44:47.557687 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539065    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 12:44:47.557687 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539068    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 12:44:47.557687 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539072    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 12:44:47.557687 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539076    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 12:44:47.557687 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539079    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 12:44:47.557687 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539099    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 12:44:47.557687 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539103    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 12:44:47.557687 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539109    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 12:44:47.557687 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539114    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 12:44:47.557687 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539118    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 12:44:47.557687 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539122    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 12:44:47.558310 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539126    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 12:44:47.558310 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539131    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 12:44:47.558310 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539135    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 12:44:47.558310 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539138    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 12:44:47.558310 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539142    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 12:44:47.558310 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539145    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 12:44:47.558310 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539149    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 12:44:47.558310 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539153    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 12:44:47.558310 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539157    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 12:44:47.558310 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539161    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 12:44:47.558310 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539164    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 12:44:47.558310 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539168    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 12:44:47.558310 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539172    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 12:44:47.558310 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539176    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 12:44:47.558310 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539180    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 12:44:47.558310 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539184    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 12:44:47.558310 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539189    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 12:44:47.558310 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539193    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 12:44:47.558310 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539197    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 12:44:47.558310 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539200    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 12:44:47.558841 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539204    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 12:44:47.558841 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539207    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 12:44:47.558841 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539211    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 12:44:47.558841 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539216    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 12:44:47.558841 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539219    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 12:44:47.558841 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539223    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 12:44:47.558841 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539227    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 12:44:47.558841 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539231    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 12:44:47.558841 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539234    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 12:44:47.558841 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539240    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 12:44:47.558841 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539244    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 12:44:47.558841 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539247    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 12:44:47.558841 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539251    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 12:44:47.558841 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539255    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 12:44:47.558841 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539258    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 12:44:47.558841 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539261    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 12:44:47.558841 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539265    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 12:44:47.558841 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539268    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 12:44:47.558841 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539273    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 12:44:47.559641 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539277    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 12:44:47.559641 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539280    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 12:44:47.559641 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539285    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 12:44:47.559641 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539288    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 12:44:47.559641 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539292    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 12:44:47.559641 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539296    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 12:44:47.559641 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539301    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 12:44:47.559641 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539304    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 12:44:47.559641 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539308    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 12:44:47.559641 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539313    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 12:44:47.559641 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539316    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 12:44:47.559641 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539320    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 12:44:47.559641 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539323    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 12:44:47.559641 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539327    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 12:44:47.559641 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539330    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 12:44:47.559641 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539335    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 12:44:47.559641 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539339    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 12:44:47.559641 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539342    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 12:44:47.559641 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539346    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 12:44:47.559641 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539350    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 12:44:47.560532 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539354    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 12:44:47.560532 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539357    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 12:44:47.560532 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539361    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 12:44:47.560532 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539365    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 12:44:47.560532 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539369    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 12:44:47.560532 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539375    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 12:44:47.560532 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539380    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 12:44:47.560532 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539384    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 12:44:47.560532 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539388    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 12:44:47.560532 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539404    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 12:44:47.560532 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539410    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 12:44:47.560532 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539415    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 12:44:47.560532 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539419    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 12:44:47.560532 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539423    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 12:44:47.560532 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539942    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 12:44:47.560532 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539948    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 12:44:47.560532 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539953    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 12:44:47.560532 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539957    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 12:44:47.560532 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539962    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 12:44:47.561167 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539966    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 12:44:47.561167 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539969    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 12:44:47.561167 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539973    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 12:44:47.561167 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539978    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 12:44:47.561167 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539983    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 12:44:47.561167 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539987    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 12:44:47.561167 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539990    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 12:44:47.561167 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539994    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 12:44:47.561167 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.539997    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 12:44:47.561167 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540001    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 12:44:47.561167 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540004    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 12:44:47.561167 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540008    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 12:44:47.561167 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540012    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 12:44:47.561167 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540016    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 12:44:47.561167 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540020    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 12:44:47.561167 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540024    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 12:44:47.561167 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540027    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 12:44:47.561167 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540032    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 12:44:47.561167 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540036    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 12:44:47.561750 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540040    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 12:44:47.561750 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540043    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 12:44:47.561750 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540048    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 12:44:47.561750 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540051    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 12:44:47.561750 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540055    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 12:44:47.561750 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540060    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 12:44:47.561750 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540063    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 12:44:47.561750 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540066    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 12:44:47.561750 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540070    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 12:44:47.561750 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540074    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 12:44:47.561750 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540078    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 12:44:47.561750 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540095    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 12:44:47.561750 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540099    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 12:44:47.561750 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540104    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 12:44:47.561750 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540109    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 12:44:47.561750 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540112    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 12:44:47.561750 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540116    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 12:44:47.561750 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540120    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 12:44:47.561750 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540124    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 12:44:47.561750 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540128    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 12:44:47.562503 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540135    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 12:44:47.562503 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540141    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 12:44:47.562503 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540145    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 12:44:47.562503 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540149    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 12:44:47.562503 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540153    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 12:44:47.562503 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540158    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 12:44:47.562503 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540161    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 12:44:47.562503 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540165    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 12:44:47.562503 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540169    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 12:44:47.562503 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540172    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 12:44:47.562503 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540176    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 12:44:47.562503 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540180    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 12:44:47.562503 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540183    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 12:44:47.562503 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540186    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 12:44:47.562503 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540190    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 12:44:47.562503 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540195    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 12:44:47.562503 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540198    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 12:44:47.562503 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540202    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 12:44:47.562503 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540206    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 12:44:47.563386 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540210    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 12:44:47.563386 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540213    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 12:44:47.563386 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540217    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 12:44:47.563386 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540221    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 12:44:47.563386 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540224    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 12:44:47.563386 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540228    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 12:44:47.563386 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540231    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 12:44:47.563386 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540236    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 12:44:47.563386 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540240    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 12:44:47.563386 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540244    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 12:44:47.563386 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540248    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 12:44:47.563386 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540251    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 12:44:47.563386 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540255    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 12:44:47.563386 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540258    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 12:44:47.563386 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540262    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 12:44:47.563386 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540265    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 12:44:47.563386 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540269    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 12:44:47.563386 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540274    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 12:44:47.563386 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540278    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 12:44:47.563386 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540281    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 12:44:47.563386 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540284    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 12:44:47.564050 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540288    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 12:44:47.564050 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540292    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 12:44:47.564050 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540296    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 12:44:47.564050 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540299    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 12:44:47.564050 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540302    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 12:44:47.564050 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540310    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 12:44:47.564050 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540315    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 12:44:47.564050 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540320    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 12:44:47.564050 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540324    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 12:44:47.564050 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540328    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 12:44:47.564050 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540332    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 12:44:47.564050 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540336    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 12:44:47.564050 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540340    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 12:44:47.564050 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540345    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 12:44:47.564050 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.540348    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 12:44:47.564050 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540446    2570 flags.go:64] FLAG: --address="0.0.0.0"
Jul 20 12:44:47.564050 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540456    2570 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 20 12:44:47.564050 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540464    2570 flags.go:64] FLAG: --anonymous-auth="true"
Jul 20 12:44:47.564050 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540471    2570 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 20 12:44:47.564050 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540480    2570 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 20 12:44:47.564050 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540485    2570 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 20 12:44:47.564698 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540491    2570 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 20 12:44:47.564698 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540498    2570 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 20 12:44:47.564698 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540503    2570 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 20 12:44:47.564698 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540508    2570 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 20 12:44:47.564698 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540512    2570 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 20 12:44:47.564698 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540517    2570 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 20 12:44:47.564698 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540521    2570 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 20 12:44:47.564698 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540527    2570 flags.go:64] FLAG: --cgroup-root=""
Jul 20 12:44:47.564698 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540531    2570 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 20 12:44:47.564698 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540535    2570 flags.go:64] FLAG: --client-ca-file=""
Jul 20 12:44:47.564698 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540540    2570 flags.go:64] FLAG: --cloud-provider="external"
Jul 20 12:44:47.564698 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540544    2570 flags.go:64] FLAG: --cluster-dns="[]"
Jul 20 12:44:47.564698 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540551    2570 flags.go:64] FLAG: --cluster-domain=""
Jul 20 12:44:47.564698 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540555    2570 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 20 12:44:47.564698 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540559    2570 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 20 12:44:47.564698 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540564    2570 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 20 12:44:47.564698 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540570    2570 flags.go:64] FLAG: --container-log-max-files="5"
Jul 20 12:44:47.564698 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540576    2570 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 20 12:44:47.564698 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540580    2570 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 20 12:44:47.564698 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540584    2570 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 20 12:44:47.564698 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540589    2570 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 20 12:44:47.564698 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540596    2570 flags.go:64] FLAG: --contention-profiling="false"
Jul 20 12:44:47.564698 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540600    2570 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 20 12:44:47.564698 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540605    2570 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 20 12:44:47.565555 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540609    2570 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 20 12:44:47.565555 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540613    2570 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 20 12:44:47.565555 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540618    2570 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 20 12:44:47.565555 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540623    2570 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 20 12:44:47.565555 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540627    2570 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 20 12:44:47.565555 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540631    2570 flags.go:64] FLAG: --enable-load-reader="false"
Jul 20 12:44:47.565555 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540635    2570 flags.go:64] FLAG: --enable-server="true"
Jul 20 12:44:47.565555 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540640    2570 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 20 12:44:47.565555 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540646    2570 flags.go:64] FLAG: --event-burst="100"
Jul 20 12:44:47.565555 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540650    2570 flags.go:64] FLAG: --event-qps="50"
Jul 20 12:44:47.565555 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540655    2570 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 20 12:44:47.565555 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540659    2570 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 20 12:44:47.565555 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540664    2570 flags.go:64] FLAG: --eviction-hard=""
Jul 20 12:44:47.565555 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540669    2570 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 20 12:44:47.565555 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540673    2570 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 20 12:44:47.565555 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540677    2570 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 20 12:44:47.565555 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540681    2570 flags.go:64] FLAG: --eviction-soft=""
Jul 20 12:44:47.565555 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540685    2570 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 20 12:44:47.565555 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540690    2570 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 20 12:44:47.565555 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540694    2570 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 20 12:44:47.565555 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540698    2570 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 20 12:44:47.565555 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540702    2570 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 20 12:44:47.565555 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540706    2570 flags.go:64] FLAG: --fail-swap-on="true"
Jul 20 12:44:47.565555 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540710    2570 flags.go:64] FLAG: --feature-gates=""
Jul 20 12:44:47.565555 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540717    2570 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 20 12:44:47.566426 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540721    2570 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 20 12:44:47.566426 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540726    2570 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 20 12:44:47.566426 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540730    2570 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 20 12:44:47.566426 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540735    2570 flags.go:64] FLAG: --healthz-port="10248"
Jul 20 12:44:47.566426 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540741    2570 flags.go:64] FLAG: --help="false"
Jul 20 12:44:47.566426 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540745    2570 flags.go:64] FLAG: --hostname-override="ip-10-0-139-1.ec2.internal"
Jul 20 12:44:47.566426 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540750    2570 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 20 12:44:47.566426 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540754    2570 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 20 12:44:47.566426 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540758    2570 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 20 12:44:47.566426 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540763    2570 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 20 12:44:47.566426 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540768    2570 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 20 12:44:47.566426 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540772    2570 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 20 12:44:47.566426 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540777    2570 flags.go:64] FLAG: --image-service-endpoint=""
Jul 20 12:44:47.566426 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540781    2570 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 20 12:44:47.566426 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540785    2570 flags.go:64] FLAG: --kube-api-burst="100"
Jul 20 12:44:47.566426 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540798    2570 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 20 12:44:47.566426 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540803    2570 flags.go:64] FLAG: --kube-api-qps="50"
Jul 20 12:44:47.566426 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540807    2570 flags.go:64] FLAG: --kube-reserved=""
Jul 20 12:44:47.566426 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540812    2570 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 20 12:44:47.566426 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540815    2570 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 20 12:44:47.566426 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540820    2570 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 20 12:44:47.566426 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540824    2570 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 20 12:44:47.566426 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540828    2570 flags.go:64] FLAG: --lock-file=""
Jul 20 12:44:47.566426 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540832    2570 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 20 12:44:47.567279 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540837    2570 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 20 12:44:47.567279 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540841    2570 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 20 12:44:47.567279 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540854    2570 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 20 12:44:47.567279 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540858    2570 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 20 12:44:47.567279 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540862    2570 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 20 12:44:47.567279 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540866    2570 flags.go:64] FLAG: --logging-format="text"
Jul 20 12:44:47.567279 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540870    2570 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 20 12:44:47.567279 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540877    2570 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 20 12:44:47.567279 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540881    2570 flags.go:64] FLAG: --manifest-url=""
Jul 20 12:44:47.567279 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540885    2570 flags.go:64] FLAG: --manifest-url-header=""
Jul 20 12:44:47.567279 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540892    2570 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 20 12:44:47.567279 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540896    2570 flags.go:64] FLAG: --max-open-files="1000000"
Jul 20 12:44:47.567279 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540904    2570 flags.go:64] FLAG: --max-pods="110"
Jul 20 12:44:47.567279 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540908    2570 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 20 12:44:47.567279 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540912    2570 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 20 12:44:47.567279 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540916    2570 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 20 12:44:47.567279 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540920    2570 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 20 12:44:47.567279 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540925    2570 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 20 12:44:47.567279 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540930    2570 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 20 12:44:47.567279 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540934    2570 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 20 12:44:47.567279 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540945    2570 flags.go:64] FLAG: --node-status-max-images="50"
Jul 20 12:44:47.567279 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540950    2570 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 20 12:44:47.567279 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540954    2570 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 20 12:44:47.567279 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540958    2570 flags.go:64] FLAG: --pod-cidr=""
Jul 20 12:44:47.632833 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540963    2570 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 20 12:44:47.632833 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540971    2570 flags.go:64] FLAG: --pod-manifest-path=""
Jul 20 12:44:47.632833 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540976    2570 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 20 12:44:47.632833 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540980    2570 flags.go:64] FLAG: --pods-per-core="0"
Jul 20 12:44:47.632833 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540984    2570 flags.go:64] FLAG: --port="10250"
Jul 20 12:44:47.632833 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540988    2570 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 20 12:44:47.632833 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540993    2570 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f5971645cbb55ace"
Jul 20 12:44:47.632833 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.540997    2570 flags.go:64] FLAG: --qos-reserved=""
Jul 20 12:44:47.632833 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.541002    2570 flags.go:64] FLAG: --read-only-port="10255"
Jul 20 12:44:47.632833 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.541006    2570 flags.go:64] FLAG: --register-node="true"
Jul 20 12:44:47.632833 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.541010    2570 flags.go:64] FLAG: --register-with-taints=""
Jul 20 12:44:47.632833 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.541015    2570 flags.go:64] FLAG: --registry-burst="10"
Jul 20 12:44:47.632833 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.541019    2570 flags.go:64] FLAG: --registry-qps="5"
Jul 20 12:44:47.632833 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.541023    2570 flags.go:64] FLAG: --reserved-cpus=""
Jul 20 12:44:47.632833 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.541028    2570 flags.go:64] FLAG: --reserved-memory=""
Jul 20 12:44:47.632833 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.541033    2570 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 20 12:44:47.632833 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.541040    2570 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 20 12:44:47.632833 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.541044    2570 flags.go:64] FLAG: --rotate-certificates="false"
Jul 20 12:44:47.632833 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.541048    2570 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 20 12:44:47.632833 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.541052    2570 flags.go:64] FLAG: --runonce="false"
Jul 20 12:44:47.632833 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.541058    2570 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 20 12:44:47.632833 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.541063    2570 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 20 12:44:47.632833 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.541067    2570 flags.go:64] FLAG: --seccomp-default="false"
Jul 20 12:44:47.632833 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.541071    2570 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 20 12:44:47.632833 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.541075    2570 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 20 12:44:47.622639 ip-10-0-139-1 systemd[1]: Started Kubernetes Kubelet.
Jul 20 12:44:47.634125 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.541079    2570 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 20 12:44:47.634125 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.541097    2570 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 20 12:44:47.634125 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.541101    2570 flags.go:64] FLAG: --storage-driver-password="root"
Jul 20 12:44:47.634125 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.541105    2570 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 20 12:44:47.634125 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.541110    2570 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 20 12:44:47.634125 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.541115    2570 flags.go:64] FLAG: --storage-driver-user="root"
Jul 20 12:44:47.634125 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.541119    2570 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 20 12:44:47.634125 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.541123    2570 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 20 12:44:47.634125 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.541128    2570 flags.go:64] FLAG: --system-cgroups=""
Jul 20 12:44:47.634125 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.541133    2570 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 20 12:44:47.634125 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.541140    2570 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 20 12:44:47.634125 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.541144    2570 flags.go:64] FLAG: --tls-cert-file=""
Jul 20 12:44:47.634125 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.541148    2570 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 20 12:44:47.634125 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.541154    2570 flags.go:64] FLAG: --tls-min-version=""
Jul 20 12:44:47.634125 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.541157    2570 flags.go:64] FLAG: --tls-private-key-file=""
Jul 20 12:44:47.634125 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.541161    2570 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 20 12:44:47.634125 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.541165    2570 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 20 12:44:47.634125 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.541169    2570 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 20 12:44:47.634125 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.541174    2570 flags.go:64] FLAG: --v="2"
Jul 20 12:44:47.634125 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.541180    2570 flags.go:64] FLAG: --version="false"
Jul 20 12:44:47.634125 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.541186    2570 flags.go:64] FLAG: --vmodule=""
Jul 20 12:44:47.634125 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.541192    2570 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 20 12:44:47.634125 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.541197    2570 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 20 12:44:47.634125 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541359    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 12:44:47.634125 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541365    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 12:44:47.642663 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541369    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 12:44:47.642663 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541373    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 12:44:47.642663 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541378    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 12:44:47.642663 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541382    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 12:44:47.642663 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541385    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 12:44:47.642663 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541389    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 12:44:47.642663 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541393    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 12:44:47.642663 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541397    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 12:44:47.642663 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541400    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 12:44:47.642663 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541404    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 12:44:47.642663 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541407    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 12:44:47.642663 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541411    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 12:44:47.642663 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541415    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 12:44:47.642663 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541419    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 12:44:47.642663 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541423    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 12:44:47.642663 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541426    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 12:44:47.642663 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541431    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 12:44:47.642663 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541434    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 12:44:47.642663 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541438    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 12:44:47.642663 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541442    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 12:44:47.643494 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541445    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 12:44:47.643494 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541449    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 12:44:47.643494 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541452    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 12:44:47.643494 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541456    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 12:44:47.643494 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541460    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 12:44:47.643494 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541463    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 12:44:47.643494 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541467    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 12:44:47.643494 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541471    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 12:44:47.643494 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541474    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 12:44:47.643494 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541478    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 12:44:47.643494 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541483    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 12:44:47.643494 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541487    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 12:44:47.643494 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541491    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 12:44:47.643494 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541495    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 12:44:47.643494 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541500    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 12:44:47.643494 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541503    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 12:44:47.643494 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541507    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 12:44:47.643494 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541510    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 12:44:47.643494 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541514    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 12:44:47.644364 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541519    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 12:44:47.644364 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541524    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 12:44:47.644364 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541528    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 12:44:47.644364 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541532    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 12:44:47.644364 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541536    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 12:44:47.644364 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541540    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 12:44:47.644364 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541544    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 12:44:47.644364 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541547    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 12:44:47.644364 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541551    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 12:44:47.644364 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541555    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 12:44:47.644364 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541562    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 12:44:47.644364 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541566    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 12:44:47.644364 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541571    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 12:44:47.644364 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541575    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 12:44:47.644364 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541578    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 12:44:47.644364 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541582    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 12:44:47.644364 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541586    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 12:44:47.644364 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541590    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 12:44:47.644364 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541596    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 12:44:47.645390 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541600    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 12:44:47.645390 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541604    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 12:44:47.645390 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541608    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 12:44:47.645390 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541612    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 12:44:47.645390 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541617    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 12:44:47.645390 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541622    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 12:44:47.645390 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541626    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 12:44:47.645390 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541630    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 12:44:47.645390 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541635    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 12:44:47.645390 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541640    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 12:44:47.645390 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541644    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 12:44:47.645390 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541648    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 12:44:47.645390 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541652    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 12:44:47.645390 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541657    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 12:44:47.645390 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541660    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 12:44:47.645390 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541664    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 12:44:47.645390 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541668    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 12:44:47.645390 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541671    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 12:44:47.645390 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541675    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 12:44:47.645390 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541679    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 12:44:47.646000 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541682    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 12:44:47.646000 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541686    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 12:44:47.646000 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541690    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 12:44:47.646000 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541693    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 12:44:47.646000 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541698    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 12:44:47.646000 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541701    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 12:44:47.646000 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541705    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 12:44:47.646000 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541709    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 12:44:47.646000 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541713    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 12:44:47.646000 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541716    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 12:44:47.646000 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541720    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 12:44:47.646000 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541724    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 12:44:47.646000 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541728    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 12:44:47.646000 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541732    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 12:44:47.646000 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541735    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 12:44:47.646000 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541738    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 12:44:47.646000 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541744    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 12:44:47.646000 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541748    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 12:44:47.646000 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.541752    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 12:44:47.646836 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.542389    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 12:44:47.646836 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.549617    2570 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 20 12:44:47.646836 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.549634    2570 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 20 12:44:47.646836 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.549654    2570 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 20 12:44:47.646836 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.549660    2570 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 20 12:44:47.646836 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549718    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 12:44:47.646836 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549723    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 12:44:47.646836 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549726    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 12:44:47.646836 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549729    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 12:44:47.646836 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549732    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 12:44:47.646836 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549735    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 12:44:47.646836 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549737    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 12:44:47.646836 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549740    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 12:44:47.646836 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549742    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 12:44:47.646836 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549746    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 12:44:47.647461 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549751    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 12:44:47.647461 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549754    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 12:44:47.647461 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549757    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 12:44:47.647461 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549760    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 12:44:47.647461 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549769    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 12:44:47.647461 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549772    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 12:44:47.647461 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549777    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 12:44:47.647461 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549780    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 12:44:47.647461 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549783    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 12:44:47.647461 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549786    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 12:44:47.647461 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549789    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 12:44:47.647461 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549792    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 12:44:47.647461 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549795    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 12:44:47.647461 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549798    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 12:44:47.647461 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549801    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 12:44:47.647461 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549805    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 12:44:47.647461 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549809    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 12:44:47.647461 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549812    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 12:44:47.647461 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549815    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 12:44:47.648072 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549823    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 12:44:47.648072 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549826    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 12:44:47.648072 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549830    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 12:44:47.648072 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549833    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 12:44:47.648072 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549835    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 12:44:47.648072 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549838    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 12:44:47.648072 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549841    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 12:44:47.648072 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549844    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 12:44:47.648072 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549847    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 12:44:47.648072 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549849    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 12:44:47.648072 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549852    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 12:44:47.648072 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549854    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 12:44:47.648072 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549857    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 12:44:47.648072 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549860    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 12:44:47.648072 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549863    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 12:44:47.648072 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549865    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 12:44:47.648072 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549868    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 12:44:47.648072 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549872    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 12:44:47.648072 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549875    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 12:44:47.648677 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549878    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 12:44:47.648677 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549880    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 12:44:47.648677 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549883    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 12:44:47.648677 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549885    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 12:44:47.648677 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549888    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 12:44:47.648677 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549891    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 12:44:47.648677 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549893    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 12:44:47.648677 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549896    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 12:44:47.648677 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549898    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 12:44:47.648677 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549900    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 12:44:47.648677 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549903    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 12:44:47.648677 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549905    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 12:44:47.648677 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549908    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 12:44:47.648677 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549910    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 12:44:47.648677 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549913    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 12:44:47.648677 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549916    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 12:44:47.648677 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549918    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 12:44:47.648677 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549920    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 12:44:47.648677 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549923    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 12:44:47.648677 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549925    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 12:44:47.649563 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549930    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 12:44:47.649563 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549933    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 12:44:47.649563 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549935    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 12:44:47.649563 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549937    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 12:44:47.649563 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549940    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 12:44:47.649563 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549942    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 12:44:47.649563 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549945    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 12:44:47.649563 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549947    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 12:44:47.649563 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549950    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 12:44:47.649563 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549952    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 12:44:47.649563 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549957    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 12:44:47.649563 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549959    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 12:44:47.649563 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549962    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 12:44:47.649563 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549964    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 12:44:47.649563 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549967    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 12:44:47.649563 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549969    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 12:44:47.649563 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549971    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 12:44:47.649563 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549974    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 12:44:47.649563 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549977    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 12:44:47.649563 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549979    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 12:44:47.650526 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549982    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 12:44:47.650526 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549984    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 12:44:47.650526 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549987    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 12:44:47.650526 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549989    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 12:44:47.650526 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549992    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 12:44:47.650526 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549994    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 12:44:47.650526 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549997    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 12:44:47.650526 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.549999    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 12:44:47.650526 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550001    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 12:44:47.650526 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550004    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 12:44:47.650526 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550006    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 12:44:47.650526 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.550012    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 12:44:47.650526 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550141    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 12:44:47.650526 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550147    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 12:44:47.650526 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550150    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 12:44:47.651422 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550153    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 12:44:47.651422 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550156    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 12:44:47.651422 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550159    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 12:44:47.651422 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550162    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 12:44:47.651422 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550164    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 12:44:47.651422 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550167    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 12:44:47.651422 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550169    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 12:44:47.651422 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550180    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 12:44:47.651422 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550185    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 12:44:47.651422 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550188    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 12:44:47.651422 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550191    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 12:44:47.651422 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550193    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 12:44:47.651422 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550196    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 12:44:47.651422 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550200    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 12:44:47.651422 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550204    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 12:44:47.651422 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550207    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 12:44:47.651422 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550210    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 12:44:47.651422 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550212    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 12:44:47.651422 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550234    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 12:44:47.651422 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550237    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 12:44:47.652548 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550239    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 12:44:47.652548 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550242    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 12:44:47.652548 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550245    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 12:44:47.652548 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550247    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 12:44:47.652548 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550250    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 12:44:47.652548 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550252    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 12:44:47.652548 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550255    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 12:44:47.652548 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550257    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 12:44:47.652548 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550259    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 12:44:47.652548 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550262    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 12:44:47.652548 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550265    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 12:44:47.652548 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550268    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 12:44:47.652548 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550271    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 12:44:47.652548 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550273    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 12:44:47.652548 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550276    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 12:44:47.652548 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550278    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 12:44:47.652548 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550281    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 12:44:47.652548 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550283    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 12:44:47.652548 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550286    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 12:44:47.652548 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550290    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 12:44:47.653664 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550293    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 12:44:47.653664 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550296    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 12:44:47.653664 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550299    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 12:44:47.653664 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550302    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 12:44:47.653664 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550304    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 12:44:47.653664 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550308    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 12:44:47.653664 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550311    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 12:44:47.653664 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550315    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 12:44:47.653664 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550318    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 12:44:47.653664 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550321    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 12:44:47.653664 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550323    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 12:44:47.653664 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550326    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 12:44:47.653664 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550328    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 12:44:47.653664 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550330    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 12:44:47.653664 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550333    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 12:44:47.653664 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550336    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 12:44:47.653664 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550338    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 12:44:47.653664 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550341    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 12:44:47.653664 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550343    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 12:44:47.653664 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550345    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 12:44:47.654810 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550348    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 12:44:47.654810 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550351    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 12:44:47.654810 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550356    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 12:44:47.654810 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550359    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 12:44:47.654810 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550361    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 12:44:47.654810 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550364    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 12:44:47.654810 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550367    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 12:44:47.654810 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550369    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 12:44:47.654810 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550372    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 12:44:47.654810 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550374    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 12:44:47.654810 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550377    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 12:44:47.654810 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550382    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 12:44:47.654810 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550384    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 12:44:47.654810 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550387    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 12:44:47.654810 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550390    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 12:44:47.654810 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550392    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 12:44:47.654810 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550395    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 12:44:47.654810 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550397    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 12:44:47.654810 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550400    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 12:44:47.654810 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550402    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 12:44:47.655941 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550404    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 12:44:47.655941 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550407    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 12:44:47.655941 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550409    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 12:44:47.655941 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550412    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 12:44:47.655941 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550414    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 12:44:47.655941 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550417    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 12:44:47.655941 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550419    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 12:44:47.655941 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550422    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 12:44:47.655941 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550424    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 12:44:47.655941 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550427    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 12:44:47.655941 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550429    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 12:44:47.655941 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550432    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 12:44:47.655941 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550434    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 12:44:47.655941 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550437    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 12:44:47.655941 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550440    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 12:44:47.655941 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:47.550443    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 12:44:47.656830 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.550448    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 12:44:47.656830 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.550562    2570 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 20 12:44:47.656830 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.552555    2570 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 20 12:44:47.656830 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.553881    2570 server.go:1019] "Starting client certificate rotation"
Jul 20 12:44:47.656830 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.556166    2570 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 20 12:44:47.656830 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.557331    2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 20 12:44:47.656830 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.557374    2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 20 12:44:47.656830 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.557549    2570 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 20 12:44:47.656830 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.576811    2570 log.go:25] "Validated CRI v1 runtime API"
Jul 20 12:44:47.656830 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.581612    2570 log.go:25] "Validated CRI v1 image API"
Jul 20 12:44:47.656830 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.594204    2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 20 12:44:47.656830 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.594764    2570 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 20 12:44:47.657480 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.597865    2570 fs.go:135] Filesystem UUIDs: map[6cb01c1e-a1c8-44bc-a77c-4ae8ece63f16:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 e768214b-c41d-4054-a0c4-aec242d04ae5:/dev/nvme0n1p4]
Jul 20 12:44:47.657480 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.597881    2570 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 20 12:44:47.657922 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.602924    2570 manager.go:216] Machine: {Timestamp:2026-07-20 12:44:47.601555631 +0000 UTC m=+0.356605016 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3198574 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e2669d8473fb0d38db20792d9a5b2 SystemUUID:ec2e2669-d847-3fb0-d38d-b20792d9a5b2 BootID:6019d226-eb00-4413-8fc1-149fe9bbe6a5 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:2d:c9:5f:45:99 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:2d:c9:5f:45:99 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b2:5a:a2:a4:bc:fd Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 20 12:44:47.657922 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.603036    2570 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 20 12:44:47.657922 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.603142    2570 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 20 12:44:47.657922 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.606122    2570 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 20 12:44:47.657922 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.606154    2570 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-1.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 20 12:44:47.657922 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.606989    2570 topology_manager.go:138] "Creating topology manager with none policy"
Jul 20 12:44:47.657922 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.606999    2570 container_manager_linux.go:309] "Creating device plugin manager"
Jul 20 12:44:47.657922 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.607007    2570 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 20 12:44:47.657922 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.607676    2570 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 20 12:44:47.657922 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.608976    2570 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 20 12:44:47.657922 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.611608    2570 state_mem.go:36] "Initialized new in-memory state store"
Jul 20 12:44:47.657922 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.611734    2570 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 20 12:44:47.657922 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.611764    2570 kubelet.go:486] "Attempting to sync node with API server"
Jul 20 12:44:47.657922 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.611774    2570 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 20 12:44:47.657922 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.611788    2570 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 20 12:44:47.657922 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.611797    2570 kubelet.go:398] "Adding apiserver pod source"
Jul 20 12:44:47.657922 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.611806    2570 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 20 12:44:47.657922 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.612154    2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 20 12:44:47.750180 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.612175    2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 20 12:44:47.750180 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.615055    2570 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 20 12:44:47.750180 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.616923    2570 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 20 12:44:47.750180 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.616950    2570 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 20 12:44:47.750180 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.617948    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 20 12:44:47.750180 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.617959    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 20 12:44:47.750180 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.617966    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 20 12:44:47.750180 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.617972    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 20 12:44:47.750180 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.617981    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 20 12:44:47.750180 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.617992    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 20 12:44:47.750180 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.618001    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 20 12:44:47.750180 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.618006    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 20 12:44:47.750180 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.618012    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 20 12:44:47.750180 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.618019    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 20 12:44:47.750180 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.618032    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 20 12:44:47.750180 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.618037    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 20 12:44:47.750180 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.618817    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 20 12:44:47.750180 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.618824    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 20 12:44:47.750180 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.620702    2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-82bt4"
Jul 20 12:44:47.750180 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.621918    2570 server.go:1268] "Started kubelet"
Jul 20 12:44:47.750180 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.622337    2570 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 20 12:44:47.750180 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.623878    2570 server.go:310] "Adding debug handlers to kubelet server"
Jul 20 12:44:47.750180 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.624637    2570 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 20 12:44:47.750180 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.624670    2570 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 20 12:44:47.750180 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.626375    2570 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 20 12:44:47.750180 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.626662    2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-82bt4"
Jul 20 12:44:47.750180 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.634159    2570 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-1.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 20 12:44:47.750180 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.634597    2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 20 12:44:47.750180 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:47.635715    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-1.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 20 12:44:47.750180 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:47.635807    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 20 12:44:47.750180 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.636522    2570 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 20 12:44:47.750180 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:47.636698    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-1.ec2.internal\" not found"
Jul 20 12:44:47.750180 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.637632    2570 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 20 12:44:47.750180 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.637634    2570 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 20 12:44:47.750180 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.637677    2570 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 20 12:44:47.750180 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.637790    2570 reconstruct.go:97] "Volume reconstruction finished"
Jul 20 12:44:47.750180 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.637800    2570 reconciler.go:29] "Reconciler: start to sync state"
Jul 20 12:44:47.750180 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.640651    2570 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 12:44:47.750180 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:47.642830    2570 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-139-1.ec2.internal\" not found" node="ip-10-0-139-1.ec2.internal"
Jul 20 12:44:47.750180 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.649688    2570 factory.go:55] Registering systemd factory
Jul 20 12:44:47.750180 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.649703    2570 factory.go:223] Registration of the systemd container factory successfully
Jul 20 12:44:47.750180 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.650645    2570 factory.go:153] Registering CRI-O factory
Jul 20 12:44:47.750180 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.650661    2570 factory.go:223] Registration of the crio container factory successfully
Jul 20 12:44:47.750180 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.650716    2570 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 20 12:44:47.750180 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.650737    2570 factory.go:103] Registering Raw factory
Jul 20 12:44:47.750180 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.650756    2570 manager.go:1196] Started watching for new ooms in manager
Jul 20 12:44:47.750180 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.651156    2570 manager.go:349] Starting recovery of all containers
Jul 20 12:44:47.750180 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.660553    2570 manager.go:354] Recovery completed
Jul 20 12:44:47.772824 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.666151    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 12:44:47.772824 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.669351    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 12:44:47.772824 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.669398    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 12:44:47.772824 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.669417    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasSufficientPID"
Jul 20 12:44:47.772824 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.670037    2570 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 20 12:44:47.772824 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.670055    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 12:44:47.772824 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.670049    2570 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 20 12:44:47.772824 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.670099    2570 state_mem.go:36] "Initialized new in-memory state store"
Jul 20 12:44:47.772824 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.670923    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 12:44:47.772824 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.670951    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 12:44:47.772824 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.670963    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasSufficientPID"
Jul 20 12:44:47.772824 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.671480    2570 policy_none.go:49] "None policy: Start"
Jul 20 12:44:47.772824 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.671495    2570 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 20 12:44:47.772824 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.671507    2570 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 20 12:44:47.772824 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.672456    2570 policy_none.go:47] "Start"
Jul 20 12:44:47.772824 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.716722    2570 manager.go:337] "Starting Device Plugin manager"
Jul 20 12:44:47.772824 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:47.716756    2570 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 20 12:44:47.772824 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.716767    2570 server.go:87] "Starting device plugin registration server"
Jul 20 12:44:47.772824 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.717038    2570 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 20 12:44:47.772824 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.717053    2570 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 20 12:44:47.772824 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.717155    2570 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 20 12:44:47.772824 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.717242    2570 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 20 12:44:47.772824 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.717250    2570 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 20 12:44:47.772824 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:47.717829    2570 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 20 12:44:47.772824 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:47.717879    2570 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-1.ec2.internal\" not found"
Jul 20 12:44:47.874462 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.799501    2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 20 12:44:47.874462 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.800957    2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 20 12:44:47.874462 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.800990    2570 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 20 12:44:47.874462 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.801012    2570 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 20 12:44:47.874462 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:47.801044    2570 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 20 12:44:47.874462 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.803132    2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 12:44:47.874462 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.817487    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 12:44:47.874462 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.818475    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 12:44:47.874462 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.818506    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 12:44:47.874462 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.818519    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasSufficientPID"
Jul 20 12:44:47.874462 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.818543    2570 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-1.ec2.internal"
Jul 20 12:44:47.874462 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.828027    2570 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-1.ec2.internal"
Jul 20 12:44:47.874462 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:47.828051    2570 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-1.ec2.internal\": node \"ip-10-0-139-1.ec2.internal\" not found"
Jul 20 12:44:47.874462 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:47.842501    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-1.ec2.internal\" not found"
Jul 20 12:44:48.001537 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.903489    2570 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-139-1.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal"]
Jul 20 12:44:48.001537 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.903575    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 12:44:48.001537 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.905289    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 12:44:48.001537 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.905318    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 12:44:48.001537 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.905329    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasSufficientPID"
Jul 20 12:44:48.001537 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.907694    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 12:44:48.001537 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.907792    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-1.ec2.internal"
Jul 20 12:44:48.001537 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.907821    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 12:44:48.001537 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.908494    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 12:44:48.001537 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.908523    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 12:44:48.001537 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.908494    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 12:44:48.001537 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.908533    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasSufficientPID"
Jul 20 12:44:48.001537 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.908550    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 12:44:48.001537 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.908561    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasSufficientPID"
Jul 20 12:44:48.001537 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.911246    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal"
Jul 20 12:44:48.001537 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.911276    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 12:44:48.001537 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.911952    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 12:44:48.001537 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.911975    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 12:44:48.001537 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.911991    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasSufficientPID"
Jul 20 12:44:48.001537 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.939298    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a315493ff7ec57552d98ccbaa050d33e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal\" (UID: \"a315493ff7ec57552d98ccbaa050d33e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal"
Jul 20 12:44:48.001537 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.939331    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a315493ff7ec57552d98ccbaa050d33e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal\" (UID: \"a315493ff7ec57552d98ccbaa050d33e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal"
Jul 20 12:44:48.001537 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:47.939351    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4359bec0e352431350db386bdadf6398-config\") pod \"kube-apiserver-proxy-ip-10-0-139-1.ec2.internal\" (UID: \"4359bec0e352431350db386bdadf6398\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-1.ec2.internal"
Jul 20 12:44:48.001537 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:47.943307    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-1.ec2.internal\" not found"
Jul 20 12:44:48.001537 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:47.958257    2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-1.ec2.internal\" not found" node="ip-10-0-139-1.ec2.internal"
Jul 20 12:44:48.001537 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:47.963020    2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-1.ec2.internal\" not found" node="ip-10-0-139-1.ec2.internal"
Jul 20 12:44:48.111775 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:48.040313    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4359bec0e352431350db386bdadf6398-config\") pod \"kube-apiserver-proxy-ip-10-0-139-1.ec2.internal\" (UID: \"4359bec0e352431350db386bdadf6398\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-1.ec2.internal"
Jul 20 12:44:48.111775 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:48.040363    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a315493ff7ec57552d98ccbaa050d33e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal\" (UID: \"a315493ff7ec57552d98ccbaa050d33e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal"
Jul 20 12:44:48.111775 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:48.040389    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a315493ff7ec57552d98ccbaa050d33e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal\" (UID: \"a315493ff7ec57552d98ccbaa050d33e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal"
Jul 20 12:44:48.111775 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:48.040431    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a315493ff7ec57552d98ccbaa050d33e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal\" (UID: \"a315493ff7ec57552d98ccbaa050d33e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal"
Jul 20 12:44:48.111775 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:48.040450    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a315493ff7ec57552d98ccbaa050d33e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal\" (UID: \"a315493ff7ec57552d98ccbaa050d33e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal"
Jul 20 12:44:48.111775 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:48.040453    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4359bec0e352431350db386bdadf6398-config\") pod \"kube-apiserver-proxy-ip-10-0-139-1.ec2.internal\" (UID: \"4359bec0e352431350db386bdadf6398\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-1.ec2.internal"
Jul 20 12:44:48.111775 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:48.043493    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-1.ec2.internal\" not found"
Jul 20 12:44:48.221263 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:48.143643    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-1.ec2.internal\" not found"
Jul 20 12:44:48.311563 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:48.244265    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-1.ec2.internal\" not found"
Jul 20 12:44:48.311563 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:48.261305    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-1.ec2.internal"
Jul 20 12:44:48.311563 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:48.266396    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal"
Jul 20 12:44:48.419915 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:48.345165    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-1.ec2.internal\" not found"
Jul 20 12:44:48.527893 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:48.446133    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-1.ec2.internal\" not found"
Jul 20 12:44:48.622423 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:48.547080    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-1.ec2.internal\" not found"
Jul 20 12:44:48.622423 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:48.557818    2570 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 20 12:44:48.622423 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:48.557969    2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 20 12:44:48.622423 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:48.558005    2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 20 12:44:48.730153 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:48.634266    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-19 12:39:47 +0000 UTC" deadline="2028-01-10 12:01:52.634497447 +0000 UTC"
Jul 20 12:44:48.730153 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:48.634313    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12935h17m4.000188836s"
Jul 20 12:44:48.730153 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:48.647832    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-1.ec2.internal\" not found"
Jul 20 12:44:48.730153 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:48.663309    2570 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 12:44:48.748821 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:48.748789    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-1.ec2.internal\" not found"
Jul 20 12:44:48.849141 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:48.849112    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-1.ec2.internal\" not found"
Jul 20 12:44:48.949695 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:48.949671    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-1.ec2.internal\" not found"
Jul 20 12:44:48.957193 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:48.957165    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4359bec0e352431350db386bdadf6398.slice/crio-4c7e1cb810dc7ea4ec5b492d23d344fec872e223a8026f9b8e18aea8cacff2fb WatchSource:0}: Error finding container 4c7e1cb810dc7ea4ec5b492d23d344fec872e223a8026f9b8e18aea8cacff2fb: Status 404 returned error can't find the container with id 4c7e1cb810dc7ea4ec5b492d23d344fec872e223a8026f9b8e18aea8cacff2fb
Jul 20 12:44:48.957536 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:48.957517    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda315493ff7ec57552d98ccbaa050d33e.slice/crio-f709360f36ce19b95ea3c299d9b7654421e847927a59f68934c4ec645d87902e WatchSource:0}: Error finding container f709360f36ce19b95ea3c299d9b7654421e847927a59f68934c4ec645d87902e: Status 404 returned error can't find the container with id f709360f36ce19b95ea3c299d9b7654421e847927a59f68934c4ec645d87902e
Jul 20 12:44:48.962736 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:48.962722    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 12:44:49.050776 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:49.050735    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-1.ec2.internal\" not found"
Jul 20 12:44:49.151667 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:49.151583    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-1.ec2.internal\" not found"
Jul 20 12:44:49.159812 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.159782    2570 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 12:44:49.237584 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.237550    2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-1.ec2.internal"
Jul 20 12:44:49.247750 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.247723    2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 20 12:44:49.249016 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.249002    2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal"
Jul 20 12:44:49.260910 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.260887    2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 20 12:44:49.615121 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.615016    2570 apiserver.go:52] "Watching apiserver"
Jul 20 12:44:49.626976 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.626941    2570 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 20 12:44:49.627573 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.627370    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-nt9ss","openshift-network-operator/iptables-alerter-58x4n","openshift-ovn-kubernetes/ovnkube-node-rhdn8","kube-system/global-pull-secret-syncer-4dkkp","kube-system/konnectivity-agent-w7hxf","openshift-cluster-node-tuning-operator/tuned-k9w5j","openshift-dns/node-resolver-qvfnf","openshift-image-registry/node-ca-bmw8t","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal","openshift-multus/multus-wphvm","openshift-multus/network-metrics-daemon-gn69x","kube-system/kube-apiserver-proxy-ip-10-0-139-1.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhlms","openshift-multus/multus-additional-cni-plugins-5fvsm"]
Jul 20 12:44:49.629988 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.629958    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-w7hxf"
Jul 20 12:44:49.633360 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.633041    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-lr8x6\""
Jul 20 12:44:49.633360 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.633203    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 20 12:44:49.633531 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.633385    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-58x4n"
Jul 20 12:44:49.633531 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.633426    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 20 12:44:49.635511 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.635346    2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 20 12:44:49.635511 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.635428    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhlms"
Jul 20 12:44:49.636462 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.636440    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 20 12:44:49.636575 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.636553    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 20 12:44:49.636825 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.636807    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 20 12:44:49.636887 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.636875    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vtxbv\""
Jul 20 12:44:49.637819 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.637799    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wphvm"
Jul 20 12:44:49.638370 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.638275    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 20 12:44:49.638370 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.638306    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 20 12:44:49.638781 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.638733    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 20 12:44:49.638978 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.638929    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-96p8h\""
Jul 20 12:44:49.640298 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.640002    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dkkp"
Jul 20 12:44:49.640298 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:49.640074    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dkkp" podUID="5fbafa93-14fa-41b3-a202-eb69336c381e"
Jul 20 12:44:49.640808 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.640789    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 20 12:44:49.640993 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.640977    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 20 12:44:49.641227 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.641211    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 20 12:44:49.641412 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.641398    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4pdpw\""
Jul 20 12:44:49.641674 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.641657    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 20 12:44:49.642192 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.642160    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k9w5j"
Jul 20 12:44:49.644770 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.644563    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qvfnf"
Jul 20 12:44:49.645292 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.645031    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 20 12:44:49.645292 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.645098    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 20 12:44:49.645292 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.645126    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8w2p7\""
Jul 20 12:44:49.647138 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.647042    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bmw8t"
Jul 20 12:44:49.647365 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.647291    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-pt7q6\""
Jul 20 12:44:49.647465 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.647371    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 20 12:44:49.647465 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.647437    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 20 12:44:49.651571 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.651525    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-779f5\""
Jul 20 12:44:49.651787 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.651532    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 20 12:44:49.651911 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.651892    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 20 12:44:49.651970 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.651774    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 20 12:44:49.652422 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.652404    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/684e2cf7-4db4-4e84-a1e2-96d825a873d6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rhlms\" (UID: \"684e2cf7-4db4-4e84-a1e2-96d825a873d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhlms"
Jul 20 12:44:49.652521 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.652429    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nt9ss"
Jul 20 12:44:49.652521 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.652443    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5597d831-70ad-4f2c-803d-8775135e6215-multus-cni-dir\") pod \"multus-wphvm\" (UID: \"5597d831-70ad-4f2c-803d-8775135e6215\") " pod="openshift-multus/multus-wphvm"
Jul 20 12:44:49.652697 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.652642    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5597d831-70ad-4f2c-803d-8775135e6215-host-run-k8s-cni-cncf-io\") pod \"multus-wphvm\" (UID: \"5597d831-70ad-4f2c-803d-8775135e6215\") " pod="openshift-multus/multus-wphvm"
Jul 20 12:44:49.652759 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:49.652699    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nt9ss" podUID="d63473a8-86d8-4ad9-a2b0-26a3ab221c57"
Jul 20 12:44:49.652759 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.652720    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xftm6\" (UniqueName: \"kubernetes.io/projected/5597d831-70ad-4f2c-803d-8775135e6215-kube-api-access-xftm6\") pod \"multus-wphvm\" (UID: \"5597d831-70ad-4f2c-803d-8775135e6215\") " pod="openshift-multus/multus-wphvm"
Jul 20 12:44:49.652759 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.652752    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/50a9fa72-f7cd-4281-a6ae-6dce52580ba0-iptables-alerter-script\") pod \"iptables-alerter-58x4n\" (UID: \"50a9fa72-f7cd-4281-a6ae-6dce52580ba0\") " pod="openshift-network-operator/iptables-alerter-58x4n"
Jul 20 12:44:49.652910 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.652788    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/684e2cf7-4db4-4e84-a1e2-96d825a873d6-sys-fs\") pod \"aws-ebs-csi-driver-node-rhlms\" (UID: \"684e2cf7-4db4-4e84-a1e2-96d825a873d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhlms"
Jul 20 12:44:49.652910 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.652900    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5597d831-70ad-4f2c-803d-8775135e6215-cnibin\") pod \"multus-wphvm\" (UID: \"5597d831-70ad-4f2c-803d-8775135e6215\") " pod="openshift-multus/multus-wphvm"
Jul 20 12:44:49.653004 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.652991    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5597d831-70ad-4f2c-803d-8775135e6215-host-var-lib-cni-multus\") pod \"multus-wphvm\" (UID: \"5597d831-70ad-4f2c-803d-8775135e6215\") " pod="openshift-multus/multus-wphvm"
Jul 20 12:44:49.653064 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.653048    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/684e2cf7-4db4-4e84-a1e2-96d825a873d6-device-dir\") pod \"aws-ebs-csi-driver-node-rhlms\" (UID: \"684e2cf7-4db4-4e84-a1e2-96d825a873d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhlms"
Jul 20 12:44:49.653203 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.653070    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn69x"
Jul 20 12:44:49.653203 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.653099    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5597d831-70ad-4f2c-803d-8775135e6215-os-release\") pod \"multus-wphvm\" (UID: \"5597d831-70ad-4f2c-803d-8775135e6215\") " pod="openshift-multus/multus-wphvm"
Jul 20 12:44:49.653203 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.653128    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5597d831-70ad-4f2c-803d-8775135e6215-host-run-netns\") pod \"multus-wphvm\" (UID: \"5597d831-70ad-4f2c-803d-8775135e6215\") " pod="openshift-multus/multus-wphvm"
Jul 20 12:44:49.653203 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.653186    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5597d831-70ad-4f2c-803d-8775135e6215-host-var-lib-cni-bin\") pod \"multus-wphvm\" (UID: \"5597d831-70ad-4f2c-803d-8775135e6215\") " pod="openshift-multus/multus-wphvm"
Jul 20 12:44:49.653412 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.653234    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5597d831-70ad-4f2c-803d-8775135e6215-host-run-multus-certs\") pod \"multus-wphvm\" (UID: \"5597d831-70ad-4f2c-803d-8775135e6215\") " pod="openshift-multus/multus-wphvm"
Jul 20 12:44:49.653412 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.653321    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1590374e-47ea-4c52-8ad0-c84873ec14c6-agent-certs\") pod \"konnectivity-agent-w7hxf\" (UID: \"1590374e-47ea-4c52-8ad0-c84873ec14c6\") " pod="kube-system/konnectivity-agent-w7hxf"
Jul 20 12:44:49.653412 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.653354    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/684e2cf7-4db4-4e84-a1e2-96d825a873d6-registration-dir\") pod \"aws-ebs-csi-driver-node-rhlms\" (UID: \"684e2cf7-4db4-4e84-a1e2-96d825a873d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhlms"
Jul 20 12:44:49.653556 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.653410    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/684e2cf7-4db4-4e84-a1e2-96d825a873d6-etc-selinux\") pod \"aws-ebs-csi-driver-node-rhlms\" (UID: \"684e2cf7-4db4-4e84-a1e2-96d825a873d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhlms"
Jul 20 12:44:49.653556 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.653476    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5597d831-70ad-4f2c-803d-8775135e6215-hostroot\") pod \"multus-wphvm\" (UID: \"5597d831-70ad-4f2c-803d-8775135e6215\") " pod="openshift-multus/multus-wphvm"
Jul 20 12:44:49.653556 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:49.653461    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gn69x" podUID="d5e87d68-a096-452b-a6b3-c0815771c37d"
Jul 20 12:44:49.653698 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.653573    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5597d831-70ad-4f2c-803d-8775135e6215-multus-conf-dir\") pod \"multus-wphvm\" (UID: \"5597d831-70ad-4f2c-803d-8775135e6215\") " pod="openshift-multus/multus-wphvm"
Jul 20 12:44:49.653749 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.653678    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5597d831-70ad-4f2c-803d-8775135e6215-etc-kubernetes\") pod \"multus-wphvm\" (UID: \"5597d831-70ad-4f2c-803d-8775135e6215\") " pod="openshift-multus/multus-wphvm"
Jul 20 12:44:49.653801 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.653747    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5fbafa93-14fa-41b3-a202-eb69336c381e-original-pull-secret\") pod \"global-pull-secret-syncer-4dkkp\" (UID: \"5fbafa93-14fa-41b3-a202-eb69336c381e\") " pod="kube-system/global-pull-secret-syncer-4dkkp"
Jul 20 12:44:49.653801 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.653795    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/50a9fa72-f7cd-4281-a6ae-6dce52580ba0-host-slash\") pod \"iptables-alerter-58x4n\" (UID: \"50a9fa72-f7cd-4281-a6ae-6dce52580ba0\") " pod="openshift-network-operator/iptables-alerter-58x4n"
Jul 20 12:44:49.653894 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.653847    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/684e2cf7-4db4-4e84-a1e2-96d825a873d6-socket-dir\") pod \"aws-ebs-csi-driver-node-rhlms\" (UID: \"684e2cf7-4db4-4e84-a1e2-96d825a873d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhlms"
Jul 20 12:44:49.653949 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.653927    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5597d831-70ad-4f2c-803d-8775135e6215-system-cni-dir\") pod \"multus-wphvm\" (UID: \"5597d831-70ad-4f2c-803d-8775135e6215\") " pod="openshift-multus/multus-wphvm"
Jul 20 12:44:49.654001 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.653959    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5597d831-70ad-4f2c-803d-8775135e6215-multus-socket-dir-parent\") pod \"multus-wphvm\" (UID: \"5597d831-70ad-4f2c-803d-8775135e6215\") " pod="openshift-multus/multus-wphvm"
Jul 20 12:44:49.654001 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.653955    2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 20 12:44:49.654113 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.654029    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5597d831-70ad-4f2c-803d-8775135e6215-cni-binary-copy\") pod \"multus-wphvm\" (UID: \"5597d831-70ad-4f2c-803d-8775135e6215\") " pod="openshift-multus/multus-wphvm"
Jul 20 12:44:49.654113 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.654077    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5597d831-70ad-4f2c-803d-8775135e6215-multus-daemon-config\") pod \"multus-wphvm\" (UID: \"5597d831-70ad-4f2c-803d-8775135e6215\") " pod="openshift-multus/multus-wphvm"
Jul 20 12:44:49.654214 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.654149    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5fbafa93-14fa-41b3-a202-eb69336c381e-dbus\") pod \"global-pull-secret-syncer-4dkkp\" (UID: \"5fbafa93-14fa-41b3-a202-eb69336c381e\") " pod="kube-system/global-pull-secret-syncer-4dkkp"
Jul 20 12:44:49.654267 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.654216    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5fbafa93-14fa-41b3-a202-eb69336c381e-kubelet-config\") pod \"global-pull-secret-syncer-4dkkp\" (UID: \"5fbafa93-14fa-41b3-a202-eb69336c381e\") " pod="kube-system/global-pull-secret-syncer-4dkkp"
Jul 20 12:44:49.654314 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.654272    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ms4xb\" (UniqueName: \"kubernetes.io/projected/50a9fa72-f7cd-4281-a6ae-6dce52580ba0-kube-api-access-ms4xb\") pod \"iptables-alerter-58x4n\" (UID: \"50a9fa72-f7cd-4281-a6ae-6dce52580ba0\") " pod="openshift-network-operator/iptables-alerter-58x4n"
Jul 20 12:44:49.654365 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.654311    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9f2w4\" (UniqueName: \"kubernetes.io/projected/684e2cf7-4db4-4e84-a1e2-96d825a873d6-kube-api-access-9f2w4\") pod \"aws-ebs-csi-driver-node-rhlms\" (UID: \"684e2cf7-4db4-4e84-a1e2-96d825a873d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhlms"
Jul 20 12:44:49.654419 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.654365    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5597d831-70ad-4f2c-803d-8775135e6215-host-var-lib-kubelet\") pod \"multus-wphvm\" (UID: \"5597d831-70ad-4f2c-803d-8775135e6215\") " pod="openshift-multus/multus-wphvm"
Jul 20 12:44:49.654419 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.654392    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1590374e-47ea-4c52-8ad0-c84873ec14c6-konnectivity-ca\") pod \"konnectivity-agent-w7hxf\" (UID: \"1590374e-47ea-4c52-8ad0-c84873ec14c6\") " pod="kube-system/konnectivity-agent-w7hxf"
Jul 20 12:44:49.657187 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.657159    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.659696 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.659657    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5fvsm"
Jul 20 12:44:49.660171 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.660140    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 20 12:44:49.660416 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.660399    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 20 12:44:49.660625 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.660409    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 20 12:44:49.660878 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.660835    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-v6q6m\""
Jul 20 12:44:49.661127 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.661113    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 20 12:44:49.662525 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.662504    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 20 12:44:49.662647 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.662545    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 20 12:44:49.662897 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.662880    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-llctl\""
Jul 20 12:44:49.663052 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.663019    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 20 12:44:49.663154 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.663139    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 20 12:44:49.671914 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.671879    2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5vnvt"
Jul 20 12:44:49.681317 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.681294    2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5vnvt"
Jul 20 12:44:49.737220 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.736985    2570 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 12:44:49.739161 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.739130    2570 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 20 12:44:49.754938 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.754905    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/684e2cf7-4db4-4e84-a1e2-96d825a873d6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rhlms\" (UID: \"684e2cf7-4db4-4e84-a1e2-96d825a873d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhlms"
Jul 20 12:44:49.755117 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.754950    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5597d831-70ad-4f2c-803d-8775135e6215-host-run-k8s-cni-cncf-io\") pod \"multus-wphvm\" (UID: \"5597d831-70ad-4f2c-803d-8775135e6215\") " pod="openshift-multus/multus-wphvm"
Jul 20 12:44:49.755117 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.754982    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5efe9094-763c-4689-85b7-83e0ccb19811-systemd-units\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.755117 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.754999    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5efe9094-763c-4689-85b7-83e0ccb19811-host-run-netns\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.755117 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.755024    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5efe9094-763c-4689-85b7-83e0ccb19811-ovnkube-config\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.755117 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.755048    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8223a859-94ea-40ad-b31d-7ee1eb77834e-run\") pod \"tuned-k9w5j\" (UID: \"8223a859-94ea-40ad-b31d-7ee1eb77834e\") " pod="openshift-cluster-node-tuning-operator/tuned-k9w5j"
Jul 20 12:44:49.755117 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.755063    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8223a859-94ea-40ad-b31d-7ee1eb77834e-lib-modules\") pod \"tuned-k9w5j\" (UID: \"8223a859-94ea-40ad-b31d-7ee1eb77834e\") " pod="openshift-cluster-node-tuning-operator/tuned-k9w5j"
Jul 20 12:44:49.755117 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.755097    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825-os-release\") pod \"multus-additional-cni-plugins-5fvsm\" (UID: \"f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825\") " pod="openshift-multus/multus-additional-cni-plugins-5fvsm"
Jul 20 12:44:49.755117 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.755115    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/50a9fa72-f7cd-4281-a6ae-6dce52580ba0-iptables-alerter-script\") pod \"iptables-alerter-58x4n\" (UID: \"50a9fa72-f7cd-4281-a6ae-6dce52580ba0\") " pod="openshift-network-operator/iptables-alerter-58x4n"
Jul 20 12:44:49.755497 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.755147    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5efe9094-763c-4689-85b7-83e0ccb19811-var-lib-openvswitch\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.755497 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.755170    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8223a859-94ea-40ad-b31d-7ee1eb77834e-etc-tuned\") pod \"tuned-k9w5j\" (UID: \"8223a859-94ea-40ad-b31d-7ee1eb77834e\") " pod="openshift-cluster-node-tuning-operator/tuned-k9w5j"
Jul 20 12:44:49.755497 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.755191    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwzhh\" (UniqueName: \"kubernetes.io/projected/8223a859-94ea-40ad-b31d-7ee1eb77834e-kube-api-access-jwzhh\") pod \"tuned-k9w5j\" (UID: \"8223a859-94ea-40ad-b31d-7ee1eb77834e\") " pod="openshift-cluster-node-tuning-operator/tuned-k9w5j"
Jul 20 12:44:49.755497 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.755206    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/684e2cf7-4db4-4e84-a1e2-96d825a873d6-device-dir\") pod \"aws-ebs-csi-driver-node-rhlms\" (UID: \"684e2cf7-4db4-4e84-a1e2-96d825a873d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhlms"
Jul 20 12:44:49.755497 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.755220    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5597d831-70ad-4f2c-803d-8775135e6215-host-run-multus-certs\") pod \"multus-wphvm\" (UID: \"5597d831-70ad-4f2c-803d-8775135e6215\") " pod="openshift-multus/multus-wphvm"
Jul 20 12:44:49.755497 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.755235    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpqcr\" (UniqueName: \"kubernetes.io/projected/d63473a8-86d8-4ad9-a2b0-26a3ab221c57-kube-api-access-vpqcr\") pod \"network-check-target-nt9ss\" (UID: \"d63473a8-86d8-4ad9-a2b0-26a3ab221c57\") " pod="openshift-network-diagnostics/network-check-target-nt9ss"
Jul 20 12:44:49.755497 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.755267    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/684e2cf7-4db4-4e84-a1e2-96d825a873d6-registration-dir\") pod \"aws-ebs-csi-driver-node-rhlms\" (UID: \"684e2cf7-4db4-4e84-a1e2-96d825a873d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhlms"
Jul 20 12:44:49.755497 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.755284    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/684e2cf7-4db4-4e84-a1e2-96d825a873d6-etc-selinux\") pod \"aws-ebs-csi-driver-node-rhlms\" (UID: \"684e2cf7-4db4-4e84-a1e2-96d825a873d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhlms"
Jul 20 12:44:49.755497 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.755368    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/684e2cf7-4db4-4e84-a1e2-96d825a873d6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rhlms\" (UID: \"684e2cf7-4db4-4e84-a1e2-96d825a873d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhlms"
Jul 20 12:44:49.755497 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.755421    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5597d831-70ad-4f2c-803d-8775135e6215-host-run-k8s-cni-cncf-io\") pod \"multus-wphvm\" (UID: \"5597d831-70ad-4f2c-803d-8775135e6215\") " pod="openshift-multus/multus-wphvm"
Jul 20 12:44:49.755497 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.755482    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5597d831-70ad-4f2c-803d-8775135e6215-hostroot\") pod \"multus-wphvm\" (UID: \"5597d831-70ad-4f2c-803d-8775135e6215\") " pod="openshift-multus/multus-wphvm"
Jul 20 12:44:49.755990 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.755527    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5597d831-70ad-4f2c-803d-8775135e6215-host-run-multus-certs\") pod \"multus-wphvm\" (UID: \"5597d831-70ad-4f2c-803d-8775135e6215\") " pod="openshift-multus/multus-wphvm"
Jul 20 12:44:49.755990 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.755525    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/684e2cf7-4db4-4e84-a1e2-96d825a873d6-registration-dir\") pod \"aws-ebs-csi-driver-node-rhlms\" (UID: \"684e2cf7-4db4-4e84-a1e2-96d825a873d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhlms"
Jul 20 12:44:49.755990 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.755604    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/684e2cf7-4db4-4e84-a1e2-96d825a873d6-device-dir\") pod \"aws-ebs-csi-driver-node-rhlms\" (UID: \"684e2cf7-4db4-4e84-a1e2-96d825a873d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhlms"
Jul 20 12:44:49.755990 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.755429    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5597d831-70ad-4f2c-803d-8775135e6215-hostroot\") pod \"multus-wphvm\" (UID: \"5597d831-70ad-4f2c-803d-8775135e6215\") " pod="openshift-multus/multus-wphvm"
Jul 20 12:44:49.755990 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.755541    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/684e2cf7-4db4-4e84-a1e2-96d825a873d6-etc-selinux\") pod \"aws-ebs-csi-driver-node-rhlms\" (UID: \"684e2cf7-4db4-4e84-a1e2-96d825a873d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhlms"
Jul 20 12:44:49.755990 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.755683    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5fbafa93-14fa-41b3-a202-eb69336c381e-original-pull-secret\") pod \"global-pull-secret-syncer-4dkkp\" (UID: \"5fbafa93-14fa-41b3-a202-eb69336c381e\") " pod="kube-system/global-pull-secret-syncer-4dkkp"
Jul 20 12:44:49.755990 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.755720    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5efe9094-763c-4689-85b7-83e0ccb19811-host-run-ovn-kubernetes\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.755990 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:49.755876    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 12:44:49.755990 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.755883    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5efe9094-763c-4689-85b7-83e0ccb19811-ovn-node-metrics-cert\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.755990 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.755919    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8223a859-94ea-40ad-b31d-7ee1eb77834e-var-lib-kubelet\") pod \"tuned-k9w5j\" (UID: \"8223a859-94ea-40ad-b31d-7ee1eb77834e\") " pod="openshift-cluster-node-tuning-operator/tuned-k9w5j"
Jul 20 12:44:49.755990 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:49.755963    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fbafa93-14fa-41b3-a202-eb69336c381e-original-pull-secret podName:5fbafa93-14fa-41b3-a202-eb69336c381e nodeName:}" failed. No retries permitted until 2026-07-20 12:44:50.255928507 +0000 UTC m=+3.010977879 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5fbafa93-14fa-41b3-a202-eb69336c381e-original-pull-secret") pod "global-pull-secret-syncer-4dkkp" (UID: "5fbafa93-14fa-41b3-a202-eb69336c381e") : object "kube-system"/"original-pull-secret" not registered
Jul 20 12:44:49.755990 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.755985    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/50a9fa72-f7cd-4281-a6ae-6dce52580ba0-host-slash\") pod \"iptables-alerter-58x4n\" (UID: \"50a9fa72-f7cd-4281-a6ae-6dce52580ba0\") " pod="openshift-network-operator/iptables-alerter-58x4n"
Jul 20 12:44:49.756637 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.756014    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5efe9094-763c-4689-85b7-83e0ccb19811-env-overrides\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.756637 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.756018    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/50a9fa72-f7cd-4281-a6ae-6dce52580ba0-iptables-alerter-script\") pod \"iptables-alerter-58x4n\" (UID: \"50a9fa72-f7cd-4281-a6ae-6dce52580ba0\") " pod="openshift-network-operator/iptables-alerter-58x4n"
Jul 20 12:44:49.756637 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.756038    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8223a859-94ea-40ad-b31d-7ee1eb77834e-etc-sysconfig\") pod \"tuned-k9w5j\" (UID: \"8223a859-94ea-40ad-b31d-7ee1eb77834e\") " pod="openshift-cluster-node-tuning-operator/tuned-k9w5j"
Jul 20 12:44:49.756637 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.756049    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/50a9fa72-f7cd-4281-a6ae-6dce52580ba0-host-slash\") pod \"iptables-alerter-58x4n\" (UID: \"50a9fa72-f7cd-4281-a6ae-6dce52580ba0\") " pod="openshift-network-operator/iptables-alerter-58x4n"
Jul 20 12:44:49.756637 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.756061    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8223a859-94ea-40ad-b31d-7ee1eb77834e-etc-sysctl-conf\") pod \"tuned-k9w5j\" (UID: \"8223a859-94ea-40ad-b31d-7ee1eb77834e\") " pod="openshift-cluster-node-tuning-operator/tuned-k9w5j"
Jul 20 12:44:49.756637 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.756106    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5fvsm\" (UID: \"f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825\") " pod="openshift-multus/multus-additional-cni-plugins-5fvsm"
Jul 20 12:44:49.756637 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.756125    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8223a859-94ea-40ad-b31d-7ee1eb77834e-etc-kubernetes\") pod \"tuned-k9w5j\" (UID: \"8223a859-94ea-40ad-b31d-7ee1eb77834e\") " pod="openshift-cluster-node-tuning-operator/tuned-k9w5j"
Jul 20 12:44:49.756637 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.756202    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8223a859-94ea-40ad-b31d-7ee1eb77834e-etc-systemd\") pod \"tuned-k9w5j\" (UID: \"8223a859-94ea-40ad-b31d-7ee1eb77834e\") " pod="openshift-cluster-node-tuning-operator/tuned-k9w5j"
Jul 20 12:44:49.756637 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.756222    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5fbafa93-14fa-41b3-a202-eb69336c381e-kubelet-config\") pod \"global-pull-secret-syncer-4dkkp\" (UID: \"5fbafa93-14fa-41b3-a202-eb69336c381e\") " pod="kube-system/global-pull-secret-syncer-4dkkp"
Jul 20 12:44:49.756637 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.756264    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5efe9094-763c-4689-85b7-83e0ccb19811-host-cni-bin\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.756637 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.756314    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5fbafa93-14fa-41b3-a202-eb69336c381e-kubelet-config\") pod \"global-pull-secret-syncer-4dkkp\" (UID: \"5fbafa93-14fa-41b3-a202-eb69336c381e\") " pod="kube-system/global-pull-secret-syncer-4dkkp"
Jul 20 12:44:49.756637 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.756360    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22rdv\" (UniqueName: \"kubernetes.io/projected/f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825-kube-api-access-22rdv\") pod \"multus-additional-cni-plugins-5fvsm\" (UID: \"f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825\") " pod="openshift-multus/multus-additional-cni-plugins-5fvsm"
Jul 20 12:44:49.756637 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.756393    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9f2w4\" (UniqueName: \"kubernetes.io/projected/684e2cf7-4db4-4e84-a1e2-96d825a873d6-kube-api-access-9f2w4\") pod \"aws-ebs-csi-driver-node-rhlms\" (UID: \"684e2cf7-4db4-4e84-a1e2-96d825a873d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhlms"
Jul 20 12:44:49.756637 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.756452    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8223a859-94ea-40ad-b31d-7ee1eb77834e-etc-sysctl-d\") pod \"tuned-k9w5j\" (UID: \"8223a859-94ea-40ad-b31d-7ee1eb77834e\") " pod="openshift-cluster-node-tuning-operator/tuned-k9w5j"
Jul 20 12:44:49.756637 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.756555    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5fvsm\" (UID: \"f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825\") " pod="openshift-multus/multus-additional-cni-plugins-5fvsm"
Jul 20 12:44:49.756637 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.756595    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1590374e-47ea-4c52-8ad0-c84873ec14c6-konnectivity-ca\") pod \"konnectivity-agent-w7hxf\" (UID: \"1590374e-47ea-4c52-8ad0-c84873ec14c6\") " pod="kube-system/konnectivity-agent-w7hxf"
Jul 20 12:44:49.757536 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.756634    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5597d831-70ad-4f2c-803d-8775135e6215-multus-cni-dir\") pod \"multus-wphvm\" (UID: \"5597d831-70ad-4f2c-803d-8775135e6215\") " pod="openshift-multus/multus-wphvm"
Jul 20 12:44:49.757536 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.756717    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xftm6\" (UniqueName: \"kubernetes.io/projected/5597d831-70ad-4f2c-803d-8775135e6215-kube-api-access-xftm6\") pod \"multus-wphvm\" (UID: \"5597d831-70ad-4f2c-803d-8775135e6215\") " pod="openshift-multus/multus-wphvm"
Jul 20 12:44:49.757536 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.756759    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8223a859-94ea-40ad-b31d-7ee1eb77834e-tmp\") pod \"tuned-k9w5j\" (UID: \"8223a859-94ea-40ad-b31d-7ee1eb77834e\") " pod="openshift-cluster-node-tuning-operator/tuned-k9w5j"
Jul 20 12:44:49.757536 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.756793    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/591fe657-5268-4a39-b559-48e285b8e064-tmp-dir\") pod \"node-resolver-qvfnf\" (UID: \"591fe657-5268-4a39-b559-48e285b8e064\") " pod="openshift-dns/node-resolver-qvfnf"
Jul 20 12:44:49.757536 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.756834    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825-cni-binary-copy\") pod \"multus-additional-cni-plugins-5fvsm\" (UID: \"f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825\") " pod="openshift-multus/multus-additional-cni-plugins-5fvsm"
Jul 20 12:44:49.757536 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.756882    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/684e2cf7-4db4-4e84-a1e2-96d825a873d6-sys-fs\") pod \"aws-ebs-csi-driver-node-rhlms\" (UID: \"684e2cf7-4db4-4e84-a1e2-96d825a873d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhlms"
Jul 20 12:44:49.757536 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.756907    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5597d831-70ad-4f2c-803d-8775135e6215-cnibin\") pod \"multus-wphvm\" (UID: \"5597d831-70ad-4f2c-803d-8775135e6215\") " pod="openshift-multus/multus-wphvm"
Jul 20 12:44:49.757536 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.756914    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5597d831-70ad-4f2c-803d-8775135e6215-multus-cni-dir\") pod \"multus-wphvm\" (UID: \"5597d831-70ad-4f2c-803d-8775135e6215\") " pod="openshift-multus/multus-wphvm"
Jul 20 12:44:49.757536 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.756932    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5597d831-70ad-4f2c-803d-8775135e6215-host-var-lib-cni-multus\") pod \"multus-wphvm\" (UID: \"5597d831-70ad-4f2c-803d-8775135e6215\") " pod="openshift-multus/multus-wphvm"
Jul 20 12:44:49.757536 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.757003    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5efe9094-763c-4689-85b7-83e0ccb19811-run-openvswitch\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.757536 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.757043    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8223a859-94ea-40ad-b31d-7ee1eb77834e-etc-modprobe-d\") pod \"tuned-k9w5j\" (UID: \"8223a859-94ea-40ad-b31d-7ee1eb77834e\") " pod="openshift-cluster-node-tuning-operator/tuned-k9w5j"
Jul 20 12:44:49.757536 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.757069    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8223a859-94ea-40ad-b31d-7ee1eb77834e-host\") pod \"tuned-k9w5j\" (UID: \"8223a859-94ea-40ad-b31d-7ee1eb77834e\") " pod="openshift-cluster-node-tuning-operator/tuned-k9w5j"
Jul 20 12:44:49.757536 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.757112    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/591fe657-5268-4a39-b559-48e285b8e064-hosts-file\") pod \"node-resolver-qvfnf\" (UID: \"591fe657-5268-4a39-b559-48e285b8e064\") " pod="openshift-dns/node-resolver-qvfnf"
Jul 20 12:44:49.757536 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.757163    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5597d831-70ad-4f2c-803d-8775135e6215-os-release\") pod \"multus-wphvm\" (UID: \"5597d831-70ad-4f2c-803d-8775135e6215\") " pod="openshift-multus/multus-wphvm"
Jul 20 12:44:49.757536 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.757192    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5597d831-70ad-4f2c-803d-8775135e6215-host-run-netns\") pod \"multus-wphvm\" (UID: \"5597d831-70ad-4f2c-803d-8775135e6215\") " pod="openshift-multus/multus-wphvm"
Jul 20 12:44:49.757536 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.757278    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5597d831-70ad-4f2c-803d-8775135e6215-host-var-lib-cni-bin\") pod \"multus-wphvm\" (UID: \"5597d831-70ad-4f2c-803d-8775135e6215\") " pod="openshift-multus/multus-wphvm"
Jul 20 12:44:49.757536 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.757325    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5efe9094-763c-4689-85b7-83e0ccb19811-host-kubelet\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.758323 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.757346    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5efe9094-763c-4689-85b7-83e0ccb19811-run-ovn\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.758323 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.757379    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5e87d68-a096-452b-a6b3-c0815771c37d-metrics-certs\") pod \"network-metrics-daemon-gn69x\" (UID: \"d5e87d68-a096-452b-a6b3-c0815771c37d\") " pod="openshift-multus/network-metrics-daemon-gn69x"
Jul 20 12:44:49.758323 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.757404    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1590374e-47ea-4c52-8ad0-c84873ec14c6-agent-certs\") pod \"konnectivity-agent-w7hxf\" (UID: \"1590374e-47ea-4c52-8ad0-c84873ec14c6\") " pod="kube-system/konnectivity-agent-w7hxf"
Jul 20 12:44:49.758323 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.757454    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5597d831-70ad-4f2c-803d-8775135e6215-multus-conf-dir\") pod \"multus-wphvm\" (UID: \"5597d831-70ad-4f2c-803d-8775135e6215\") " pod="openshift-multus/multus-wphvm"
Jul 20 12:44:49.758323 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.757480    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5597d831-70ad-4f2c-803d-8775135e6215-etc-kubernetes\") pod \"multus-wphvm\" (UID: \"5597d831-70ad-4f2c-803d-8775135e6215\") " pod="openshift-multus/multus-wphvm"
Jul 20 12:44:49.758323 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.757511    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5efe9094-763c-4689-85b7-83e0ccb19811-host-cni-netd\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.758323 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.757535    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6f1bf356-0007-494d-af6b-f42d5333291b-host\") pod \"node-ca-bmw8t\" (UID: \"6f1bf356-0007-494d-af6b-f42d5333291b\") " pod="openshift-image-registry/node-ca-bmw8t"
Jul 20 12:44:49.758323 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.757567    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6f1bf356-0007-494d-af6b-f42d5333291b-serviceca\") pod \"node-ca-bmw8t\" (UID: \"6f1bf356-0007-494d-af6b-f42d5333291b\") " pod="openshift-image-registry/node-ca-bmw8t"
Jul 20 12:44:49.758323 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.757604    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfhkj\" (UniqueName: \"kubernetes.io/projected/6f1bf356-0007-494d-af6b-f42d5333291b-kube-api-access-pfhkj\") pod \"node-ca-bmw8t\" (UID: \"6f1bf356-0007-494d-af6b-f42d5333291b\") " pod="openshift-image-registry/node-ca-bmw8t"
Jul 20 12:44:49.758323 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.757701    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1590374e-47ea-4c52-8ad0-c84873ec14c6-konnectivity-ca\") pod \"konnectivity-agent-w7hxf\" (UID: \"1590374e-47ea-4c52-8ad0-c84873ec14c6\") " pod="kube-system/konnectivity-agent-w7hxf"
Jul 20 12:44:49.758323 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.757772    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/684e2cf7-4db4-4e84-a1e2-96d825a873d6-socket-dir\") pod \"aws-ebs-csi-driver-node-rhlms\" (UID: \"684e2cf7-4db4-4e84-a1e2-96d825a873d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhlms"
Jul 20 12:44:49.758323 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.757790    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5597d831-70ad-4f2c-803d-8775135e6215-host-run-netns\") pod \"multus-wphvm\" (UID: \"5597d831-70ad-4f2c-803d-8775135e6215\") " pod="openshift-multus/multus-wphvm"
Jul 20 12:44:49.758323 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.757798    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5597d831-70ad-4f2c-803d-8775135e6215-system-cni-dir\") pod \"multus-wphvm\" (UID: \"5597d831-70ad-4f2c-803d-8775135e6215\") " pod="openshift-multus/multus-wphvm"
Jul 20 12:44:49.758323 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.757825    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5597d831-70ad-4f2c-803d-8775135e6215-multus-socket-dir-parent\") pod \"multus-wphvm\" (UID: \"5597d831-70ad-4f2c-803d-8775135e6215\") " pod="openshift-multus/multus-wphvm"
Jul 20 12:44:49.758323 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.757826    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5597d831-70ad-4f2c-803d-8775135e6215-host-var-lib-cni-multus\") pod \"multus-wphvm\" (UID: \"5597d831-70ad-4f2c-803d-8775135e6215\") " pod="openshift-multus/multus-wphvm"
Jul 20 12:44:49.758323 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.757855    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5efe9094-763c-4689-85b7-83e0ccb19811-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.758323 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.757876    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/684e2cf7-4db4-4e84-a1e2-96d825a873d6-sys-fs\") pod \"aws-ebs-csi-driver-node-rhlms\" (UID: \"684e2cf7-4db4-4e84-a1e2-96d825a873d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhlms"
Jul 20 12:44:49.759226 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.757883    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5efe9094-763c-4689-85b7-83e0ccb19811-ovnkube-script-lib\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.759226 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.757908    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825-system-cni-dir\") pod \"multus-additional-cni-plugins-5fvsm\" (UID: \"f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825\") " pod="openshift-multus/multus-additional-cni-plugins-5fvsm"
Jul 20 12:44:49.759226 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.757916    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5597d831-70ad-4f2c-803d-8775135e6215-cnibin\") pod \"multus-wphvm\" (UID: \"5597d831-70ad-4f2c-803d-8775135e6215\") " pod="openshift-multus/multus-wphvm"
Jul 20 12:44:49.759226 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.757933    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825-cnibin\") pod \"multus-additional-cni-plugins-5fvsm\" (UID: \"f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825\") " pod="openshift-multus/multus-additional-cni-plugins-5fvsm"
Jul 20 12:44:49.759226 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.757967    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5fvsm\" (UID: \"f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825\") " pod="openshift-multus/multus-additional-cni-plugins-5fvsm"
Jul 20 12:44:49.759226 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.758002    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5597d831-70ad-4f2c-803d-8775135e6215-etc-kubernetes\") pod \"multus-wphvm\" (UID: \"5597d831-70ad-4f2c-803d-8775135e6215\") " pod="openshift-multus/multus-wphvm"
Jul 20 12:44:49.759226 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.758008    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5597d831-70ad-4f2c-803d-8775135e6215-cni-binary-copy\") pod \"multus-wphvm\" (UID: \"5597d831-70ad-4f2c-803d-8775135e6215\") " pod="openshift-multus/multus-wphvm"
Jul 20 12:44:49.759226 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.758107    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5597d831-70ad-4f2c-803d-8775135e6215-os-release\") pod \"multus-wphvm\" (UID: \"5597d831-70ad-4f2c-803d-8775135e6215\") " pod="openshift-multus/multus-wphvm"
Jul 20 12:44:49.759226 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.758142    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5597d831-70ad-4f2c-803d-8775135e6215-host-var-lib-cni-bin\") pod \"multus-wphvm\" (UID: \"5597d831-70ad-4f2c-803d-8775135e6215\") " pod="openshift-multus/multus-wphvm"
Jul 20 12:44:49.759226 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.758417    2570 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 20 12:44:49.759226 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.758648    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5597d831-70ad-4f2c-803d-8775135e6215-multus-conf-dir\") pod \"multus-wphvm\" (UID: \"5597d831-70ad-4f2c-803d-8775135e6215\") " pod="openshift-multus/multus-wphvm"
Jul 20 12:44:49.759226 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.758686    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5597d831-70ad-4f2c-803d-8775135e6215-multus-daemon-config\") pod \"multus-wphvm\" (UID: \"5597d831-70ad-4f2c-803d-8775135e6215\") " pod="openshift-multus/multus-wphvm"
Jul 20 12:44:49.759226 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.758715    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5fbafa93-14fa-41b3-a202-eb69336c381e-dbus\") pod \"global-pull-secret-syncer-4dkkp\" (UID: \"5fbafa93-14fa-41b3-a202-eb69336c381e\") " pod="kube-system/global-pull-secret-syncer-4dkkp"
Jul 20 12:44:49.759226 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.758742    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5efe9094-763c-4689-85b7-83e0ccb19811-etc-openvswitch\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.759226 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.758766    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvfdv\" (UniqueName: \"kubernetes.io/projected/5efe9094-763c-4689-85b7-83e0ccb19811-kube-api-access-cvfdv\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.759226 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.758789    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfvjv\" (UniqueName: \"kubernetes.io/projected/591fe657-5268-4a39-b559-48e285b8e064-kube-api-access-cfvjv\") pod \"node-resolver-qvfnf\" (UID: \"591fe657-5268-4a39-b559-48e285b8e064\") " pod="openshift-dns/node-resolver-qvfnf"
Jul 20 12:44:49.759226 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.758814    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xb89w\" (UniqueName: \"kubernetes.io/projected/d5e87d68-a096-452b-a6b3-c0815771c37d-kube-api-access-xb89w\") pod \"network-metrics-daemon-gn69x\" (UID: \"d5e87d68-a096-452b-a6b3-c0815771c37d\") " pod="openshift-multus/network-metrics-daemon-gn69x"
Jul 20 12:44:49.760013 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.758824    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5597d831-70ad-4f2c-803d-8775135e6215-multus-socket-dir-parent\") pod \"multus-wphvm\" (UID: \"5597d831-70ad-4f2c-803d-8775135e6215\") " pod="openshift-multus/multus-wphvm"
Jul 20 12:44:49.760013 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.758837    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5efe9094-763c-4689-85b7-83e0ccb19811-log-socket\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.760013 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.758875    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ms4xb\" (UniqueName: \"kubernetes.io/projected/50a9fa72-f7cd-4281-a6ae-6dce52580ba0-kube-api-access-ms4xb\") pod \"iptables-alerter-58x4n\" (UID: \"50a9fa72-f7cd-4281-a6ae-6dce52580ba0\") " pod="openshift-network-operator/iptables-alerter-58x4n"
Jul 20 12:44:49.760013 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.758906    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5fbafa93-14fa-41b3-a202-eb69336c381e-dbus\") pod \"global-pull-secret-syncer-4dkkp\" (UID: \"5fbafa93-14fa-41b3-a202-eb69336c381e\") " pod="kube-system/global-pull-secret-syncer-4dkkp"
Jul 20 12:44:49.760013 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.758947    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5597d831-70ad-4f2c-803d-8775135e6215-host-var-lib-kubelet\") pod \"multus-wphvm\" (UID: \"5597d831-70ad-4f2c-803d-8775135e6215\") " pod="openshift-multus/multus-wphvm"
Jul 20 12:44:49.760013 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.758974    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5efe9094-763c-4689-85b7-83e0ccb19811-host-slash\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.760013 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.758998    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5efe9094-763c-4689-85b7-83e0ccb19811-run-systemd\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.760013 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.759022    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5efe9094-763c-4689-85b7-83e0ccb19811-node-log\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.760013 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.759043    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8223a859-94ea-40ad-b31d-7ee1eb77834e-sys\") pod \"tuned-k9w5j\" (UID: \"8223a859-94ea-40ad-b31d-7ee1eb77834e\") " pod="openshift-cluster-node-tuning-operator/tuned-k9w5j"
Jul 20 12:44:49.760013 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.759258    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/684e2cf7-4db4-4e84-a1e2-96d825a873d6-socket-dir\") pod \"aws-ebs-csi-driver-node-rhlms\" (UID: \"684e2cf7-4db4-4e84-a1e2-96d825a873d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhlms"
Jul 20 12:44:49.760013 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.759279    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5597d831-70ad-4f2c-803d-8775135e6215-multus-daemon-config\") pod \"multus-wphvm\" (UID: \"5597d831-70ad-4f2c-803d-8775135e6215\") " pod="openshift-multus/multus-wphvm"
Jul 20 12:44:49.760013 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.759317    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5597d831-70ad-4f2c-803d-8775135e6215-system-cni-dir\") pod \"multus-wphvm\" (UID: \"5597d831-70ad-4f2c-803d-8775135e6215\") " pod="openshift-multus/multus-wphvm"
Jul 20 12:44:49.760013 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.759348    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5597d831-70ad-4f2c-803d-8775135e6215-host-var-lib-kubelet\") pod \"multus-wphvm\" (UID: \"5597d831-70ad-4f2c-803d-8775135e6215\") " pod="openshift-multus/multus-wphvm"
Jul 20 12:44:49.760013 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.759717    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5597d831-70ad-4f2c-803d-8775135e6215-cni-binary-copy\") pod \"multus-wphvm\" (UID: \"5597d831-70ad-4f2c-803d-8775135e6215\") " pod="openshift-multus/multus-wphvm"
Jul 20 12:44:49.763434 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.763381    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1590374e-47ea-4c52-8ad0-c84873ec14c6-agent-certs\") pod \"konnectivity-agent-w7hxf\" (UID: \"1590374e-47ea-4c52-8ad0-c84873ec14c6\") " pod="kube-system/konnectivity-agent-w7hxf"
Jul 20 12:44:49.768715 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.768671    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9f2w4\" (UniqueName: \"kubernetes.io/projected/684e2cf7-4db4-4e84-a1e2-96d825a873d6-kube-api-access-9f2w4\") pod \"aws-ebs-csi-driver-node-rhlms\" (UID: \"684e2cf7-4db4-4e84-a1e2-96d825a873d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhlms"
Jul 20 12:44:49.769879 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.769856    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xftm6\" (UniqueName: \"kubernetes.io/projected/5597d831-70ad-4f2c-803d-8775135e6215-kube-api-access-xftm6\") pod \"multus-wphvm\" (UID: \"5597d831-70ad-4f2c-803d-8775135e6215\") " pod="openshift-multus/multus-wphvm"
Jul 20 12:44:49.770249 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.770227    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ms4xb\" (UniqueName: \"kubernetes.io/projected/50a9fa72-f7cd-4281-a6ae-6dce52580ba0-kube-api-access-ms4xb\") pod \"iptables-alerter-58x4n\" (UID: \"50a9fa72-f7cd-4281-a6ae-6dce52580ba0\") " pod="openshift-network-operator/iptables-alerter-58x4n"
Jul 20 12:44:49.809674 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.809616    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal" event={"ID":"a315493ff7ec57552d98ccbaa050d33e","Type":"ContainerStarted","Data":"f709360f36ce19b95ea3c299d9b7654421e847927a59f68934c4ec645d87902e"}
Jul 20 12:44:49.811492 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.811458    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-1.ec2.internal" event={"ID":"4359bec0e352431350db386bdadf6398","Type":"ContainerStarted","Data":"4c7e1cb810dc7ea4ec5b492d23d344fec872e223a8026f9b8e18aea8cacff2fb"}
Jul 20 12:44:49.834880 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.834846    2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 12:44:49.859352 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.859314    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8223a859-94ea-40ad-b31d-7ee1eb77834e-etc-systemd\") pod \"tuned-k9w5j\" (UID: \"8223a859-94ea-40ad-b31d-7ee1eb77834e\") " pod="openshift-cluster-node-tuning-operator/tuned-k9w5j"
Jul 20 12:44:49.859352 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.859363    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5efe9094-763c-4689-85b7-83e0ccb19811-host-cni-bin\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.859854 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.859394    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22rdv\" (UniqueName: \"kubernetes.io/projected/f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825-kube-api-access-22rdv\") pod \"multus-additional-cni-plugins-5fvsm\" (UID: \"f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825\") " pod="openshift-multus/multus-additional-cni-plugins-5fvsm"
Jul 20 12:44:49.859854 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.859420    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8223a859-94ea-40ad-b31d-7ee1eb77834e-etc-sysctl-d\") pod \"tuned-k9w5j\" (UID: \"8223a859-94ea-40ad-b31d-7ee1eb77834e\") " pod="openshift-cluster-node-tuning-operator/tuned-k9w5j"
Jul 20 12:44:49.859854 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.859446    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5fvsm\" (UID: \"f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825\") " pod="openshift-multus/multus-additional-cni-plugins-5fvsm"
Jul 20 12:44:49.859854 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.859472    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8223a859-94ea-40ad-b31d-7ee1eb77834e-tmp\") pod \"tuned-k9w5j\" (UID: \"8223a859-94ea-40ad-b31d-7ee1eb77834e\") " pod="openshift-cluster-node-tuning-operator/tuned-k9w5j"
Jul 20 12:44:49.859854 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.859494    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/591fe657-5268-4a39-b559-48e285b8e064-tmp-dir\") pod \"node-resolver-qvfnf\" (UID: \"591fe657-5268-4a39-b559-48e285b8e064\") " pod="openshift-dns/node-resolver-qvfnf"
Jul 20 12:44:49.859854 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.859520    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825-cni-binary-copy\") pod \"multus-additional-cni-plugins-5fvsm\" (UID: \"f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825\") " pod="openshift-multus/multus-additional-cni-plugins-5fvsm"
Jul 20 12:44:49.859854 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.859547    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5efe9094-763c-4689-85b7-83e0ccb19811-run-openvswitch\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.859854 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.859571    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8223a859-94ea-40ad-b31d-7ee1eb77834e-etc-modprobe-d\") pod \"tuned-k9w5j\" (UID: \"8223a859-94ea-40ad-b31d-7ee1eb77834e\") " pod="openshift-cluster-node-tuning-operator/tuned-k9w5j"
Jul 20 12:44:49.859854 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.859592    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8223a859-94ea-40ad-b31d-7ee1eb77834e-host\") pod \"tuned-k9w5j\" (UID: \"8223a859-94ea-40ad-b31d-7ee1eb77834e\") " pod="openshift-cluster-node-tuning-operator/tuned-k9w5j"
Jul 20 12:44:49.859854 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.859613    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/591fe657-5268-4a39-b559-48e285b8e064-hosts-file\") pod \"node-resolver-qvfnf\" (UID: \"591fe657-5268-4a39-b559-48e285b8e064\") " pod="openshift-dns/node-resolver-qvfnf"
Jul 20 12:44:49.859854 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.859637    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5efe9094-763c-4689-85b7-83e0ccb19811-host-kubelet\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.859854 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.859659    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5efe9094-763c-4689-85b7-83e0ccb19811-run-ovn\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.859854 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.859681    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5e87d68-a096-452b-a6b3-c0815771c37d-metrics-certs\") pod \"network-metrics-daemon-gn69x\" (UID: \"d5e87d68-a096-452b-a6b3-c0815771c37d\") " pod="openshift-multus/network-metrics-daemon-gn69x"
Jul 20 12:44:49.859854 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.859710    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5efe9094-763c-4689-85b7-83e0ccb19811-host-cni-netd\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.859854 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.859734    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6f1bf356-0007-494d-af6b-f42d5333291b-host\") pod \"node-ca-bmw8t\" (UID: \"6f1bf356-0007-494d-af6b-f42d5333291b\") " pod="openshift-image-registry/node-ca-bmw8t"
Jul 20 12:44:49.859854 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.859768    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6f1bf356-0007-494d-af6b-f42d5333291b-serviceca\") pod \"node-ca-bmw8t\" (UID: \"6f1bf356-0007-494d-af6b-f42d5333291b\") " pod="openshift-image-registry/node-ca-bmw8t"
Jul 20 12:44:49.859854 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.859798    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfhkj\" (UniqueName: \"kubernetes.io/projected/6f1bf356-0007-494d-af6b-f42d5333291b-kube-api-access-pfhkj\") pod \"node-ca-bmw8t\" (UID: \"6f1bf356-0007-494d-af6b-f42d5333291b\") " pod="openshift-image-registry/node-ca-bmw8t"
Jul 20 12:44:49.860898 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.859825    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5efe9094-763c-4689-85b7-83e0ccb19811-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.860898 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.859848    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5efe9094-763c-4689-85b7-83e0ccb19811-ovnkube-script-lib\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.860898 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.859871    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825-system-cni-dir\") pod \"multus-additional-cni-plugins-5fvsm\" (UID: \"f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825\") " pod="openshift-multus/multus-additional-cni-plugins-5fvsm"
Jul 20 12:44:49.860898 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.859894    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825-cnibin\") pod \"multus-additional-cni-plugins-5fvsm\" (UID: \"f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825\") " pod="openshift-multus/multus-additional-cni-plugins-5fvsm"
Jul 20 12:44:49.860898 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.859919    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5fvsm\" (UID: \"f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825\") " pod="openshift-multus/multus-additional-cni-plugins-5fvsm"
Jul 20 12:44:49.860898 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.859945    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5efe9094-763c-4689-85b7-83e0ccb19811-etc-openvswitch\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.860898 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.859969    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvfdv\" (UniqueName: \"kubernetes.io/projected/5efe9094-763c-4689-85b7-83e0ccb19811-kube-api-access-cvfdv\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.860898 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.859995    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfvjv\" (UniqueName: \"kubernetes.io/projected/591fe657-5268-4a39-b559-48e285b8e064-kube-api-access-cfvjv\") pod \"node-resolver-qvfnf\" (UID: \"591fe657-5268-4a39-b559-48e285b8e064\") " pod="openshift-dns/node-resolver-qvfnf"
Jul 20 12:44:49.860898 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.860015    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/591fe657-5268-4a39-b559-48e285b8e064-tmp-dir\") pod \"node-resolver-qvfnf\" (UID: \"591fe657-5268-4a39-b559-48e285b8e064\") " pod="openshift-dns/node-resolver-qvfnf"
Jul 20 12:44:49.860898 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.860018    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xb89w\" (UniqueName: \"kubernetes.io/projected/d5e87d68-a096-452b-a6b3-c0815771c37d-kube-api-access-xb89w\") pod \"network-metrics-daemon-gn69x\" (UID: \"d5e87d68-a096-452b-a6b3-c0815771c37d\") " pod="openshift-multus/network-metrics-daemon-gn69x"
Jul 20 12:44:49.860898 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.860052    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5efe9094-763c-4689-85b7-83e0ccb19811-log-socket\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.860898 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.860101    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5efe9094-763c-4689-85b7-83e0ccb19811-host-slash\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.860898 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.860125    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5efe9094-763c-4689-85b7-83e0ccb19811-run-systemd\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.860898 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.860135    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8223a859-94ea-40ad-b31d-7ee1eb77834e-etc-systemd\") pod \"tuned-k9w5j\" (UID: \"8223a859-94ea-40ad-b31d-7ee1eb77834e\") " pod="openshift-cluster-node-tuning-operator/tuned-k9w5j"
Jul 20 12:44:49.860898 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.860149    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5efe9094-763c-4689-85b7-83e0ccb19811-node-log\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.860898 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.860174    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8223a859-94ea-40ad-b31d-7ee1eb77834e-sys\") pod \"tuned-k9w5j\" (UID: \"8223a859-94ea-40ad-b31d-7ee1eb77834e\") " pod="openshift-cluster-node-tuning-operator/tuned-k9w5j"
Jul 20 12:44:49.860898 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.860180    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5efe9094-763c-4689-85b7-83e0ccb19811-host-cni-bin\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.861963 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.860198    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5efe9094-763c-4689-85b7-83e0ccb19811-systemd-units\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.861963 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.860222    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5efe9094-763c-4689-85b7-83e0ccb19811-host-run-netns\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.861963 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.860246    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5efe9094-763c-4689-85b7-83e0ccb19811-ovnkube-config\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.861963 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.860254    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5efe9094-763c-4689-85b7-83e0ccb19811-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.861963 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.860267    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8223a859-94ea-40ad-b31d-7ee1eb77834e-run\") pod \"tuned-k9w5j\" (UID: \"8223a859-94ea-40ad-b31d-7ee1eb77834e\") " pod="openshift-cluster-node-tuning-operator/tuned-k9w5j"
Jul 20 12:44:49.861963 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.860290    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8223a859-94ea-40ad-b31d-7ee1eb77834e-lib-modules\") pod \"tuned-k9w5j\" (UID: \"8223a859-94ea-40ad-b31d-7ee1eb77834e\") " pod="openshift-cluster-node-tuning-operator/tuned-k9w5j"
Jul 20 12:44:49.861963 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.860313    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825-os-release\") pod \"multus-additional-cni-plugins-5fvsm\" (UID: \"f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825\") " pod="openshift-multus/multus-additional-cni-plugins-5fvsm"
Jul 20 12:44:49.861963 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.860337    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5efe9094-763c-4689-85b7-83e0ccb19811-var-lib-openvswitch\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.861963 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.860360    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8223a859-94ea-40ad-b31d-7ee1eb77834e-etc-tuned\") pod \"tuned-k9w5j\" (UID: \"8223a859-94ea-40ad-b31d-7ee1eb77834e\") " pod="openshift-cluster-node-tuning-operator/tuned-k9w5j"
Jul 20 12:44:49.861963 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.860383    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwzhh\" (UniqueName: \"kubernetes.io/projected/8223a859-94ea-40ad-b31d-7ee1eb77834e-kube-api-access-jwzhh\") pod \"tuned-k9w5j\" (UID: \"8223a859-94ea-40ad-b31d-7ee1eb77834e\") " pod="openshift-cluster-node-tuning-operator/tuned-k9w5j"
Jul 20 12:44:49.861963 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.860421    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpqcr\" (UniqueName: \"kubernetes.io/projected/d63473a8-86d8-4ad9-a2b0-26a3ab221c57-kube-api-access-vpqcr\") pod \"network-check-target-nt9ss\" (UID: \"d63473a8-86d8-4ad9-a2b0-26a3ab221c57\") " pod="openshift-network-diagnostics/network-check-target-nt9ss"
Jul 20 12:44:49.861963 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.860463    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5efe9094-763c-4689-85b7-83e0ccb19811-host-run-ovn-kubernetes\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.861963 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.860488    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5efe9094-763c-4689-85b7-83e0ccb19811-ovn-node-metrics-cert\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.861963 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.860515    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8223a859-94ea-40ad-b31d-7ee1eb77834e-var-lib-kubelet\") pod \"tuned-k9w5j\" (UID: \"8223a859-94ea-40ad-b31d-7ee1eb77834e\") " pod="openshift-cluster-node-tuning-operator/tuned-k9w5j"
Jul 20 12:44:49.861963 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.860542    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5efe9094-763c-4689-85b7-83e0ccb19811-env-overrides\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.861963 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.860558    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8223a859-94ea-40ad-b31d-7ee1eb77834e-etc-sysctl-d\") pod \"tuned-k9w5j\" (UID: \"8223a859-94ea-40ad-b31d-7ee1eb77834e\") " pod="openshift-cluster-node-tuning-operator/tuned-k9w5j"
Jul 20 12:44:49.861963 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.860572    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8223a859-94ea-40ad-b31d-7ee1eb77834e-etc-sysconfig\") pod \"tuned-k9w5j\" (UID: \"8223a859-94ea-40ad-b31d-7ee1eb77834e\") " pod="openshift-cluster-node-tuning-operator/tuned-k9w5j"
Jul 20 12:44:49.863014 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.860594    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8223a859-94ea-40ad-b31d-7ee1eb77834e-etc-sysctl-conf\") pod \"tuned-k9w5j\" (UID: \"8223a859-94ea-40ad-b31d-7ee1eb77834e\") " pod="openshift-cluster-node-tuning-operator/tuned-k9w5j"
Jul 20 12:44:49.863014 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.860633    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5fvsm\" (UID: \"f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825\") " pod="openshift-multus/multus-additional-cni-plugins-5fvsm"
Jul 20 12:44:49.863014 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.860663    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8223a859-94ea-40ad-b31d-7ee1eb77834e-etc-kubernetes\") pod \"tuned-k9w5j\" (UID: \"8223a859-94ea-40ad-b31d-7ee1eb77834e\") " pod="openshift-cluster-node-tuning-operator/tuned-k9w5j"
Jul 20 12:44:49.863014 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.860730    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8223a859-94ea-40ad-b31d-7ee1eb77834e-etc-sysctl-conf\") pod \"tuned-k9w5j\" (UID: \"8223a859-94ea-40ad-b31d-7ee1eb77834e\") " pod="openshift-cluster-node-tuning-operator/tuned-k9w5j"
Jul 20 12:44:49.863014 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.860747    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8223a859-94ea-40ad-b31d-7ee1eb77834e-etc-kubernetes\") pod \"tuned-k9w5j\" (UID: \"8223a859-94ea-40ad-b31d-7ee1eb77834e\") " pod="openshift-cluster-node-tuning-operator/tuned-k9w5j"
Jul 20 12:44:49.863014 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.860771    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5efe9094-763c-4689-85b7-83e0ccb19811-systemd-units\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.863014 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.860811    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825-cni-binary-copy\") pod \"multus-additional-cni-plugins-5fvsm\" (UID: \"f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825\") " pod="openshift-multus/multus-additional-cni-plugins-5fvsm"
Jul 20 12:44:49.863014 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.860875    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5efe9094-763c-4689-85b7-83e0ccb19811-run-openvswitch\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.863014 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.860976    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8223a859-94ea-40ad-b31d-7ee1eb77834e-etc-modprobe-d\") pod \"tuned-k9w5j\" (UID: \"8223a859-94ea-40ad-b31d-7ee1eb77834e\") " pod="openshift-cluster-node-tuning-operator/tuned-k9w5j"
Jul 20 12:44:49.863014 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.860980    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5fvsm\" (UID: \"f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825\") " pod="openshift-multus/multus-additional-cni-plugins-5fvsm"
Jul 20 12:44:49.863014 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.861037    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8223a859-94ea-40ad-b31d-7ee1eb77834e-host\") pod \"tuned-k9w5j\" (UID: \"8223a859-94ea-40ad-b31d-7ee1eb77834e\") " pod="openshift-cluster-node-tuning-operator/tuned-k9w5j"
Jul 20 12:44:49.863014 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.861052    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5efe9094-763c-4689-85b7-83e0ccb19811-host-run-ovn-kubernetes\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.863014 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.861077    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5efe9094-763c-4689-85b7-83e0ccb19811-host-run-netns\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.863014 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.861111    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/591fe657-5268-4a39-b559-48e285b8e064-hosts-file\") pod \"node-resolver-qvfnf\" (UID: \"591fe657-5268-4a39-b559-48e285b8e064\") " pod="openshift-dns/node-resolver-qvfnf"
Jul 20 12:44:49.863014 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.861114    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5efe9094-763c-4689-85b7-83e0ccb19811-host-kubelet\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.863014 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.861147    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5efe9094-763c-4689-85b7-83e0ccb19811-run-ovn\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.863014 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.861190    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825-system-cni-dir\") pod \"multus-additional-cni-plugins-5fvsm\" (UID: \"f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825\") " pod="openshift-multus/multus-additional-cni-plugins-5fvsm"
Jul 20 12:44:49.863860 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.861251    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5efe9094-763c-4689-85b7-83e0ccb19811-host-slash\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.863860 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:49.861260    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 12:44:49.863860 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.861284    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5efe9094-763c-4689-85b7-83e0ccb19811-log-socket\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.863860 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.861326    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5efe9094-763c-4689-85b7-83e0ccb19811-host-cni-netd\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.863860 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.861345    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5efe9094-763c-4689-85b7-83e0ccb19811-ovnkube-script-lib\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.863860 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.861374    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6f1bf356-0007-494d-af6b-f42d5333291b-host\") pod \"node-ca-bmw8t\" (UID: \"6f1bf356-0007-494d-af6b-f42d5333291b\") " pod="openshift-image-registry/node-ca-bmw8t"
Jul 20 12:44:49.863860 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.861386    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5efe9094-763c-4689-85b7-83e0ccb19811-env-overrides\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.863860 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.861395    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825-cnibin\") pod \"multus-additional-cni-plugins-5fvsm\" (UID: \"f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825\") " pod="openshift-multus/multus-additional-cni-plugins-5fvsm"
Jul 20 12:44:49.863860 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.861405    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5efe9094-763c-4689-85b7-83e0ccb19811-node-log\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.863860 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.861448    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8223a859-94ea-40ad-b31d-7ee1eb77834e-etc-sysconfig\") pod \"tuned-k9w5j\" (UID: \"8223a859-94ea-40ad-b31d-7ee1eb77834e\") " pod="openshift-cluster-node-tuning-operator/tuned-k9w5j"
Jul 20 12:44:49.863860 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.861190    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8223a859-94ea-40ad-b31d-7ee1eb77834e-run\") pod \"tuned-k9w5j\" (UID: \"8223a859-94ea-40ad-b31d-7ee1eb77834e\") " pod="openshift-cluster-node-tuning-operator/tuned-k9w5j"
Jul 20 12:44:49.863860 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.861542    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5fvsm\" (UID: \"f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825\") " pod="openshift-multus/multus-additional-cni-plugins-5fvsm"
Jul 20 12:44:49.863860 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.861578    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5efe9094-763c-4689-85b7-83e0ccb19811-etc-openvswitch\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.863860 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.861625    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8223a859-94ea-40ad-b31d-7ee1eb77834e-sys\") pod \"tuned-k9w5j\" (UID: \"8223a859-94ea-40ad-b31d-7ee1eb77834e\") " pod="openshift-cluster-node-tuning-operator/tuned-k9w5j"
Jul 20 12:44:49.863860 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.861627    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5efe9094-763c-4689-85b7-83e0ccb19811-run-systemd\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.863860 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.861678    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8223a859-94ea-40ad-b31d-7ee1eb77834e-var-lib-kubelet\") pod \"tuned-k9w5j\" (UID: \"8223a859-94ea-40ad-b31d-7ee1eb77834e\") " pod="openshift-cluster-node-tuning-operator/tuned-k9w5j"
Jul 20 12:44:49.863860 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.861703    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825-os-release\") pod \"multus-additional-cni-plugins-5fvsm\" (UID: \"f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825\") " pod="openshift-multus/multus-additional-cni-plugins-5fvsm"
Jul 20 12:44:49.863860 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.861739    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5efe9094-763c-4689-85b7-83e0ccb19811-var-lib-openvswitch\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.864735 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.861810    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8223a859-94ea-40ad-b31d-7ee1eb77834e-lib-modules\") pod \"tuned-k9w5j\" (UID: \"8223a859-94ea-40ad-b31d-7ee1eb77834e\") " pod="openshift-cluster-node-tuning-operator/tuned-k9w5j"
Jul 20 12:44:49.864735 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.861810    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6f1bf356-0007-494d-af6b-f42d5333291b-serviceca\") pod \"node-ca-bmw8t\" (UID: \"6f1bf356-0007-494d-af6b-f42d5333291b\") " pod="openshift-image-registry/node-ca-bmw8t"
Jul 20 12:44:49.864735 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:49.862134    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5e87d68-a096-452b-a6b3-c0815771c37d-metrics-certs podName:d5e87d68-a096-452b-a6b3-c0815771c37d nodeName:}" failed. No retries permitted until 2026-07-20 12:44:50.362109292 +0000 UTC m=+3.117158657 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5e87d68-a096-452b-a6b3-c0815771c37d-metrics-certs") pod "network-metrics-daemon-gn69x" (UID: "d5e87d68-a096-452b-a6b3-c0815771c37d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 12:44:49.864735 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.862134    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5fvsm\" (UID: \"f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825\") " pod="openshift-multus/multus-additional-cni-plugins-5fvsm"
Jul 20 12:44:49.864735 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.862281    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5efe9094-763c-4689-85b7-83e0ccb19811-ovnkube-config\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.865304 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.865232    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8223a859-94ea-40ad-b31d-7ee1eb77834e-tmp\") pod \"tuned-k9w5j\" (UID: \"8223a859-94ea-40ad-b31d-7ee1eb77834e\") " pod="openshift-cluster-node-tuning-operator/tuned-k9w5j"
Jul 20 12:44:49.867024 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.866997    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5efe9094-763c-4689-85b7-83e0ccb19811-ovn-node-metrics-cert\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.867632 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.867523    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8223a859-94ea-40ad-b31d-7ee1eb77834e-etc-tuned\") pod \"tuned-k9w5j\" (UID: \"8223a859-94ea-40ad-b31d-7ee1eb77834e\") " pod="openshift-cluster-node-tuning-operator/tuned-k9w5j"
Jul 20 12:44:49.870241 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.870216    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22rdv\" (UniqueName: \"kubernetes.io/projected/f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825-kube-api-access-22rdv\") pod \"multus-additional-cni-plugins-5fvsm\" (UID: \"f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825\") " pod="openshift-multus/multus-additional-cni-plugins-5fvsm"
Jul 20 12:44:49.870934 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:49.870607    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 12:44:49.870934 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:49.870630    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 12:44:49.870934 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:49.870645    2570 projected.go:196] Error preparing data for projected volume kube-api-access-vpqcr for pod openshift-network-diagnostics/network-check-target-nt9ss: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 12:44:49.870934 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:49.870707    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d63473a8-86d8-4ad9-a2b0-26a3ab221c57-kube-api-access-vpqcr podName:d63473a8-86d8-4ad9-a2b0-26a3ab221c57 nodeName:}" failed. No retries permitted until 2026-07-20 12:44:50.370689984 +0000 UTC m=+3.125739354 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vpqcr" (UniqueName: "kubernetes.io/projected/d63473a8-86d8-4ad9-a2b0-26a3ab221c57-kube-api-access-vpqcr") pod "network-check-target-nt9ss" (UID: "d63473a8-86d8-4ad9-a2b0-26a3ab221c57") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 12:44:49.872417 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.872370    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xb89w\" (UniqueName: \"kubernetes.io/projected/d5e87d68-a096-452b-a6b3-c0815771c37d-kube-api-access-xb89w\") pod \"network-metrics-daemon-gn69x\" (UID: \"d5e87d68-a096-452b-a6b3-c0815771c37d\") " pod="openshift-multus/network-metrics-daemon-gn69x"
Jul 20 12:44:49.873025 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.872682    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwzhh\" (UniqueName: \"kubernetes.io/projected/8223a859-94ea-40ad-b31d-7ee1eb77834e-kube-api-access-jwzhh\") pod \"tuned-k9w5j\" (UID: \"8223a859-94ea-40ad-b31d-7ee1eb77834e\") " pod="openshift-cluster-node-tuning-operator/tuned-k9w5j"
Jul 20 12:44:49.874984 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.874952    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfhkj\" (UniqueName: \"kubernetes.io/projected/6f1bf356-0007-494d-af6b-f42d5333291b-kube-api-access-pfhkj\") pod \"node-ca-bmw8t\" (UID: \"6f1bf356-0007-494d-af6b-f42d5333291b\") " pod="openshift-image-registry/node-ca-bmw8t"
Jul 20 12:44:49.875519 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.875496    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvfdv\" (UniqueName: \"kubernetes.io/projected/5efe9094-763c-4689-85b7-83e0ccb19811-kube-api-access-cvfdv\") pod \"ovnkube-node-rhdn8\" (UID: \"5efe9094-763c-4689-85b7-83e0ccb19811\") " pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:49.877145 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.877102    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfvjv\" (UniqueName: \"kubernetes.io/projected/591fe657-5268-4a39-b559-48e285b8e064-kube-api-access-cfvjv\") pod \"node-resolver-qvfnf\" (UID: \"591fe657-5268-4a39-b559-48e285b8e064\") " pod="openshift-dns/node-resolver-qvfnf"
Jul 20 12:44:49.945023 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.944891    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-w7hxf"
Jul 20 12:44:49.956756 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.956695    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-58x4n"
Jul 20 12:44:49.966373 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.966185    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhlms"
Jul 20 12:44:49.973407 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.973274    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wphvm"
Jul 20 12:44:49.980078 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.980046    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k9w5j"
Jul 20 12:44:49.987836 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.987814    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qvfnf"
Jul 20 12:44:49.994411 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:49.994381    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bmw8t"
Jul 20 12:44:50.003096 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:50.003059    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:44:50.010458 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:50.010439    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5fvsm"
Jul 20 12:44:50.262814 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:50.262735    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5fbafa93-14fa-41b3-a202-eb69336c381e-original-pull-secret\") pod \"global-pull-secret-syncer-4dkkp\" (UID: \"5fbafa93-14fa-41b3-a202-eb69336c381e\") " pod="kube-system/global-pull-secret-syncer-4dkkp"
Jul 20 12:44:50.262958 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:50.262859    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 12:44:50.262958 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:50.262927    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fbafa93-14fa-41b3-a202-eb69336c381e-original-pull-secret podName:5fbafa93-14fa-41b3-a202-eb69336c381e nodeName:}" failed. No retries permitted until 2026-07-20 12:44:51.262908332 +0000 UTC m=+4.017957688 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5fbafa93-14fa-41b3-a202-eb69336c381e-original-pull-secret") pod "global-pull-secret-syncer-4dkkp" (UID: "5fbafa93-14fa-41b3-a202-eb69336c381e") : object "kube-system"/"original-pull-secret" not registered
Jul 20 12:44:50.363727 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:50.363667    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5e87d68-a096-452b-a6b3-c0815771c37d-metrics-certs\") pod \"network-metrics-daemon-gn69x\" (UID: \"d5e87d68-a096-452b-a6b3-c0815771c37d\") " pod="openshift-multus/network-metrics-daemon-gn69x"
Jul 20 12:44:50.363923 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:50.363833    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 12:44:50.363923 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:50.363901    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5e87d68-a096-452b-a6b3-c0815771c37d-metrics-certs podName:d5e87d68-a096-452b-a6b3-c0815771c37d nodeName:}" failed. No retries permitted until 2026-07-20 12:44:51.363880707 +0000 UTC m=+4.118930073 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5e87d68-a096-452b-a6b3-c0815771c37d-metrics-certs") pod "network-metrics-daemon-gn69x" (UID: "d5e87d68-a096-452b-a6b3-c0815771c37d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 12:44:50.464138 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:50.464097    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpqcr\" (UniqueName: \"kubernetes.io/projected/d63473a8-86d8-4ad9-a2b0-26a3ab221c57-kube-api-access-vpqcr\") pod \"network-check-target-nt9ss\" (UID: \"d63473a8-86d8-4ad9-a2b0-26a3ab221c57\") " pod="openshift-network-diagnostics/network-check-target-nt9ss"
Jul 20 12:44:50.464321 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:50.464240    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 12:44:50.464321 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:50.464259    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 12:44:50.464321 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:50.464272    2570 projected.go:196] Error preparing data for projected volume kube-api-access-vpqcr for pod openshift-network-diagnostics/network-check-target-nt9ss: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 12:44:50.464469 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:50.464335    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d63473a8-86d8-4ad9-a2b0-26a3ab221c57-kube-api-access-vpqcr podName:d63473a8-86d8-4ad9-a2b0-26a3ab221c57 nodeName:}" failed. No retries permitted until 2026-07-20 12:44:51.464317366 +0000 UTC m=+4.219366718 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vpqcr" (UniqueName: "kubernetes.io/projected/d63473a8-86d8-4ad9-a2b0-26a3ab221c57-kube-api-access-vpqcr") pod "network-check-target-nt9ss" (UID: "d63473a8-86d8-4ad9-a2b0-26a3ab221c57") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 12:44:50.685388 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:50.685293    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 12:39:49 +0000 UTC" deadline="2028-01-05 19:01:15.00422081 +0000 UTC"
Jul 20 12:44:50.685388 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:50.685332    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12822h16m24.318893523s"
Jul 20 12:44:50.802295 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:50.802259    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn69x"
Jul 20 12:44:50.802478 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:50.802404    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gn69x" podUID="d5e87d68-a096-452b-a6b3-c0815771c37d"
Jul 20 12:44:50.802478 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:50.802458    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dkkp"
Jul 20 12:44:50.802611 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:50.802562    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dkkp" podUID="5fbafa93-14fa-41b3-a202-eb69336c381e"
Jul 20 12:44:50.895110 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:50.895070    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50a9fa72_f7cd_4281_a6ae_6dce52580ba0.slice/crio-2f3ca20c6d9f8e33c15c53539ba66c26bfe3767316c6282a85f1d19c7e2e09bd WatchSource:0}: Error finding container 2f3ca20c6d9f8e33c15c53539ba66c26bfe3767316c6282a85f1d19c7e2e09bd: Status 404 returned error can't find the container with id 2f3ca20c6d9f8e33c15c53539ba66c26bfe3767316c6282a85f1d19c7e2e09bd
Jul 20 12:44:50.896418 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:50.896383    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8223a859_94ea_40ad_b31d_7ee1eb77834e.slice/crio-d3d2d846a83925f403cc82f4b2690d0a168e9de231a7dd37ee18ef8103b89d0d WatchSource:0}: Error finding container d3d2d846a83925f403cc82f4b2690d0a168e9de231a7dd37ee18ef8103b89d0d: Status 404 returned error can't find the container with id d3d2d846a83925f403cc82f4b2690d0a168e9de231a7dd37ee18ef8103b89d0d
Jul 20 12:44:50.899248 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:50.899226    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod684e2cf7_4db4_4e84_a1e2_96d825a873d6.slice/crio-b3a5cc0a972a31c96cd6de2d8355028abf45fe8bd6ba3d702274c9d781e99215 WatchSource:0}: Error finding container b3a5cc0a972a31c96cd6de2d8355028abf45fe8bd6ba3d702274c9d781e99215: Status 404 returned error can't find the container with id b3a5cc0a972a31c96cd6de2d8355028abf45fe8bd6ba3d702274c9d781e99215
Jul 20 12:44:50.900295 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:50.900275    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f1bf356_0007_494d_af6b_f42d5333291b.slice/crio-80e2c14a880ff8c8f3c4cec73155a0d7c53bf3e883bd8655b0bde768c6f911fb WatchSource:0}: Error finding container 80e2c14a880ff8c8f3c4cec73155a0d7c53bf3e883bd8655b0bde768c6f911fb: Status 404 returned error can't find the container with id 80e2c14a880ff8c8f3c4cec73155a0d7c53bf3e883bd8655b0bde768c6f911fb
Jul 20 12:44:50.921859 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:50.921818    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod591fe657_5268_4a39_b559_48e285b8e064.slice/crio-7d5b311783dbd96fdd982601470c850d398eb32d97b06ddd2750c167776d5c9f WatchSource:0}: Error finding container 7d5b311783dbd96fdd982601470c850d398eb32d97b06ddd2750c167776d5c9f: Status 404 returned error can't find the container with id 7d5b311783dbd96fdd982601470c850d398eb32d97b06ddd2750c167776d5c9f
Jul 20 12:44:50.922427 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:50.922375    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5efe9094_763c_4689_85b7_83e0ccb19811.slice/crio-370f58cdd003f1b5c0a73b8f49225f2f60556162955dfa733a8fe200120b148a WatchSource:0}: Error finding container 370f58cdd003f1b5c0a73b8f49225f2f60556162955dfa733a8fe200120b148a: Status 404 returned error can't find the container with id 370f58cdd003f1b5c0a73b8f49225f2f60556162955dfa733a8fe200120b148a
Jul 20 12:44:50.923221 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:50.923200    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1590374e_47ea_4c52_8ad0_c84873ec14c6.slice/crio-452f7c630e1c28e4017711774e5991fe34e40d5cb437562966daf8e4010a8812 WatchSource:0}: Error finding container 452f7c630e1c28e4017711774e5991fe34e40d5cb437562966daf8e4010a8812: Status 404 returned error can't find the container with id 452f7c630e1c28e4017711774e5991fe34e40d5cb437562966daf8e4010a8812
Jul 20 12:44:50.925032 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:50.924999    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7b2c7e2_c533_483d_a2ed_d6f1c2ffb825.slice/crio-ee18ae4d93b93c8d6a45310e0dfae86e44b09dfa240b45dcd88cb90582a4d7b4 WatchSource:0}: Error finding container ee18ae4d93b93c8d6a45310e0dfae86e44b09dfa240b45dcd88cb90582a4d7b4: Status 404 returned error can't find the container with id ee18ae4d93b93c8d6a45310e0dfae86e44b09dfa240b45dcd88cb90582a4d7b4
Jul 20 12:44:50.925618 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:44:50.925597    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5597d831_70ad_4f2c_803d_8775135e6215.slice/crio-adf3a557e99055ce9ae6b69451e852477e974dd636ba18ec3dc456a372135ce1 WatchSource:0}: Error finding container adf3a557e99055ce9ae6b69451e852477e974dd636ba18ec3dc456a372135ce1: Status 404 returned error can't find the container with id adf3a557e99055ce9ae6b69451e852477e974dd636ba18ec3dc456a372135ce1
Jul 20 12:44:51.269531 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:51.269296    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5fbafa93-14fa-41b3-a202-eb69336c381e-original-pull-secret\") pod \"global-pull-secret-syncer-4dkkp\" (UID: \"5fbafa93-14fa-41b3-a202-eb69336c381e\") " pod="kube-system/global-pull-secret-syncer-4dkkp"
Jul 20 12:44:51.269531 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:51.269460    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 12:44:51.269699 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:51.269581    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fbafa93-14fa-41b3-a202-eb69336c381e-original-pull-secret podName:5fbafa93-14fa-41b3-a202-eb69336c381e nodeName:}" failed. No retries permitted until 2026-07-20 12:44:53.269566919 +0000 UTC m=+6.024616272 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5fbafa93-14fa-41b3-a202-eb69336c381e-original-pull-secret") pod "global-pull-secret-syncer-4dkkp" (UID: "5fbafa93-14fa-41b3-a202-eb69336c381e") : object "kube-system"/"original-pull-secret" not registered
Jul 20 12:44:51.370123 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:51.370071    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5e87d68-a096-452b-a6b3-c0815771c37d-metrics-certs\") pod \"network-metrics-daemon-gn69x\" (UID: \"d5e87d68-a096-452b-a6b3-c0815771c37d\") " pod="openshift-multus/network-metrics-daemon-gn69x"
Jul 20 12:44:51.370295 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:51.370217    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 12:44:51.370295 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:51.370279    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5e87d68-a096-452b-a6b3-c0815771c37d-metrics-certs podName:d5e87d68-a096-452b-a6b3-c0815771c37d nodeName:}" failed. No retries permitted until 2026-07-20 12:44:53.3702639 +0000 UTC m=+6.125313252 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5e87d68-a096-452b-a6b3-c0815771c37d-metrics-certs") pod "network-metrics-daemon-gn69x" (UID: "d5e87d68-a096-452b-a6b3-c0815771c37d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 12:44:51.471373 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:51.470707    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpqcr\" (UniqueName: \"kubernetes.io/projected/d63473a8-86d8-4ad9-a2b0-26a3ab221c57-kube-api-access-vpqcr\") pod \"network-check-target-nt9ss\" (UID: \"d63473a8-86d8-4ad9-a2b0-26a3ab221c57\") " pod="openshift-network-diagnostics/network-check-target-nt9ss"
Jul 20 12:44:51.471373 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:51.470881    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 12:44:51.471373 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:51.470906    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 12:44:51.471373 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:51.470918    2570 projected.go:196] Error preparing data for projected volume kube-api-access-vpqcr for pod openshift-network-diagnostics/network-check-target-nt9ss: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 12:44:51.471373 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:51.470978    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d63473a8-86d8-4ad9-a2b0-26a3ab221c57-kube-api-access-vpqcr podName:d63473a8-86d8-4ad9-a2b0-26a3ab221c57 nodeName:}" failed. No retries permitted until 2026-07-20 12:44:53.470958102 +0000 UTC m=+6.226007455 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vpqcr" (UniqueName: "kubernetes.io/projected/d63473a8-86d8-4ad9-a2b0-26a3ab221c57-kube-api-access-vpqcr") pod "network-check-target-nt9ss" (UID: "d63473a8-86d8-4ad9-a2b0-26a3ab221c57") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 12:44:51.686070 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:51.685861    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 12:39:49 +0000 UTC" deadline="2028-02-09 17:02:00.357906378 +0000 UTC"
Jul 20 12:44:51.686070 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:51.685979    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13660h17m8.67193197s"
Jul 20 12:44:51.808569 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:51.807955    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nt9ss"
Jul 20 12:44:51.808569 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:51.808158    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nt9ss" podUID="d63473a8-86d8-4ad9-a2b0-26a3ab221c57"
Jul 20 12:44:51.828343 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:51.828262    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bmw8t" event={"ID":"6f1bf356-0007-494d-af6b-f42d5333291b","Type":"ContainerStarted","Data":"80e2c14a880ff8c8f3c4cec73155a0d7c53bf3e883bd8655b0bde768c6f911fb"}
Jul 20 12:44:51.830467 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:51.830375    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhlms" event={"ID":"684e2cf7-4db4-4e84-a1e2-96d825a873d6","Type":"ContainerStarted","Data":"b3a5cc0a972a31c96cd6de2d8355028abf45fe8bd6ba3d702274c9d781e99215"}
Jul 20 12:44:51.843452 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:51.843413    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-1.ec2.internal" event={"ID":"4359bec0e352431350db386bdadf6398","Type":"ContainerStarted","Data":"ec362f1ed793c160df13f07f5dca9a9c3d20d3e337077475c4d29b79646a190e"}
Jul 20 12:44:51.854463 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:51.854430    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wphvm" event={"ID":"5597d831-70ad-4f2c-803d-8775135e6215","Type":"ContainerStarted","Data":"adf3a557e99055ce9ae6b69451e852477e974dd636ba18ec3dc456a372135ce1"}
Jul 20 12:44:51.857343 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:51.857311    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5fvsm" event={"ID":"f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825","Type":"ContainerStarted","Data":"ee18ae4d93b93c8d6a45310e0dfae86e44b09dfa240b45dcd88cb90582a4d7b4"}
Jul 20 12:44:51.859346 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:51.859287    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-w7hxf" event={"ID":"1590374e-47ea-4c52-8ad0-c84873ec14c6","Type":"ContainerStarted","Data":"452f7c630e1c28e4017711774e5991fe34e40d5cb437562966daf8e4010a8812"}
Jul 20 12:44:51.859673 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:51.859626    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-1.ec2.internal" podStartSLOduration=2.859607951 podStartE2EDuration="2.859607951s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 12:44:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:44:51.859285868 +0000 UTC m=+4.614335256" watchObservedRunningTime="2026-07-20 12:44:51.859607951 +0000 UTC m=+4.614657328"
Jul 20 12:44:51.868763 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:51.868731    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qvfnf" event={"ID":"591fe657-5268-4a39-b559-48e285b8e064","Type":"ContainerStarted","Data":"7d5b311783dbd96fdd982601470c850d398eb32d97b06ddd2750c167776d5c9f"}
Jul 20 12:44:51.873326 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:51.873292    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k9w5j" event={"ID":"8223a859-94ea-40ad-b31d-7ee1eb77834e","Type":"ContainerStarted","Data":"d3d2d846a83925f403cc82f4b2690d0a168e9de231a7dd37ee18ef8103b89d0d"}
Jul 20 12:44:51.877832 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:51.877804    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-58x4n" event={"ID":"50a9fa72-f7cd-4281-a6ae-6dce52580ba0","Type":"ContainerStarted","Data":"2f3ca20c6d9f8e33c15c53539ba66c26bfe3767316c6282a85f1d19c7e2e09bd"}
Jul 20 12:44:51.900845 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:51.900808    2570 generic.go:356] "Generic (PLEG): container finished" podID="a315493ff7ec57552d98ccbaa050d33e" containerID="4c6ca222d7d6e46666f7d07a988ee8ac0d82ff8303569b89deb02c3ee4f15081" exitCode=0
Jul 20 12:44:51.901204 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:51.901177    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal" event={"ID":"a315493ff7ec57552d98ccbaa050d33e","Type":"ContainerDied","Data":"4c6ca222d7d6e46666f7d07a988ee8ac0d82ff8303569b89deb02c3ee4f15081"}
Jul 20 12:44:51.914255 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:51.914220    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8" event={"ID":"5efe9094-763c-4689-85b7-83e0ccb19811","Type":"ContainerStarted","Data":"370f58cdd003f1b5c0a73b8f49225f2f60556162955dfa733a8fe200120b148a"}
Jul 20 12:44:52.801678 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:52.801649    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dkkp"
Jul 20 12:44:52.802191 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:52.801780    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dkkp" podUID="5fbafa93-14fa-41b3-a202-eb69336c381e"
Jul 20 12:44:52.802191 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:52.802185    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn69x"
Jul 20 12:44:52.802395 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:52.802335    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gn69x" podUID="d5e87d68-a096-452b-a6b3-c0815771c37d"
Jul 20 12:44:52.925456 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:52.924190    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal" event={"ID":"a315493ff7ec57552d98ccbaa050d33e","Type":"ContainerStarted","Data":"7466e69c9c392676b6f05b09a19702aed8e20aec998bd356a33c3c013405dab5"}
Jul 20 12:44:52.940222 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:52.940163    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal" podStartSLOduration=3.940139052 podStartE2EDuration="3.940139052s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 12:44:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:44:52.939709003 +0000 UTC m=+5.694758379" watchObservedRunningTime="2026-07-20 12:44:52.940139052 +0000 UTC m=+5.695188418"
Jul 20 12:44:53.289924 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:53.289832    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5fbafa93-14fa-41b3-a202-eb69336c381e-original-pull-secret\") pod \"global-pull-secret-syncer-4dkkp\" (UID: \"5fbafa93-14fa-41b3-a202-eb69336c381e\") " pod="kube-system/global-pull-secret-syncer-4dkkp"
Jul 20 12:44:53.290114 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:53.290018    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 12:44:53.290195 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:53.290121    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fbafa93-14fa-41b3-a202-eb69336c381e-original-pull-secret podName:5fbafa93-14fa-41b3-a202-eb69336c381e nodeName:}" failed. No retries permitted until 2026-07-20 12:44:57.290063595 +0000 UTC m=+10.045112947 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5fbafa93-14fa-41b3-a202-eb69336c381e-original-pull-secret") pod "global-pull-secret-syncer-4dkkp" (UID: "5fbafa93-14fa-41b3-a202-eb69336c381e") : object "kube-system"/"original-pull-secret" not registered
Jul 20 12:44:53.391006 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:53.390967    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5e87d68-a096-452b-a6b3-c0815771c37d-metrics-certs\") pod \"network-metrics-daemon-gn69x\" (UID: \"d5e87d68-a096-452b-a6b3-c0815771c37d\") " pod="openshift-multus/network-metrics-daemon-gn69x"
Jul 20 12:44:53.391195 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:53.391146    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 12:44:53.391270 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:53.391212    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5e87d68-a096-452b-a6b3-c0815771c37d-metrics-certs podName:d5e87d68-a096-452b-a6b3-c0815771c37d nodeName:}" failed. No retries permitted until 2026-07-20 12:44:57.391191706 +0000 UTC m=+10.146241075 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5e87d68-a096-452b-a6b3-c0815771c37d-metrics-certs") pod "network-metrics-daemon-gn69x" (UID: "d5e87d68-a096-452b-a6b3-c0815771c37d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 12:44:53.491855 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:53.491815    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpqcr\" (UniqueName: \"kubernetes.io/projected/d63473a8-86d8-4ad9-a2b0-26a3ab221c57-kube-api-access-vpqcr\") pod \"network-check-target-nt9ss\" (UID: \"d63473a8-86d8-4ad9-a2b0-26a3ab221c57\") " pod="openshift-network-diagnostics/network-check-target-nt9ss"
Jul 20 12:44:53.492048 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:53.492027    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 12:44:53.492048 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:53.492046    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 12:44:53.492183 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:53.492058    2570 projected.go:196] Error preparing data for projected volume kube-api-access-vpqcr for pod openshift-network-diagnostics/network-check-target-nt9ss: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 12:44:53.492183 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:53.492133    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d63473a8-86d8-4ad9-a2b0-26a3ab221c57-kube-api-access-vpqcr podName:d63473a8-86d8-4ad9-a2b0-26a3ab221c57 nodeName:}" failed. No retries permitted until 2026-07-20 12:44:57.492114474 +0000 UTC m=+10.247163833 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vpqcr" (UniqueName: "kubernetes.io/projected/d63473a8-86d8-4ad9-a2b0-26a3ab221c57-kube-api-access-vpqcr") pod "network-check-target-nt9ss" (UID: "d63473a8-86d8-4ad9-a2b0-26a3ab221c57") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 12:44:53.803682 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:53.803645    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nt9ss"
Jul 20 12:44:53.804177 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:53.803790    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nt9ss" podUID="d63473a8-86d8-4ad9-a2b0-26a3ab221c57"
Jul 20 12:44:54.801565 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:54.801215    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dkkp"
Jul 20 12:44:54.801565 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:54.801264    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn69x"
Jul 20 12:44:54.801565 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:54.801368    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dkkp" podUID="5fbafa93-14fa-41b3-a202-eb69336c381e"
Jul 20 12:44:54.801565 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:54.801460    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gn69x" podUID="d5e87d68-a096-452b-a6b3-c0815771c37d"
Jul 20 12:44:55.801991 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:55.801892    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nt9ss"
Jul 20 12:44:55.802399 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:55.802031    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nt9ss" podUID="d63473a8-86d8-4ad9-a2b0-26a3ab221c57"
Jul 20 12:44:56.802128 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:56.801601    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn69x"
Jul 20 12:44:56.802128 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:56.801755    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gn69x" podUID="d5e87d68-a096-452b-a6b3-c0815771c37d"
Jul 20 12:44:56.802128 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:56.801892    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dkkp"
Jul 20 12:44:56.802128 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:56.802003    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dkkp" podUID="5fbafa93-14fa-41b3-a202-eb69336c381e"
Jul 20 12:44:57.324321 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:57.323729    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5fbafa93-14fa-41b3-a202-eb69336c381e-original-pull-secret\") pod \"global-pull-secret-syncer-4dkkp\" (UID: \"5fbafa93-14fa-41b3-a202-eb69336c381e\") " pod="kube-system/global-pull-secret-syncer-4dkkp"
Jul 20 12:44:57.324321 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:57.323896    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 12:44:57.324321 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:57.323959    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fbafa93-14fa-41b3-a202-eb69336c381e-original-pull-secret podName:5fbafa93-14fa-41b3-a202-eb69336c381e nodeName:}" failed. No retries permitted until 2026-07-20 12:45:05.323940781 +0000 UTC m=+18.078990136 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5fbafa93-14fa-41b3-a202-eb69336c381e-original-pull-secret") pod "global-pull-secret-syncer-4dkkp" (UID: "5fbafa93-14fa-41b3-a202-eb69336c381e") : object "kube-system"/"original-pull-secret" not registered
Jul 20 12:44:57.424882 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:57.424844    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5e87d68-a096-452b-a6b3-c0815771c37d-metrics-certs\") pod \"network-metrics-daemon-gn69x\" (UID: \"d5e87d68-a096-452b-a6b3-c0815771c37d\") " pod="openshift-multus/network-metrics-daemon-gn69x"
Jul 20 12:44:57.425059 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:57.425013    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 12:44:57.425130 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:57.425105    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5e87d68-a096-452b-a6b3-c0815771c37d-metrics-certs podName:d5e87d68-a096-452b-a6b3-c0815771c37d nodeName:}" failed. No retries permitted until 2026-07-20 12:45:05.42507026 +0000 UTC m=+18.180119618 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5e87d68-a096-452b-a6b3-c0815771c37d-metrics-certs") pod "network-metrics-daemon-gn69x" (UID: "d5e87d68-a096-452b-a6b3-c0815771c37d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 12:44:57.525870 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:57.525835    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpqcr\" (UniqueName: \"kubernetes.io/projected/d63473a8-86d8-4ad9-a2b0-26a3ab221c57-kube-api-access-vpqcr\") pod \"network-check-target-nt9ss\" (UID: \"d63473a8-86d8-4ad9-a2b0-26a3ab221c57\") " pod="openshift-network-diagnostics/network-check-target-nt9ss"
Jul 20 12:44:57.526116 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:57.526033    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 12:44:57.526116 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:57.526065    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 12:44:57.526116 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:57.526079    2570 projected.go:196] Error preparing data for projected volume kube-api-access-vpqcr for pod openshift-network-diagnostics/network-check-target-nt9ss: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 12:44:57.526240 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:57.526157    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d63473a8-86d8-4ad9-a2b0-26a3ab221c57-kube-api-access-vpqcr podName:d63473a8-86d8-4ad9-a2b0-26a3ab221c57 nodeName:}" failed. No retries permitted until 2026-07-20 12:45:05.526139811 +0000 UTC m=+18.281189189 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vpqcr" (UniqueName: "kubernetes.io/projected/d63473a8-86d8-4ad9-a2b0-26a3ab221c57-kube-api-access-vpqcr") pod "network-check-target-nt9ss" (UID: "d63473a8-86d8-4ad9-a2b0-26a3ab221c57") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 12:44:57.803795 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:57.803659    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nt9ss"
Jul 20 12:44:57.804243 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:57.803812    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nt9ss" podUID="d63473a8-86d8-4ad9-a2b0-26a3ab221c57"
Jul 20 12:44:58.802103 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:58.802060    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn69x"
Jul 20 12:44:58.802291 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:58.802226    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gn69x" podUID="d5e87d68-a096-452b-a6b3-c0815771c37d"
Jul 20 12:44:58.802800 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:58.802645    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dkkp"
Jul 20 12:44:58.802800 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:58.802743    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dkkp" podUID="5fbafa93-14fa-41b3-a202-eb69336c381e"
Jul 20 12:44:59.801525 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:44:59.801476    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nt9ss"
Jul 20 12:44:59.802030 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:44:59.801597    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nt9ss" podUID="d63473a8-86d8-4ad9-a2b0-26a3ab221c57"
Jul 20 12:45:00.801839 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:00.801801    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn69x"
Jul 20 12:45:00.801839 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:00.801829    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dkkp"
Jul 20 12:45:00.802311 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:00.801959    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gn69x" podUID="d5e87d68-a096-452b-a6b3-c0815771c37d"
Jul 20 12:45:00.802311 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:00.802094    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dkkp" podUID="5fbafa93-14fa-41b3-a202-eb69336c381e"
Jul 20 12:45:01.802121 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:01.802015    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nt9ss"
Jul 20 12:45:01.802630 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:01.802162    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nt9ss" podUID="d63473a8-86d8-4ad9-a2b0-26a3ab221c57"
Jul 20 12:45:02.802076 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:02.802032    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dkkp"
Jul 20 12:45:02.802076 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:02.802071    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn69x"
Jul 20 12:45:02.802579 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:02.802197    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dkkp" podUID="5fbafa93-14fa-41b3-a202-eb69336c381e"
Jul 20 12:45:02.802579 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:02.802318    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gn69x" podUID="d5e87d68-a096-452b-a6b3-c0815771c37d"
Jul 20 12:45:03.802239 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:03.802200    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nt9ss"
Jul 20 12:45:03.802445 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:03.802314    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nt9ss" podUID="d63473a8-86d8-4ad9-a2b0-26a3ab221c57"
Jul 20 12:45:04.801485 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:04.801433    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn69x"
Jul 20 12:45:04.801485 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:04.801452    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dkkp"
Jul 20 12:45:04.801775 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:04.801587    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gn69x" podUID="d5e87d68-a096-452b-a6b3-c0815771c37d"
Jul 20 12:45:04.801775 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:04.801674    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dkkp" podUID="5fbafa93-14fa-41b3-a202-eb69336c381e"
Jul 20 12:45:05.388890 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:05.388851    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5fbafa93-14fa-41b3-a202-eb69336c381e-original-pull-secret\") pod \"global-pull-secret-syncer-4dkkp\" (UID: \"5fbafa93-14fa-41b3-a202-eb69336c381e\") " pod="kube-system/global-pull-secret-syncer-4dkkp"
Jul 20 12:45:05.389294 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:05.389010    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 12:45:05.389294 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:05.389113    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fbafa93-14fa-41b3-a202-eb69336c381e-original-pull-secret podName:5fbafa93-14fa-41b3-a202-eb69336c381e nodeName:}" failed. No retries permitted until 2026-07-20 12:45:21.389065012 +0000 UTC m=+34.144114376 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5fbafa93-14fa-41b3-a202-eb69336c381e-original-pull-secret") pod "global-pull-secret-syncer-4dkkp" (UID: "5fbafa93-14fa-41b3-a202-eb69336c381e") : object "kube-system"/"original-pull-secret" not registered
Jul 20 12:45:05.489888 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:05.489843    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5e87d68-a096-452b-a6b3-c0815771c37d-metrics-certs\") pod \"network-metrics-daemon-gn69x\" (UID: \"d5e87d68-a096-452b-a6b3-c0815771c37d\") " pod="openshift-multus/network-metrics-daemon-gn69x"
Jul 20 12:45:05.490056 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:05.490020    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 12:45:05.490158 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:05.490120    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5e87d68-a096-452b-a6b3-c0815771c37d-metrics-certs podName:d5e87d68-a096-452b-a6b3-c0815771c37d nodeName:}" failed. No retries permitted until 2026-07-20 12:45:21.490094918 +0000 UTC m=+34.245144293 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5e87d68-a096-452b-a6b3-c0815771c37d-metrics-certs") pod "network-metrics-daemon-gn69x" (UID: "d5e87d68-a096-452b-a6b3-c0815771c37d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 12:45:05.590518 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:05.590472    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpqcr\" (UniqueName: \"kubernetes.io/projected/d63473a8-86d8-4ad9-a2b0-26a3ab221c57-kube-api-access-vpqcr\") pod \"network-check-target-nt9ss\" (UID: \"d63473a8-86d8-4ad9-a2b0-26a3ab221c57\") " pod="openshift-network-diagnostics/network-check-target-nt9ss"
Jul 20 12:45:05.590783 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:05.590658    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 12:45:05.590783 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:05.590682    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 12:45:05.590783 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:05.590698    2570 projected.go:196] Error preparing data for projected volume kube-api-access-vpqcr for pod openshift-network-diagnostics/network-check-target-nt9ss: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 12:45:05.590783 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:05.590758    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d63473a8-86d8-4ad9-a2b0-26a3ab221c57-kube-api-access-vpqcr podName:d63473a8-86d8-4ad9-a2b0-26a3ab221c57 nodeName:}" failed. No retries permitted until 2026-07-20 12:45:21.590743101 +0000 UTC m=+34.345792475 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vpqcr" (UniqueName: "kubernetes.io/projected/d63473a8-86d8-4ad9-a2b0-26a3ab221c57-kube-api-access-vpqcr") pod "network-check-target-nt9ss" (UID: "d63473a8-86d8-4ad9-a2b0-26a3ab221c57") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 12:45:05.801331 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:05.801221    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nt9ss"
Jul 20 12:45:05.801500 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:05.801357    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nt9ss" podUID="d63473a8-86d8-4ad9-a2b0-26a3ab221c57"
Jul 20 12:45:06.801761 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:06.801720    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn69x"
Jul 20 12:45:06.802182 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:06.801766    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dkkp"
Jul 20 12:45:06.802182 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:06.801877    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gn69x" podUID="d5e87d68-a096-452b-a6b3-c0815771c37d"
Jul 20 12:45:06.802182 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:06.802000    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dkkp" podUID="5fbafa93-14fa-41b3-a202-eb69336c381e"
Jul 20 12:45:07.802480 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:07.802444    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nt9ss"
Jul 20 12:45:07.802966 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:07.802588    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nt9ss" podUID="d63473a8-86d8-4ad9-a2b0-26a3ab221c57"
Jul 20 12:45:08.801394 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:08.801356    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dkkp"
Jul 20 12:45:08.801394 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:08.801388    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn69x"
Jul 20 12:45:08.801620 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:08.801483    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dkkp" podUID="5fbafa93-14fa-41b3-a202-eb69336c381e"
Jul 20 12:45:08.801620 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:08.801610    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gn69x" podUID="d5e87d68-a096-452b-a6b3-c0815771c37d"
Jul 20 12:45:09.802101 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:09.801916    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nt9ss"
Jul 20 12:45:09.802613 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:09.802183    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nt9ss" podUID="d63473a8-86d8-4ad9-a2b0-26a3ab221c57"
Jul 20 12:45:09.960300 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:09.960099    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wphvm" event={"ID":"5597d831-70ad-4f2c-803d-8775135e6215","Type":"ContainerStarted","Data":"403ea312d490cee3969a69d5fb65f1f50e3c2e26b0bea00b67f58dcd4e1d8fb9"}
Jul 20 12:45:09.961707 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:09.961676    2570 generic.go:356] "Generic (PLEG): container finished" podID="f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825" containerID="7d15e1d46f31bb07d3bdbc81a3e8670a2567f61c5dfa7e350377a412fea97005" exitCode=0
Jul 20 12:45:09.961821 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:09.961722    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5fvsm" event={"ID":"f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825","Type":"ContainerDied","Data":"7d15e1d46f31bb07d3bdbc81a3e8670a2567f61c5dfa7e350377a412fea97005"}
Jul 20 12:45:09.963297 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:09.963179    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-w7hxf" event={"ID":"1590374e-47ea-4c52-8ad0-c84873ec14c6","Type":"ContainerStarted","Data":"73909ca7c46d0893a62578a50c76818516190740184b8d0f5a6be63177ba82b4"}
Jul 20 12:45:09.964640 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:09.964620    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qvfnf" event={"ID":"591fe657-5268-4a39-b559-48e285b8e064","Type":"ContainerStarted","Data":"2000e57c53343f9515e296c0193c76e1eb06aafe7f6e7170165a4e08834c6fc6"}
Jul 20 12:45:09.966121 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:09.966100    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k9w5j" event={"ID":"8223a859-94ea-40ad-b31d-7ee1eb77834e","Type":"ContainerStarted","Data":"e064e2a76546d457a483c924a842a46c47aed2e72b0c4eef5786d2c9fb0009e5"}
Jul 20 12:45:09.968240 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:09.968221    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rhdn8_5efe9094-763c-4689-85b7-83e0ccb19811/ovn-acl-logging/0.log"
Jul 20 12:45:09.968613 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:09.968588    2570 generic.go:356] "Generic (PLEG): container finished" podID="5efe9094-763c-4689-85b7-83e0ccb19811" containerID="651df01cca74623d3cf2ed8e092401672731a4e122dec74c1a52ee729bfe184a" exitCode=1
Jul 20 12:45:09.968715 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:09.968661    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8" event={"ID":"5efe9094-763c-4689-85b7-83e0ccb19811","Type":"ContainerStarted","Data":"9a8fdeea0ecd2c9e323aa480159a219e904e1bcdda84759419f21a1745fd6a4e"}
Jul 20 12:45:09.968770 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:09.968734    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8" event={"ID":"5efe9094-763c-4689-85b7-83e0ccb19811","Type":"ContainerStarted","Data":"3dc97e35b2d4700ab774181ce2065c472c1ecb33526eb157f4f08d365c4644dd"}
Jul 20 12:45:09.968808 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:09.968778    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8" event={"ID":"5efe9094-763c-4689-85b7-83e0ccb19811","Type":"ContainerDied","Data":"651df01cca74623d3cf2ed8e092401672731a4e122dec74c1a52ee729bfe184a"}
Jul 20 12:45:09.968847 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:09.968824    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8" event={"ID":"5efe9094-763c-4689-85b7-83e0ccb19811","Type":"ContainerStarted","Data":"bf215ef016fe385f66fcea4db8dc31d70f021d2cb7238a943557442d40496373"}
Jul 20 12:45:09.969992 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:09.969974    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bmw8t" event={"ID":"6f1bf356-0007-494d-af6b-f42d5333291b","Type":"ContainerStarted","Data":"48eb8a4454531debf1f39dc3b36b15cbfe1e0ce353c6579602a4dadf69f00ba3"}
Jul 20 12:45:09.971223 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:09.971203    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhlms" event={"ID":"684e2cf7-4db4-4e84-a1e2-96d825a873d6","Type":"ContainerStarted","Data":"911bd261a6324f648431da853ba5eb90f7cab2a61bb9346de0ef8a4e48401138"}
Jul 20 12:45:09.981981 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:09.981935    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wphvm" podStartSLOduration=4.474360038 podStartE2EDuration="22.981922738s" totalImagesPullingTime="18.5075627s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 12:44:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:45:09.981438581 +0000 UTC m=+22.736487954" watchObservedRunningTime="2026-07-20 12:45:09.981922738 +0000 UTC m=+22.736972112"
Jul 20 12:45:09.998124 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:09.998059    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qvfnf" podStartSLOduration=3.535253667 podStartE2EDuration="21.998045275s" totalImagesPullingTime="18.462791608s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 12:44:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:45:09.997410674 +0000 UTC m=+22.752460048" watchObservedRunningTime="2026-07-20 12:45:09.998045275 +0000 UTC m=+22.753094649"
Jul 20 12:45:10.012946 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:10.012898    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-w7hxf" podStartSLOduration=12.806800499 podStartE2EDuration="23.012884868s" totalImagesPullingTime="10.206084369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:44:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:45:10.012290172 +0000 UTC m=+22.767339545" watchObservedRunningTime="2026-07-20 12:45:10.012884868 +0000 UTC m=+22.767934240"
Jul 20 12:45:10.030372 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:10.030329    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-k9w5j" podStartSLOduration=3.539776066 podStartE2EDuration="22.030314254s" totalImagesPullingTime="18.490538188s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 12:44:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:45:10.029858425 +0000 UTC m=+22.784907799" watchObservedRunningTime="2026-07-20 12:45:10.030314254 +0000 UTC m=+22.785363686"
Jul 20 12:45:10.070757 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:10.070713    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bmw8t" podStartSLOduration=3.938376032 podStartE2EDuration="22.070695715s" totalImagesPullingTime="18.132319683s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 12:44:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:45:10.070337807 +0000 UTC m=+22.825387176" watchObservedRunningTime="2026-07-20 12:45:10.070695715 +0000 UTC m=+22.825745093"
Jul 20 12:45:10.725901 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:10.725812    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-w7hxf"
Jul 20 12:45:10.726507 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:10.726485    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-w7hxf"
Jul 20 12:45:10.801911 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:10.801877    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dkkp"
Jul 20 12:45:10.802096 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:10.801879    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn69x"
Jul 20 12:45:10.802096 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:10.801990    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dkkp" podUID="5fbafa93-14fa-41b3-a202-eb69336c381e"
Jul 20 12:45:10.802517 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:10.802111    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gn69x" podUID="d5e87d68-a096-452b-a6b3-c0815771c37d"
Jul 20 12:45:10.973575 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:10.973539    2570 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 20 12:45:10.976527 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:10.976461    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhlms" event={"ID":"684e2cf7-4db4-4e84-a1e2-96d825a873d6","Type":"ContainerStarted","Data":"e4edc734ba1020d134e6949a7d379ec3c71c41bdad76a0ace7a18b7af65591c1"}
Jul 20 12:45:10.978017 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:10.977990    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-58x4n" event={"ID":"50a9fa72-f7cd-4281-a6ae-6dce52580ba0","Type":"ContainerStarted","Data":"7a68ab6e92f523bcbe6734673ba41c7961dfd894c77ceb590dac021843a96653"}
Jul 20 12:45:10.980741 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:10.980721    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rhdn8_5efe9094-763c-4689-85b7-83e0ccb19811/ovn-acl-logging/0.log"
Jul 20 12:45:10.981140 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:10.981117    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8" event={"ID":"5efe9094-763c-4689-85b7-83e0ccb19811","Type":"ContainerStarted","Data":"560ab1a3e6c1a8b87f88bb48f037e6b20990d597416ec0d9478ce703c7384c6e"}
Jul 20 12:45:10.981204 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:10.981176    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8" event={"ID":"5efe9094-763c-4689-85b7-83e0ccb19811","Type":"ContainerStarted","Data":"ee3cda02a21db89a5aaea65da712fa581eb449359702bfc0a2dabd1f76d13550"}
Jul 20 12:45:10.994968 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:10.994920    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-58x4n" podStartSLOduration=5.515292089 podStartE2EDuration="23.994906392s" totalImagesPullingTime="18.479614303s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 12:44:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:45:10.994640373 +0000 UTC m=+23.749689750" watchObservedRunningTime="2026-07-20 12:45:10.994906392 +0000 UTC m=+23.749955767"
Jul 20 12:45:11.467161 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:11.467059    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-w7hxf"
Jul 20 12:45:11.467804 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:11.467777    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-w7hxf"
Jul 20 12:45:11.728994 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:11.728801    2570 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-20T12:45:10.973558136Z","UUID":"d23f9eef-373d-4d7e-8598-b0d778773248","Handler":null,"Name":"","Endpoint":""}
Jul 20 12:45:11.730817 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:11.730789    2570 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 20 12:45:11.730949 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:11.730834    2570 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 20 12:45:11.801798 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:11.801762    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nt9ss"
Jul 20 12:45:11.801972 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:11.801865    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nt9ss" podUID="d63473a8-86d8-4ad9-a2b0-26a3ab221c57"
Jul 20 12:45:12.802433 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:12.802240    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dkkp"
Jul 20 12:45:12.802869 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:12.802238    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn69x"
Jul 20 12:45:12.802869 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:12.802530    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dkkp" podUID="5fbafa93-14fa-41b3-a202-eb69336c381e"
Jul 20 12:45:12.802869 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:12.802597    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gn69x" podUID="d5e87d68-a096-452b-a6b3-c0815771c37d"
Jul 20 12:45:12.989266 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:12.989237    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rhdn8_5efe9094-763c-4689-85b7-83e0ccb19811/ovn-acl-logging/0.log"
Jul 20 12:45:12.989723 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:12.989698    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8" event={"ID":"5efe9094-763c-4689-85b7-83e0ccb19811","Type":"ContainerStarted","Data":"d49c449cc32dbcb2be5bfa13936a557800cb7efeeef9ecd29162fcde39ee22b3"}
Jul 20 12:45:12.992074 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:12.992041    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhlms" event={"ID":"684e2cf7-4db4-4e84-a1e2-96d825a873d6","Type":"ContainerStarted","Data":"0d299f69bcc4d00ef89feeb3491ce0798a68769a5742186e0752d856988738ac"}
Jul 20 12:45:13.013265 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:13.013204    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhlms" podStartSLOduration=5.272559549 podStartE2EDuration="26.013187292s" totalImagesPullingTime="20.740627743s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 12:44:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:45:13.012844517 +0000 UTC m=+25.767893893" watchObservedRunningTime="2026-07-20 12:45:13.013187292 +0000 UTC m=+25.768236665"
Jul 20 12:45:13.802032 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:13.801973    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nt9ss"
Jul 20 12:45:13.802280 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:13.802145    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nt9ss" podUID="d63473a8-86d8-4ad9-a2b0-26a3ab221c57"
Jul 20 12:45:14.802036 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:14.801942    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dkkp"
Jul 20 12:45:14.802631 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:14.801942    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn69x"
Jul 20 12:45:14.802631 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:14.802069    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dkkp" podUID="5fbafa93-14fa-41b3-a202-eb69336c381e"
Jul 20 12:45:14.802631 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:14.802153    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gn69x" podUID="d5e87d68-a096-452b-a6b3-c0815771c37d"
Jul 20 12:45:15.802414 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:15.802193    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nt9ss"
Jul 20 12:45:15.802952 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:15.802446    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nt9ss" podUID="d63473a8-86d8-4ad9-a2b0-26a3ab221c57"
Jul 20 12:45:16.001496 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:16.001463    2570 generic.go:356] "Generic (PLEG): container finished" podID="f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825" containerID="02ac905bc79d74f216af990021b75544081da1e08bf6c2da8056402bd34c8de8" exitCode=0
Jul 20 12:45:16.001676 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:16.001551    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5fvsm" event={"ID":"f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825","Type":"ContainerDied","Data":"02ac905bc79d74f216af990021b75544081da1e08bf6c2da8056402bd34c8de8"}
Jul 20 12:45:16.005220 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:16.005200    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rhdn8_5efe9094-763c-4689-85b7-83e0ccb19811/ovn-acl-logging/0.log"
Jul 20 12:45:16.005561 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:16.005542    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8" event={"ID":"5efe9094-763c-4689-85b7-83e0ccb19811","Type":"ContainerStarted","Data":"ac89e7d8a1c67dfae79a3ffb667f2e4f066b46fff72f71ab2cec78d67a8d985c"}
Jul 20 12:45:16.005919 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:16.005896    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:45:16.005998 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:16.005954    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:45:16.006052 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:16.006036    2570 scope.go:117] "RemoveContainer" containerID="651df01cca74623d3cf2ed8e092401672731a4e122dec74c1a52ee729bfe184a"
Jul 20 12:45:16.022730 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:16.022705    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:45:16.801337 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:16.801301    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn69x"
Jul 20 12:45:16.801633 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:16.801351    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dkkp"
Jul 20 12:45:16.801633 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:16.801440    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gn69x" podUID="d5e87d68-a096-452b-a6b3-c0815771c37d"
Jul 20 12:45:16.801633 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:16.801540    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dkkp" podUID="5fbafa93-14fa-41b3-a202-eb69336c381e"
Jul 20 12:45:17.011862 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:17.011829    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rhdn8_5efe9094-763c-4689-85b7-83e0ccb19811/ovn-acl-logging/0.log"
Jul 20 12:45:17.012289 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:17.012228    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8" event={"ID":"5efe9094-763c-4689-85b7-83e0ccb19811","Type":"ContainerStarted","Data":"c62ae0372fc79ff513cd2eeb1bf867bd6195626f354e0a80b805ba475a50fe1e"}
Jul 20 12:45:17.012408 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:17.012392    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:45:17.027964 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:17.027930    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:45:17.042285 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:17.042243    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8" podStartSLOduration=10.439687916 podStartE2EDuration="29.042229521s" totalImagesPullingTime="18.602541605s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 12:44:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:45:17.041714393 +0000 UTC m=+29.796763778" watchObservedRunningTime="2026-07-20 12:45:17.042229521 +0000 UTC m=+29.797278921"
Jul 20 12:45:17.802589 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:17.802537    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nt9ss"
Jul 20 12:45:17.802752 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:17.802675    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nt9ss" podUID="d63473a8-86d8-4ad9-a2b0-26a3ab221c57"
Jul 20 12:45:18.016716 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:18.016676    2570 generic.go:356] "Generic (PLEG): container finished" podID="f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825" containerID="4a320d4b65de36b39e6316ab996ff51c1b3351c1563480ca722b89e3d7ba4b86" exitCode=0
Jul 20 12:45:18.017120 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:18.016763    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5fvsm" event={"ID":"f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825","Type":"ContainerDied","Data":"4a320d4b65de36b39e6316ab996ff51c1b3351c1563480ca722b89e3d7ba4b86"}
Jul 20 12:45:18.801732 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:18.801696    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn69x"
Jul 20 12:45:18.801921 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:18.801747    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dkkp"
Jul 20 12:45:18.801921 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:18.801834    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gn69x" podUID="d5e87d68-a096-452b-a6b3-c0815771c37d"
Jul 20 12:45:18.802015 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:18.801965    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dkkp" podUID="5fbafa93-14fa-41b3-a202-eb69336c381e"
Jul 20 12:45:19.801711 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:19.801677    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nt9ss"
Jul 20 12:45:19.802058 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:19.801779    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nt9ss" podUID="d63473a8-86d8-4ad9-a2b0-26a3ab221c57"
Jul 20 12:45:20.022916 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:20.022884    2570 generic.go:356] "Generic (PLEG): container finished" podID="f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825" containerID="46b95fd7e5f7876748751682c291bdf6061b1f8cb17cd29906c34c22eaf9b69f" exitCode=0
Jul 20 12:45:20.023104 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:20.022929    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5fvsm" event={"ID":"f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825","Type":"ContainerDied","Data":"46b95fd7e5f7876748751682c291bdf6061b1f8cb17cd29906c34c22eaf9b69f"}
Jul 20 12:45:20.801567 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:20.801411    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dkkp"
Jul 20 12:45:20.801745 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:20.801479    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn69x"
Jul 20 12:45:20.801745 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:20.801635    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dkkp" podUID="5fbafa93-14fa-41b3-a202-eb69336c381e"
Jul 20 12:45:20.801745 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:20.801718    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gn69x" podUID="d5e87d68-a096-452b-a6b3-c0815771c37d"
Jul 20 12:45:21.408774 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:21.408731    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5fbafa93-14fa-41b3-a202-eb69336c381e-original-pull-secret\") pod \"global-pull-secret-syncer-4dkkp\" (UID: \"5fbafa93-14fa-41b3-a202-eb69336c381e\") " pod="kube-system/global-pull-secret-syncer-4dkkp"
Jul 20 12:45:21.408952 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:21.408867    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 12:45:21.408952 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:21.408933    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fbafa93-14fa-41b3-a202-eb69336c381e-original-pull-secret podName:5fbafa93-14fa-41b3-a202-eb69336c381e nodeName:}" failed. No retries permitted until 2026-07-20 12:45:53.408918847 +0000 UTC m=+66.163968199 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5fbafa93-14fa-41b3-a202-eb69336c381e-original-pull-secret") pod "global-pull-secret-syncer-4dkkp" (UID: "5fbafa93-14fa-41b3-a202-eb69336c381e") : object "kube-system"/"original-pull-secret" not registered
Jul 20 12:45:21.509741 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:21.509702    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5e87d68-a096-452b-a6b3-c0815771c37d-metrics-certs\") pod \"network-metrics-daemon-gn69x\" (UID: \"d5e87d68-a096-452b-a6b3-c0815771c37d\") " pod="openshift-multus/network-metrics-daemon-gn69x"
Jul 20 12:45:21.509893 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:21.509868    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 12:45:21.509951 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:21.509938    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5e87d68-a096-452b-a6b3-c0815771c37d-metrics-certs podName:d5e87d68-a096-452b-a6b3-c0815771c37d nodeName:}" failed. No retries permitted until 2026-07-20 12:45:53.509922634 +0000 UTC m=+66.264971986 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5e87d68-a096-452b-a6b3-c0815771c37d-metrics-certs") pod "network-metrics-daemon-gn69x" (UID: "d5e87d68-a096-452b-a6b3-c0815771c37d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 12:45:21.610972 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:21.610933    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpqcr\" (UniqueName: \"kubernetes.io/projected/d63473a8-86d8-4ad9-a2b0-26a3ab221c57-kube-api-access-vpqcr\") pod \"network-check-target-nt9ss\" (UID: \"d63473a8-86d8-4ad9-a2b0-26a3ab221c57\") " pod="openshift-network-diagnostics/network-check-target-nt9ss"
Jul 20 12:45:21.611145 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:21.611104    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 12:45:21.611145 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:21.611122    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 12:45:21.611145 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:21.611132    2570 projected.go:196] Error preparing data for projected volume kube-api-access-vpqcr for pod openshift-network-diagnostics/network-check-target-nt9ss: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 12:45:21.611284 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:21.611184    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d63473a8-86d8-4ad9-a2b0-26a3ab221c57-kube-api-access-vpqcr podName:d63473a8-86d8-4ad9-a2b0-26a3ab221c57 nodeName:}" failed. No retries permitted until 2026-07-20 12:45:53.61116843 +0000 UTC m=+66.366217787 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vpqcr" (UniqueName: "kubernetes.io/projected/d63473a8-86d8-4ad9-a2b0-26a3ab221c57-kube-api-access-vpqcr") pod "network-check-target-nt9ss" (UID: "d63473a8-86d8-4ad9-a2b0-26a3ab221c57") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 12:45:21.802260 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:21.802173    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nt9ss"
Jul 20 12:45:21.802697 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:21.802310    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nt9ss" podUID="d63473a8-86d8-4ad9-a2b0-26a3ab221c57"
Jul 20 12:45:22.801543 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:22.801512    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dkkp"
Jul 20 12:45:22.801752 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:22.801512    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn69x"
Jul 20 12:45:22.801752 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:22.801627    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dkkp" podUID="5fbafa93-14fa-41b3-a202-eb69336c381e"
Jul 20 12:45:22.801752 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:22.801720    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gn69x" podUID="d5e87d68-a096-452b-a6b3-c0815771c37d"
Jul 20 12:45:23.801595 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:23.801558    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nt9ss"
Jul 20 12:45:23.802039 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:23.801689    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nt9ss" podUID="d63473a8-86d8-4ad9-a2b0-26a3ab221c57"
Jul 20 12:45:24.801943 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:24.801850    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn69x"
Jul 20 12:45:24.802330 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:24.801970    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gn69x" podUID="d5e87d68-a096-452b-a6b3-c0815771c37d"
Jul 20 12:45:24.802330 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:24.802021    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dkkp"
Jul 20 12:45:24.802330 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:24.802134    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dkkp" podUID="5fbafa93-14fa-41b3-a202-eb69336c381e"
Jul 20 12:45:25.037674 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:25.037641    2570 generic.go:356] "Generic (PLEG): container finished" podID="f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825" containerID="8e06635f523b12f0de8cc1e3aef956dea2a7e12e11ea8ad3ddabaa194f14a812" exitCode=0
Jul 20 12:45:25.037841 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:25.037707    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5fvsm" event={"ID":"f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825","Type":"ContainerDied","Data":"8e06635f523b12f0de8cc1e3aef956dea2a7e12e11ea8ad3ddabaa194f14a812"}
Jul 20 12:45:25.801768 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:25.801730    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nt9ss"
Jul 20 12:45:25.801936 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:25.801861    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nt9ss" podUID="d63473a8-86d8-4ad9-a2b0-26a3ab221c57"
Jul 20 12:45:26.042730 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:26.042698    2570 generic.go:356] "Generic (PLEG): container finished" podID="f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825" containerID="0acdf536fd3c42d48f2a088dbcb33dfd93e494539839f350318addc20ab3af02" exitCode=0
Jul 20 12:45:26.043156 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:26.042756    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5fvsm" event={"ID":"f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825","Type":"ContainerDied","Data":"0acdf536fd3c42d48f2a088dbcb33dfd93e494539839f350318addc20ab3af02"}
Jul 20 12:45:26.802056 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:26.802014    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn69x"
Jul 20 12:45:26.802056 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:26.802058    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dkkp"
Jul 20 12:45:26.802282 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:26.802166    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gn69x" podUID="d5e87d68-a096-452b-a6b3-c0815771c37d"
Jul 20 12:45:26.802282 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:26.802263    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dkkp" podUID="5fbafa93-14fa-41b3-a202-eb69336c381e"
Jul 20 12:45:27.047579 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:27.047547    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5fvsm" event={"ID":"f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825","Type":"ContainerStarted","Data":"ad94dd1a46abbca905500273019a313d5f80ecced065072d6778fe5d392df4d6"}
Jul 20 12:45:27.073660 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:27.073607    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5fvsm" podStartSLOduration=8.667799426 podStartE2EDuration="39.073587723s" totalImagesPullingTime="30.405788297s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 12:44:48 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:45:27.071453193 +0000 UTC m=+39.826502569" watchObservedRunningTime="2026-07-20 12:45:27.073587723 +0000 UTC m=+39.828637096"
Jul 20 12:45:27.804549 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:27.804520    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nt9ss"
Jul 20 12:45:27.804715 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:27.804616    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nt9ss" podUID="d63473a8-86d8-4ad9-a2b0-26a3ab221c57"
Jul 20 12:45:28.801590 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:28.801549    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dkkp"
Jul 20 12:45:28.802111 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:28.801660    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dkkp" podUID="5fbafa93-14fa-41b3-a202-eb69336c381e"
Jul 20 12:45:28.802111 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:28.801712    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn69x"
Jul 20 12:45:28.802111 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:28.801806    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gn69x" podUID="d5e87d68-a096-452b-a6b3-c0815771c37d"
Jul 20 12:45:29.801458 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:29.801429    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nt9ss"
Jul 20 12:45:29.801622 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:29.801554    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nt9ss" podUID="d63473a8-86d8-4ad9-a2b0-26a3ab221c57"
Jul 20 12:45:30.426499 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:30.426465    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4dkkp"]
Jul 20 12:45:30.426697 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:30.426611    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dkkp"
Jul 20 12:45:30.426761 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:30.426717    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dkkp" podUID="5fbafa93-14fa-41b3-a202-eb69336c381e"
Jul 20 12:45:30.433505 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:30.433475    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nt9ss"]
Jul 20 12:45:30.433677 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:30.433589    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nt9ss"
Jul 20 12:45:30.433741 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:30.433692    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nt9ss" podUID="d63473a8-86d8-4ad9-a2b0-26a3ab221c57"
Jul 20 12:45:30.438718 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:30.438687    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gn69x"]
Jul 20 12:45:30.438863 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:30.438811    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn69x"
Jul 20 12:45:30.438952 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:30.438930    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gn69x" podUID="d5e87d68-a096-452b-a6b3-c0815771c37d"
Jul 20 12:45:31.801477 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:31.801382    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dkkp"
Jul 20 12:45:31.802021 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:31.801383    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn69x"
Jul 20 12:45:31.802021 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:31.801499    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dkkp" podUID="5fbafa93-14fa-41b3-a202-eb69336c381e"
Jul 20 12:45:31.802021 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:31.801610    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gn69x" podUID="d5e87d68-a096-452b-a6b3-c0815771c37d"
Jul 20 12:45:32.802129 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:32.801938    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nt9ss"
Jul 20 12:45:32.802680 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:32.802211    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nt9ss" podUID="d63473a8-86d8-4ad9-a2b0-26a3ab221c57"
Jul 20 12:45:33.802238 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:33.802197    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn69x"
Jul 20 12:45:33.802806 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:33.802200    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dkkp"
Jul 20 12:45:33.802806 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:33.802346    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gn69x" podUID="d5e87d68-a096-452b-a6b3-c0815771c37d"
Jul 20 12:45:33.802806 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:33.802397    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dkkp" podUID="5fbafa93-14fa-41b3-a202-eb69336c381e"
Jul 20 12:45:34.052601 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.052528    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeReady"
Jul 20 12:45:34.052733 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.052654    2570 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 20 12:45:34.097587 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.097554    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4j5kp"]
Jul 20 12:45:34.118721 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.118691    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mvxsr"]
Jul 20 12:45:34.118870 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.118811    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4j5kp"
Jul 20 12:45:34.121777 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.121740    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 20 12:45:34.121938 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.121835    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 20 12:45:34.121995 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.121982    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dcf82\""
Jul 20 12:45:34.142908 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.142878    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4j5kp"]
Jul 20 12:45:34.142908 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.142914    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mvxsr"]
Jul 20 12:45:34.143123 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.142991    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mvxsr"
Jul 20 12:45:34.146112 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.146071    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 20 12:45:34.146259 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.146132    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 20 12:45:34.146259 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.146074    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 20 12:45:34.146259 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.146199    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wcv98\""
Jul 20 12:45:34.146259 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.146222    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 20 12:45:34.202241 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.202211    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mfd9m"]
Jul 20 12:45:34.203789 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.203763    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtj2t\" (UniqueName: \"kubernetes.io/projected/8243bed4-dbd7-4ccc-8213-ffa3cc38186b-kube-api-access-vtj2t\") pod \"dns-default-4j5kp\" (UID: \"8243bed4-dbd7-4ccc-8213-ffa3cc38186b\") " pod="openshift-dns/dns-default-4j5kp"
Jul 20 12:45:34.203923 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.203804    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8243bed4-dbd7-4ccc-8213-ffa3cc38186b-config-volume\") pod \"dns-default-4j5kp\" (UID: \"8243bed4-dbd7-4ccc-8213-ffa3cc38186b\") " pod="openshift-dns/dns-default-4j5kp"
Jul 20 12:45:34.203923 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.203826    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8243bed4-dbd7-4ccc-8213-ffa3cc38186b-metrics-tls\") pod \"dns-default-4j5kp\" (UID: \"8243bed4-dbd7-4ccc-8213-ffa3cc38186b\") " pod="openshift-dns/dns-default-4j5kp"
Jul 20 12:45:34.203923 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.203839    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8243bed4-dbd7-4ccc-8213-ffa3cc38186b-tmp-dir\") pod \"dns-default-4j5kp\" (UID: \"8243bed4-dbd7-4ccc-8213-ffa3cc38186b\") " pod="openshift-dns/dns-default-4j5kp"
Jul 20 12:45:34.224756 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.224721    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mfd9m"]
Jul 20 12:45:34.224891 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.224851    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mfd9m"
Jul 20 12:45:34.228328 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.228287    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 20 12:45:34.228737 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.228719    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 20 12:45:34.228852 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.228741    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-47mnr\""
Jul 20 12:45:34.228852 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.228745    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 20 12:45:34.304802 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.304699    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8243bed4-dbd7-4ccc-8213-ffa3cc38186b-config-volume\") pod \"dns-default-4j5kp\" (UID: \"8243bed4-dbd7-4ccc-8213-ffa3cc38186b\") " pod="openshift-dns/dns-default-4j5kp"
Jul 20 12:45:34.304802 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.304739    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8243bed4-dbd7-4ccc-8213-ffa3cc38186b-metrics-tls\") pod \"dns-default-4j5kp\" (UID: \"8243bed4-dbd7-4ccc-8213-ffa3cc38186b\") " pod="openshift-dns/dns-default-4j5kp"
Jul 20 12:45:34.304802 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.304757    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8243bed4-dbd7-4ccc-8213-ffa3cc38186b-tmp-dir\") pod \"dns-default-4j5kp\" (UID: \"8243bed4-dbd7-4ccc-8213-ffa3cc38186b\") " pod="openshift-dns/dns-default-4j5kp"
Jul 20 12:45:34.304802 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.304774    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7c51dab3-18c7-4abf-88e9-15fbb2925c88-cert\") pod \"ingress-canary-mfd9m\" (UID: \"7c51dab3-18c7-4abf-88e9-15fbb2925c88\") " pod="openshift-ingress-canary/ingress-canary-mfd9m"
Jul 20 12:45:34.305127 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.304807    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/794df699-efc3-4d10-baf2-2ea2ee8e730e-data-volume\") pod \"insights-runtime-extractor-mvxsr\" (UID: \"794df699-efc3-4d10-baf2-2ea2ee8e730e\") " pod="openshift-insights/insights-runtime-extractor-mvxsr"
Jul 20 12:45:34.305127 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.304848    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/794df699-efc3-4d10-baf2-2ea2ee8e730e-crio-socket\") pod \"insights-runtime-extractor-mvxsr\" (UID: \"794df699-efc3-4d10-baf2-2ea2ee8e730e\") " pod="openshift-insights/insights-runtime-extractor-mvxsr"
Jul 20 12:45:34.305127 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.304869    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/794df699-efc3-4d10-baf2-2ea2ee8e730e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mvxsr\" (UID: \"794df699-efc3-4d10-baf2-2ea2ee8e730e\") " pod="openshift-insights/insights-runtime-extractor-mvxsr"
Jul 20 12:45:34.305127 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.304923    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnlqs\" (UniqueName: \"kubernetes.io/projected/7c51dab3-18c7-4abf-88e9-15fbb2925c88-kube-api-access-pnlqs\") pod \"ingress-canary-mfd9m\" (UID: \"7c51dab3-18c7-4abf-88e9-15fbb2925c88\") " pod="openshift-ingress-canary/ingress-canary-mfd9m"
Jul 20 12:45:34.305127 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.304993    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/794df699-efc3-4d10-baf2-2ea2ee8e730e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mvxsr\" (UID: \"794df699-efc3-4d10-baf2-2ea2ee8e730e\") " pod="openshift-insights/insights-runtime-extractor-mvxsr"
Jul 20 12:45:34.305127 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.305018    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtj2t\" (UniqueName: \"kubernetes.io/projected/8243bed4-dbd7-4ccc-8213-ffa3cc38186b-kube-api-access-vtj2t\") pod \"dns-default-4j5kp\" (UID: \"8243bed4-dbd7-4ccc-8213-ffa3cc38186b\") " pod="openshift-dns/dns-default-4j5kp"
Jul 20 12:45:34.305127 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.305040    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp6nr\" (UniqueName: \"kubernetes.io/projected/794df699-efc3-4d10-baf2-2ea2ee8e730e-kube-api-access-wp6nr\") pod \"insights-runtime-extractor-mvxsr\" (UID: \"794df699-efc3-4d10-baf2-2ea2ee8e730e\") " pod="openshift-insights/insights-runtime-extractor-mvxsr"
Jul 20 12:45:34.305456 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.305182    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8243bed4-dbd7-4ccc-8213-ffa3cc38186b-tmp-dir\") pod \"dns-default-4j5kp\" (UID: \"8243bed4-dbd7-4ccc-8213-ffa3cc38186b\") " pod="openshift-dns/dns-default-4j5kp"
Jul 20 12:45:34.305507 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.305475    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8243bed4-dbd7-4ccc-8213-ffa3cc38186b-config-volume\") pod \"dns-default-4j5kp\" (UID: \"8243bed4-dbd7-4ccc-8213-ffa3cc38186b\") " pod="openshift-dns/dns-default-4j5kp"
Jul 20 12:45:34.308780 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.308760    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8243bed4-dbd7-4ccc-8213-ffa3cc38186b-metrics-tls\") pod \"dns-default-4j5kp\" (UID: \"8243bed4-dbd7-4ccc-8213-ffa3cc38186b\") " pod="openshift-dns/dns-default-4j5kp"
Jul 20 12:45:34.313795 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.313772    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtj2t\" (UniqueName: \"kubernetes.io/projected/8243bed4-dbd7-4ccc-8213-ffa3cc38186b-kube-api-access-vtj2t\") pod \"dns-default-4j5kp\" (UID: \"8243bed4-dbd7-4ccc-8213-ffa3cc38186b\") " pod="openshift-dns/dns-default-4j5kp"
Jul 20 12:45:34.406028 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.405985    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp6nr\" (UniqueName: \"kubernetes.io/projected/794df699-efc3-4d10-baf2-2ea2ee8e730e-kube-api-access-wp6nr\") pod \"insights-runtime-extractor-mvxsr\" (UID: \"794df699-efc3-4d10-baf2-2ea2ee8e730e\") " pod="openshift-insights/insights-runtime-extractor-mvxsr"
Jul 20 12:45:34.406028 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.406029    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7c51dab3-18c7-4abf-88e9-15fbb2925c88-cert\") pod \"ingress-canary-mfd9m\" (UID: \"7c51dab3-18c7-4abf-88e9-15fbb2925c88\") " pod="openshift-ingress-canary/ingress-canary-mfd9m"
Jul 20 12:45:34.406309 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.406056    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/794df699-efc3-4d10-baf2-2ea2ee8e730e-data-volume\") pod \"insights-runtime-extractor-mvxsr\" (UID: \"794df699-efc3-4d10-baf2-2ea2ee8e730e\") " pod="openshift-insights/insights-runtime-extractor-mvxsr"
Jul 20 12:45:34.406309 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.406081    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/794df699-efc3-4d10-baf2-2ea2ee8e730e-crio-socket\") pod \"insights-runtime-extractor-mvxsr\" (UID: \"794df699-efc3-4d10-baf2-2ea2ee8e730e\") " pod="openshift-insights/insights-runtime-extractor-mvxsr"
Jul 20 12:45:34.406309 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.406124    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/794df699-efc3-4d10-baf2-2ea2ee8e730e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mvxsr\" (UID: \"794df699-efc3-4d10-baf2-2ea2ee8e730e\") " pod="openshift-insights/insights-runtime-extractor-mvxsr"
Jul 20 12:45:34.406309 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.406145    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnlqs\" (UniqueName: \"kubernetes.io/projected/7c51dab3-18c7-4abf-88e9-15fbb2925c88-kube-api-access-pnlqs\") pod \"ingress-canary-mfd9m\" (UID: \"7c51dab3-18c7-4abf-88e9-15fbb2925c88\") " pod="openshift-ingress-canary/ingress-canary-mfd9m"
Jul 20 12:45:34.406309 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.406191    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/794df699-efc3-4d10-baf2-2ea2ee8e730e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mvxsr\" (UID: \"794df699-efc3-4d10-baf2-2ea2ee8e730e\") " pod="openshift-insights/insights-runtime-extractor-mvxsr"
Jul 20 12:45:34.406536 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.406346    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/794df699-efc3-4d10-baf2-2ea2ee8e730e-crio-socket\") pod \"insights-runtime-extractor-mvxsr\" (UID: \"794df699-efc3-4d10-baf2-2ea2ee8e730e\") " pod="openshift-insights/insights-runtime-extractor-mvxsr"
Jul 20 12:45:34.406536 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.406440    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/794df699-efc3-4d10-baf2-2ea2ee8e730e-data-volume\") pod \"insights-runtime-extractor-mvxsr\" (UID: \"794df699-efc3-4d10-baf2-2ea2ee8e730e\") " pod="openshift-insights/insights-runtime-extractor-mvxsr"
Jul 20 12:45:34.406802 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.406785    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/794df699-efc3-4d10-baf2-2ea2ee8e730e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mvxsr\" (UID: \"794df699-efc3-4d10-baf2-2ea2ee8e730e\") " pod="openshift-insights/insights-runtime-extractor-mvxsr"
Jul 20 12:45:34.408549 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.408521    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7c51dab3-18c7-4abf-88e9-15fbb2925c88-cert\") pod \"ingress-canary-mfd9m\" (UID: \"7c51dab3-18c7-4abf-88e9-15fbb2925c88\") " pod="openshift-ingress-canary/ingress-canary-mfd9m"
Jul 20 12:45:34.408656 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.408523    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/794df699-efc3-4d10-baf2-2ea2ee8e730e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mvxsr\" (UID: \"794df699-efc3-4d10-baf2-2ea2ee8e730e\") " pod="openshift-insights/insights-runtime-extractor-mvxsr"
Jul 20 12:45:34.414459 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.414435    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp6nr\" (UniqueName: \"kubernetes.io/projected/794df699-efc3-4d10-baf2-2ea2ee8e730e-kube-api-access-wp6nr\") pod \"insights-runtime-extractor-mvxsr\" (UID: \"794df699-efc3-4d10-baf2-2ea2ee8e730e\") " pod="openshift-insights/insights-runtime-extractor-mvxsr"
Jul 20 12:45:34.414566 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.414545    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnlqs\" (UniqueName: \"kubernetes.io/projected/7c51dab3-18c7-4abf-88e9-15fbb2925c88-kube-api-access-pnlqs\") pod \"ingress-canary-mfd9m\" (UID: \"7c51dab3-18c7-4abf-88e9-15fbb2925c88\") " pod="openshift-ingress-canary/ingress-canary-mfd9m"
Jul 20 12:45:34.428389 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.428358    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4j5kp"
Jul 20 12:45:34.451692 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.451662    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mvxsr"
Jul 20 12:45:34.536234 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.536196    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mfd9m"
Jul 20 12:45:34.652391 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.652359    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mvxsr"]
Jul 20 12:45:34.654510 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.654479    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4j5kp"]
Jul 20 12:45:34.656553 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:45:34.656530    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod794df699_efc3_4d10_baf2_2ea2ee8e730e.slice/crio-e8f1e91924012a08b233543274e072e58d1b594839ffa574271e5be45edea6f3 WatchSource:0}: Error finding container e8f1e91924012a08b233543274e072e58d1b594839ffa574271e5be45edea6f3: Status 404 returned error can't find the container with id e8f1e91924012a08b233543274e072e58d1b594839ffa574271e5be45edea6f3
Jul 20 12:45:34.656918 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:45:34.656864    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8243bed4_dbd7_4ccc_8213_ffa3cc38186b.slice/crio-bf02bbf925578fb591b2c73412f507ce7c99364aee1179f27e8f23ba13cfbe9c WatchSource:0}: Error finding container bf02bbf925578fb591b2c73412f507ce7c99364aee1179f27e8f23ba13cfbe9c: Status 404 returned error can't find the container with id bf02bbf925578fb591b2c73412f507ce7c99364aee1179f27e8f23ba13cfbe9c
Jul 20 12:45:34.706011 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.705977    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mfd9m"]
Jul 20 12:45:34.708951 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:45:34.708925    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c51dab3_18c7_4abf_88e9_15fbb2925c88.slice/crio-57adb12a24908e507d222e5368cadad111d2f62bd34a3fc7b5c6140ce74aa680 WatchSource:0}: Error finding container 57adb12a24908e507d222e5368cadad111d2f62bd34a3fc7b5c6140ce74aa680: Status 404 returned error can't find the container with id 57adb12a24908e507d222e5368cadad111d2f62bd34a3fc7b5c6140ce74aa680
Jul 20 12:45:34.801592 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.801552    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nt9ss"
Jul 20 12:45:34.805019 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.804995    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 20 12:45:34.805377 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.804996    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cg6n8\""
Jul 20 12:45:34.805377 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:34.804996    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 20 12:45:35.066282 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:35.066193    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mfd9m" event={"ID":"7c51dab3-18c7-4abf-88e9-15fbb2925c88","Type":"ContainerStarted","Data":"57adb12a24908e507d222e5368cadad111d2f62bd34a3fc7b5c6140ce74aa680"}
Jul 20 12:45:35.067301 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:35.067274    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mvxsr" event={"ID":"794df699-efc3-4d10-baf2-2ea2ee8e730e","Type":"ContainerStarted","Data":"e8f1e91924012a08b233543274e072e58d1b594839ffa574271e5be45edea6f3"}
Jul 20 12:45:35.068277 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:35.068243    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4j5kp" event={"ID":"8243bed4-dbd7-4ccc-8213-ffa3cc38186b","Type":"ContainerStarted","Data":"bf02bbf925578fb591b2c73412f507ce7c99364aee1179f27e8f23ba13cfbe9c"}
Jul 20 12:45:35.802374 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:35.802327    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dkkp"
Jul 20 12:45:35.803911 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:35.803306    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn69x"
Jul 20 12:45:35.807471 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:35.807413    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 20 12:45:35.807849 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:35.807501    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pvfjj\""
Jul 20 12:45:35.807849 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:35.807631    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 20 12:45:41.413009 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:41.412797    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69d95f68b6-bhfk2"]
Jul 20 12:45:41.429109 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:41.429060    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69d95f68b6-bhfk2"]
Jul 20 12:45:41.429274 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:41.429195    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69d95f68b6-bhfk2"
Jul 20 12:45:41.432822 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:41.432793    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9wlk9\""
Jul 20 12:45:41.432822 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:41.432801    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 20 12:45:41.433033 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:41.432822    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 20 12:45:41.434351 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:41.434328    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 20 12:45:41.434659 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:41.434366    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 20 12:45:41.434659 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:41.434416    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 20 12:45:41.434659 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:41.434449    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 20 12:45:41.434659 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:41.434328    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 20 12:45:41.565544 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:41.565517    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8ef0d58e-006c-4b3f-b1ce-c15211ca5a84-console-serving-cert\") pod \"console-69d95f68b6-bhfk2\" (UID: \"8ef0d58e-006c-4b3f-b1ce-c15211ca5a84\") " pod="openshift-console/console-69d95f68b6-bhfk2"
Jul 20 12:45:41.565674 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:41.565578    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8ef0d58e-006c-4b3f-b1ce-c15211ca5a84-oauth-serving-cert\") pod \"console-69d95f68b6-bhfk2\" (UID: \"8ef0d58e-006c-4b3f-b1ce-c15211ca5a84\") " pod="openshift-console/console-69d95f68b6-bhfk2"
Jul 20 12:45:41.565736 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:41.565708    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8ef0d58e-006c-4b3f-b1ce-c15211ca5a84-console-oauth-config\") pod \"console-69d95f68b6-bhfk2\" (UID: \"8ef0d58e-006c-4b3f-b1ce-c15211ca5a84\") " pod="openshift-console/console-69d95f68b6-bhfk2"
Jul 20 12:45:41.565794 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:41.565743    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8ef0d58e-006c-4b3f-b1ce-c15211ca5a84-service-ca\") pod \"console-69d95f68b6-bhfk2\" (UID: \"8ef0d58e-006c-4b3f-b1ce-c15211ca5a84\") " pod="openshift-console/console-69d95f68b6-bhfk2"
Jul 20 12:45:41.565794 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:41.565775    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gh4d\" (UniqueName: \"kubernetes.io/projected/8ef0d58e-006c-4b3f-b1ce-c15211ca5a84-kube-api-access-5gh4d\") pod \"console-69d95f68b6-bhfk2\" (UID: \"8ef0d58e-006c-4b3f-b1ce-c15211ca5a84\") " pod="openshift-console/console-69d95f68b6-bhfk2"
Jul 20 12:45:41.565903 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:41.565805    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8ef0d58e-006c-4b3f-b1ce-c15211ca5a84-console-config\") pod \"console-69d95f68b6-bhfk2\" (UID: \"8ef0d58e-006c-4b3f-b1ce-c15211ca5a84\") " pod="openshift-console/console-69d95f68b6-bhfk2"
Jul 20 12:45:41.666451 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:41.666364    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8ef0d58e-006c-4b3f-b1ce-c15211ca5a84-console-serving-cert\") pod \"console-69d95f68b6-bhfk2\" (UID: \"8ef0d58e-006c-4b3f-b1ce-c15211ca5a84\") " pod="openshift-console/console-69d95f68b6-bhfk2"
Jul 20 12:45:41.666451 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:41.666417    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8ef0d58e-006c-4b3f-b1ce-c15211ca5a84-oauth-serving-cert\") pod \"console-69d95f68b6-bhfk2\" (UID: \"8ef0d58e-006c-4b3f-b1ce-c15211ca5a84\") " pod="openshift-console/console-69d95f68b6-bhfk2"
Jul 20 12:45:41.666687 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:41.666460    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8ef0d58e-006c-4b3f-b1ce-c15211ca5a84-console-oauth-config\") pod \"console-69d95f68b6-bhfk2\" (UID: \"8ef0d58e-006c-4b3f-b1ce-c15211ca5a84\") " pod="openshift-console/console-69d95f68b6-bhfk2"
Jul 20 12:45:41.666687 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:41.666479    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8ef0d58e-006c-4b3f-b1ce-c15211ca5a84-service-ca\") pod \"console-69d95f68b6-bhfk2\" (UID: \"8ef0d58e-006c-4b3f-b1ce-c15211ca5a84\") " pod="openshift-console/console-69d95f68b6-bhfk2"
Jul 20 12:45:41.666687 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:41.666514    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gh4d\" (UniqueName: \"kubernetes.io/projected/8ef0d58e-006c-4b3f-b1ce-c15211ca5a84-kube-api-access-5gh4d\") pod \"console-69d95f68b6-bhfk2\" (UID: \"8ef0d58e-006c-4b3f-b1ce-c15211ca5a84\") " pod="openshift-console/console-69d95f68b6-bhfk2"
Jul 20 12:45:41.666687 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:41.666559    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8ef0d58e-006c-4b3f-b1ce-c15211ca5a84-console-config\") pod \"console-69d95f68b6-bhfk2\" (UID: \"8ef0d58e-006c-4b3f-b1ce-c15211ca5a84\") " pod="openshift-console/console-69d95f68b6-bhfk2"
Jul 20 12:45:41.667328 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:41.667276    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8ef0d58e-006c-4b3f-b1ce-c15211ca5a84-oauth-serving-cert\") pod \"console-69d95f68b6-bhfk2\" (UID: \"8ef0d58e-006c-4b3f-b1ce-c15211ca5a84\") " pod="openshift-console/console-69d95f68b6-bhfk2"
Jul 20 12:45:41.667461 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:41.667372    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8ef0d58e-006c-4b3f-b1ce-c15211ca5a84-service-ca\") pod \"console-69d95f68b6-bhfk2\" (UID: \"8ef0d58e-006c-4b3f-b1ce-c15211ca5a84\") " pod="openshift-console/console-69d95f68b6-bhfk2"
Jul 20 12:45:41.667521 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:41.667498    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8ef0d58e-006c-4b3f-b1ce-c15211ca5a84-console-config\") pod \"console-69d95f68b6-bhfk2\" (UID: \"8ef0d58e-006c-4b3f-b1ce-c15211ca5a84\") " pod="openshift-console/console-69d95f68b6-bhfk2"
Jul 20 12:45:41.670208 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:41.670167    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8ef0d58e-006c-4b3f-b1ce-c15211ca5a84-console-oauth-config\") pod \"console-69d95f68b6-bhfk2\" (UID: \"8ef0d58e-006c-4b3f-b1ce-c15211ca5a84\") " pod="openshift-console/console-69d95f68b6-bhfk2"
Jul 20 12:45:41.670320 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:41.670301    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8ef0d58e-006c-4b3f-b1ce-c15211ca5a84-console-serving-cert\") pod \"console-69d95f68b6-bhfk2\" (UID: \"8ef0d58e-006c-4b3f-b1ce-c15211ca5a84\") " pod="openshift-console/console-69d95f68b6-bhfk2"
Jul 20 12:45:41.677615 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:41.677591    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gh4d\" (UniqueName: \"kubernetes.io/projected/8ef0d58e-006c-4b3f-b1ce-c15211ca5a84-kube-api-access-5gh4d\") pod \"console-69d95f68b6-bhfk2\" (UID: \"8ef0d58e-006c-4b3f-b1ce-c15211ca5a84\") " pod="openshift-console/console-69d95f68b6-bhfk2"
Jul 20 12:45:41.740247 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:41.740203    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69d95f68b6-bhfk2"
Jul 20 12:45:41.807531 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:41.807493    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-lx846"]
Jul 20 12:45:41.821621 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:41.821388    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-lx846"]
Jul 20 12:45:41.821779 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:41.821506    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-lx846"
Jul 20 12:45:41.825141 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:41.824930    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 20 12:45:41.825785 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:41.825746    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-2nqvb\""
Jul 20 12:45:41.968936 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:41.968786    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/865e4acd-c06d-4d59-bbfa-8f10bf0d1115-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-lx846\" (UID: \"865e4acd-c06d-4d59-bbfa-8f10bf0d1115\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-lx846"
Jul 20 12:45:41.971484 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:41.971451    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69d95f68b6-bhfk2"]
Jul 20 12:45:41.975140 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:45:41.975106    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ef0d58e_006c_4b3f_b1ce_c15211ca5a84.slice/crio-f0de8102a3669cbdc6eb342a23b79262b77b9a3082589ea580daffb21e79b24a WatchSource:0}: Error finding container f0de8102a3669cbdc6eb342a23b79262b77b9a3082589ea580daffb21e79b24a: Status 404 returned error can't find the container with id f0de8102a3669cbdc6eb342a23b79262b77b9a3082589ea580daffb21e79b24a
Jul 20 12:45:42.069286 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:42.069241    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/865e4acd-c06d-4d59-bbfa-8f10bf0d1115-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-lx846\" (UID: \"865e4acd-c06d-4d59-bbfa-8f10bf0d1115\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-lx846"
Jul 20 12:45:42.073138 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:42.073107    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/865e4acd-c06d-4d59-bbfa-8f10bf0d1115-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-lx846\" (UID: \"865e4acd-c06d-4d59-bbfa-8f10bf0d1115\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-lx846"
Jul 20 12:45:42.088578 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:42.088545    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mfd9m" event={"ID":"7c51dab3-18c7-4abf-88e9-15fbb2925c88","Type":"ContainerStarted","Data":"80408fa09904edda9c66da356d6a5e4885be590d1b1cec0237b2f6fc1ee61328"}
Jul 20 12:45:42.089993 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:42.089967    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mvxsr" event={"ID":"794df699-efc3-4d10-baf2-2ea2ee8e730e","Type":"ContainerStarted","Data":"e43622d2f0c45ba24f727add46f5114305baef3254efe277fbf47f8398fe6b95"}
Jul 20 12:45:42.091107 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:42.091058    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69d95f68b6-bhfk2" event={"ID":"8ef0d58e-006c-4b3f-b1ce-c15211ca5a84","Type":"ContainerStarted","Data":"f0de8102a3669cbdc6eb342a23b79262b77b9a3082589ea580daffb21e79b24a"}
Jul 20 12:45:42.092692 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:42.092670    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4j5kp" event={"ID":"8243bed4-dbd7-4ccc-8213-ffa3cc38186b","Type":"ContainerStarted","Data":"fd4cc2dc215fa0b35a7388bbbb49398121b3bb0e7b850e57918b8572c7740a27"}
Jul 20 12:45:42.092820 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:42.092712    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4j5kp" event={"ID":"8243bed4-dbd7-4ccc-8213-ffa3cc38186b","Type":"ContainerStarted","Data":"6beadc9949dea6c007297098170c1130e755876831dc517e31391995442dacf5"}
Jul 20 12:45:42.092820 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:42.092807    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4j5kp"
Jul 20 12:45:42.105999 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:42.105953    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mfd9m" podStartSLOduration=1.2756230290000001 podStartE2EDuration="8.105936889s" totalImagesPullingTime="6.83031386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:45:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:45:42.105695096 +0000 UTC m=+54.860744491" watchObservedRunningTime="2026-07-20 12:45:42.105936889 +0000 UTC m=+54.860986242"
Jul 20 12:45:42.124776 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:42.124708    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4j5kp" podStartSLOduration=1.242914422 podStartE2EDuration="8.124686158s" totalImagesPullingTime="6.881771736s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:45:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:45:42.123460792 +0000 UTC m=+54.878510168" watchObservedRunningTime="2026-07-20 12:45:42.124686158 +0000 UTC m=+54.879735533"
Jul 20 12:45:42.134046 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:42.134016    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-lx846"
Jul 20 12:45:42.303252 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:42.303054    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-lx846"]
Jul 20 12:45:42.306825 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:45:42.306795    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod865e4acd_c06d_4d59_bbfa_8f10bf0d1115.slice/crio-f3148213e828dfc53d1b90c107f171d4f84e4f3c3d38bfbf0b663dc1803714b1 WatchSource:0}: Error finding container f3148213e828dfc53d1b90c107f171d4f84e4f3c3d38bfbf0b663dc1803714b1: Status 404 returned error can't find the container with id f3148213e828dfc53d1b90c107f171d4f84e4f3c3d38bfbf0b663dc1803714b1
Jul 20 12:45:43.097894 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:43.097851    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-lx846" event={"ID":"865e4acd-c06d-4d59-bbfa-8f10bf0d1115","Type":"ContainerStarted","Data":"f3148213e828dfc53d1b90c107f171d4f84e4f3c3d38bfbf0b663dc1803714b1"}
Jul 20 12:45:43.609843 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:43.609808    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-758d48dd55-tj6b2"]
Jul 20 12:45:43.611981 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:43.611955    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-758d48dd55-tj6b2"
Jul 20 12:45:43.623389 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:43.623160    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 20 12:45:43.624064 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:43.624004    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-758d48dd55-tj6b2"]
Jul 20 12:45:43.788940 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:43.788714    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ca8af42a-dd23-4216-8455-4671eeebd8e2-oauth-serving-cert\") pod \"console-758d48dd55-tj6b2\" (UID: \"ca8af42a-dd23-4216-8455-4671eeebd8e2\") " pod="openshift-console/console-758d48dd55-tj6b2"
Jul 20 12:45:43.788940 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:43.788749    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vwbs\" (UniqueName: \"kubernetes.io/projected/ca8af42a-dd23-4216-8455-4671eeebd8e2-kube-api-access-2vwbs\") pod \"console-758d48dd55-tj6b2\" (UID: \"ca8af42a-dd23-4216-8455-4671eeebd8e2\") " pod="openshift-console/console-758d48dd55-tj6b2"
Jul 20 12:45:43.788940 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:43.788794    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ca8af42a-dd23-4216-8455-4671eeebd8e2-console-oauth-config\") pod \"console-758d48dd55-tj6b2\" (UID: \"ca8af42a-dd23-4216-8455-4671eeebd8e2\") " pod="openshift-console/console-758d48dd55-tj6b2"
Jul 20 12:45:43.788940 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:43.788819    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ca8af42a-dd23-4216-8455-4671eeebd8e2-console-config\") pod \"console-758d48dd55-tj6b2\" (UID: \"ca8af42a-dd23-4216-8455-4671eeebd8e2\") " pod="openshift-console/console-758d48dd55-tj6b2"
Jul 20 12:45:43.788940 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:43.788900    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ca8af42a-dd23-4216-8455-4671eeebd8e2-console-serving-cert\") pod \"console-758d48dd55-tj6b2\" (UID: \"ca8af42a-dd23-4216-8455-4671eeebd8e2\") " pod="openshift-console/console-758d48dd55-tj6b2"
Jul 20 12:45:43.789413 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:43.789008    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ca8af42a-dd23-4216-8455-4671eeebd8e2-service-ca\") pod \"console-758d48dd55-tj6b2\" (UID: \"ca8af42a-dd23-4216-8455-4671eeebd8e2\") " pod="openshift-console/console-758d48dd55-tj6b2"
Jul 20 12:45:43.789413 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:43.789049    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca8af42a-dd23-4216-8455-4671eeebd8e2-trusted-ca-bundle\") pod \"console-758d48dd55-tj6b2\" (UID: \"ca8af42a-dd23-4216-8455-4671eeebd8e2\") " pod="openshift-console/console-758d48dd55-tj6b2"
Jul 20 12:45:43.889883 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:43.889800    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ca8af42a-dd23-4216-8455-4671eeebd8e2-service-ca\") pod \"console-758d48dd55-tj6b2\" (UID: \"ca8af42a-dd23-4216-8455-4671eeebd8e2\") " pod="openshift-console/console-758d48dd55-tj6b2"
Jul 20 12:45:43.889883 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:43.889839    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca8af42a-dd23-4216-8455-4671eeebd8e2-trusted-ca-bundle\") pod \"console-758d48dd55-tj6b2\" (UID: \"ca8af42a-dd23-4216-8455-4671eeebd8e2\") " pod="openshift-console/console-758d48dd55-tj6b2"
Jul 20 12:45:43.889883 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:43.889885    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ca8af42a-dd23-4216-8455-4671eeebd8e2-oauth-serving-cert\") pod \"console-758d48dd55-tj6b2\" (UID: \"ca8af42a-dd23-4216-8455-4671eeebd8e2\") " pod="openshift-console/console-758d48dd55-tj6b2"
Jul 20 12:45:43.890135 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:43.889902    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vwbs\" (UniqueName: \"kubernetes.io/projected/ca8af42a-dd23-4216-8455-4671eeebd8e2-kube-api-access-2vwbs\") pod \"console-758d48dd55-tj6b2\" (UID: \"ca8af42a-dd23-4216-8455-4671eeebd8e2\") " pod="openshift-console/console-758d48dd55-tj6b2"
Jul 20 12:45:43.890135 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:43.889932    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ca8af42a-dd23-4216-8455-4671eeebd8e2-console-oauth-config\") pod \"console-758d48dd55-tj6b2\" (UID: \"ca8af42a-dd23-4216-8455-4671eeebd8e2\") " pod="openshift-console/console-758d48dd55-tj6b2"
Jul 20 12:45:43.890135 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:43.889950    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ca8af42a-dd23-4216-8455-4671eeebd8e2-console-config\") pod \"console-758d48dd55-tj6b2\" (UID: \"ca8af42a-dd23-4216-8455-4671eeebd8e2\") " pod="openshift-console/console-758d48dd55-tj6b2"
Jul 20 12:45:43.890370 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:43.890341    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ca8af42a-dd23-4216-8455-4671eeebd8e2-console-serving-cert\") pod \"console-758d48dd55-tj6b2\" (UID: \"ca8af42a-dd23-4216-8455-4671eeebd8e2\") " pod="openshift-console/console-758d48dd55-tj6b2"
Jul 20 12:45:43.890731 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:43.890706    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ca8af42a-dd23-4216-8455-4671eeebd8e2-service-ca\") pod \"console-758d48dd55-tj6b2\" (UID: \"ca8af42a-dd23-4216-8455-4671eeebd8e2\") " pod="openshift-console/console-758d48dd55-tj6b2"
Jul 20 12:45:43.890841 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:43.890706    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ca8af42a-dd23-4216-8455-4671eeebd8e2-oauth-serving-cert\") pod \"console-758d48dd55-tj6b2\" (UID: \"ca8af42a-dd23-4216-8455-4671eeebd8e2\") " pod="openshift-console/console-758d48dd55-tj6b2"
Jul 20 12:45:43.890841 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:43.890753    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ca8af42a-dd23-4216-8455-4671eeebd8e2-console-config\") pod \"console-758d48dd55-tj6b2\" (UID: \"ca8af42a-dd23-4216-8455-4671eeebd8e2\") " pod="openshift-console/console-758d48dd55-tj6b2"
Jul 20 12:45:43.891308 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:43.891281    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca8af42a-dd23-4216-8455-4671eeebd8e2-trusted-ca-bundle\") pod \"console-758d48dd55-tj6b2\" (UID: \"ca8af42a-dd23-4216-8455-4671eeebd8e2\") " pod="openshift-console/console-758d48dd55-tj6b2"
Jul 20 12:45:43.894051 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:43.893995    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ca8af42a-dd23-4216-8455-4671eeebd8e2-console-oauth-config\") pod \"console-758d48dd55-tj6b2\" (UID: \"ca8af42a-dd23-4216-8455-4671eeebd8e2\") " pod="openshift-console/console-758d48dd55-tj6b2"
Jul 20 12:45:43.894051 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:43.894029    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ca8af42a-dd23-4216-8455-4671eeebd8e2-console-serving-cert\") pod \"console-758d48dd55-tj6b2\" (UID: \"ca8af42a-dd23-4216-8455-4671eeebd8e2\") " pod="openshift-console/console-758d48dd55-tj6b2"
Jul 20 12:45:43.900000 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:43.899974    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vwbs\" (UniqueName: \"kubernetes.io/projected/ca8af42a-dd23-4216-8455-4671eeebd8e2-kube-api-access-2vwbs\") pod \"console-758d48dd55-tj6b2\" (UID: \"ca8af42a-dd23-4216-8455-4671eeebd8e2\") " pod="openshift-console/console-758d48dd55-tj6b2"
Jul 20 12:45:43.926012 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:43.925962    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-758d48dd55-tj6b2"
Jul 20 12:45:44.106274 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:44.106236    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-lx846" event={"ID":"865e4acd-c06d-4d59-bbfa-8f10bf0d1115","Type":"ContainerStarted","Data":"4230bb52b6604b679762c1841bc0a6d020fcb756a6bac523dfa50691c13db1fe"}
Jul 20 12:45:44.107111 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:44.106479    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-lx846"
Jul 20 12:45:44.112121 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:44.112095    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-lx846"
Jul 20 12:45:44.123252 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:44.123194    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-lx846" podStartSLOduration=1.796984146 podStartE2EDuration="3.123179985s" totalImagesPullingTime="1.326195839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:45:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:45:44.122712233 +0000 UTC m=+56.877761607" watchObservedRunningTime="2026-07-20 12:45:44.123179985 +0000 UTC m=+56.878229359"
Jul 20 12:45:44.875756 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:44.875708    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-ckq4q"]
Jul 20 12:45:44.891725 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:44.891690    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-ckq4q"]
Jul 20 12:45:44.891905 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:44.891843    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-ckq4q"
Jul 20 12:45:44.895202 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:44.895178    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 20 12:45:44.896826 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:44.896803    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 20 12:45:44.896826 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:44.896824    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 20 12:45:44.897024 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:44.896837    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 20 12:45:44.897024 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:44.896848    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 20 12:45:44.897209 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:44.897183    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-g5rb2\""
Jul 20 12:45:44.999871 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:44.999835    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9520cffc-4076-44fb-ac67-6ebf0bb879ca-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-ckq4q\" (UID: \"9520cffc-4076-44fb-ac67-6ebf0bb879ca\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ckq4q"
Jul 20 12:45:45.000047 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:44.999916    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9520cffc-4076-44fb-ac67-6ebf0bb879ca-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-ckq4q\" (UID: \"9520cffc-4076-44fb-ac67-6ebf0bb879ca\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ckq4q"
Jul 20 12:45:45.000047 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:44.999965    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9520cffc-4076-44fb-ac67-6ebf0bb879ca-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-ckq4q\" (UID: \"9520cffc-4076-44fb-ac67-6ebf0bb879ca\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ckq4q"
Jul 20 12:45:45.000047 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:44.999987    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tg6z\" (UniqueName: \"kubernetes.io/projected/9520cffc-4076-44fb-ac67-6ebf0bb879ca-kube-api-access-5tg6z\") pod \"prometheus-operator-5945b5cfd-ckq4q\" (UID: \"9520cffc-4076-44fb-ac67-6ebf0bb879ca\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ckq4q"
Jul 20 12:45:45.100485 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:45.100443    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9520cffc-4076-44fb-ac67-6ebf0bb879ca-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-ckq4q\" (UID: \"9520cffc-4076-44fb-ac67-6ebf0bb879ca\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ckq4q"
Jul 20 12:45:45.100691 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:45.100507    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9520cffc-4076-44fb-ac67-6ebf0bb879ca-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-ckq4q\" (UID: \"9520cffc-4076-44fb-ac67-6ebf0bb879ca\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ckq4q"
Jul 20 12:45:45.100759 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:45.100688    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9520cffc-4076-44fb-ac67-6ebf0bb879ca-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-ckq4q\" (UID: \"9520cffc-4076-44fb-ac67-6ebf0bb879ca\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ckq4q"
Jul 20 12:45:45.100759 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:45.100720    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tg6z\" (UniqueName: \"kubernetes.io/projected/9520cffc-4076-44fb-ac67-6ebf0bb879ca-kube-api-access-5tg6z\") pod \"prometheus-operator-5945b5cfd-ckq4q\" (UID: \"9520cffc-4076-44fb-ac67-6ebf0bb879ca\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ckq4q"
Jul 20 12:45:45.101412 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:45.101387    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9520cffc-4076-44fb-ac67-6ebf0bb879ca-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-ckq4q\" (UID: \"9520cffc-4076-44fb-ac67-6ebf0bb879ca\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ckq4q"
Jul 20 12:45:45.103274 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:45.103252    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9520cffc-4076-44fb-ac67-6ebf0bb879ca-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-ckq4q\" (UID: \"9520cffc-4076-44fb-ac67-6ebf0bb879ca\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ckq4q"
Jul 20 12:45:45.103711 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:45.103687    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9520cffc-4076-44fb-ac67-6ebf0bb879ca-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-ckq4q\" (UID: \"9520cffc-4076-44fb-ac67-6ebf0bb879ca\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ckq4q"
Jul 20 12:45:45.109926 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:45.109898    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tg6z\" (UniqueName: \"kubernetes.io/projected/9520cffc-4076-44fb-ac67-6ebf0bb879ca-kube-api-access-5tg6z\") pod \"prometheus-operator-5945b5cfd-ckq4q\" (UID: \"9520cffc-4076-44fb-ac67-6ebf0bb879ca\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ckq4q"
Jul 20 12:45:45.203538 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:45.203451    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-ckq4q"
Jul 20 12:45:46.809663 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:46.809629    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-ckq4q"]
Jul 20 12:45:46.823912 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:46.823878    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-758d48dd55-tj6b2"]
Jul 20 12:45:46.826439 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:45:46.826395    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca8af42a_dd23_4216_8455_4671eeebd8e2.slice/crio-6d175c946482e82748cdf9fe01426f8b41b0e65fbcc3fce7c83f7e1363bc7398 WatchSource:0}: Error finding container 6d175c946482e82748cdf9fe01426f8b41b0e65fbcc3fce7c83f7e1363bc7398: Status 404 returned error can't find the container with id 6d175c946482e82748cdf9fe01426f8b41b0e65fbcc3fce7c83f7e1363bc7398
Jul 20 12:45:47.120693 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:47.120591    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mvxsr" event={"ID":"794df699-efc3-4d10-baf2-2ea2ee8e730e","Type":"ContainerStarted","Data":"8c84aeb8c3b713de67d5d85f29fc2071e21f136f0b063d3f797fad646e7b5c02"}
Jul 20 12:45:47.122080 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:47.122052    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69d95f68b6-bhfk2" event={"ID":"8ef0d58e-006c-4b3f-b1ce-c15211ca5a84","Type":"ContainerStarted","Data":"9433d14b0733afe7c733d6721db1c636a3e34210cb855e40bca0b77126e1a228"}
Jul 20 12:45:47.123325 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:47.123297    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-ckq4q" event={"ID":"9520cffc-4076-44fb-ac67-6ebf0bb879ca","Type":"ContainerStarted","Data":"cda3af4ba56f97046334a2dad8924deb00d6099cdd6b59f22b9edcf1338ca65e"}
Jul 20 12:45:47.124748 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:47.124720    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-758d48dd55-tj6b2" event={"ID":"ca8af42a-dd23-4216-8455-4671eeebd8e2","Type":"ContainerStarted","Data":"e9f3aa49bb7c40654cc36ac0fbe24d14cd584e6417f2ce7690fbfd15754bff38"}
Jul 20 12:45:47.124800 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:47.124757    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-758d48dd55-tj6b2" event={"ID":"ca8af42a-dd23-4216-8455-4671eeebd8e2","Type":"ContainerStarted","Data":"6d175c946482e82748cdf9fe01426f8b41b0e65fbcc3fce7c83f7e1363bc7398"}
Jul 20 12:45:47.145272 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:47.145226    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69d95f68b6-bhfk2" podStartSLOduration=1.466009178 podStartE2EDuration="6.145210014s" totalImagesPullingTime="4.679200836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:45:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:45:47.144984421 +0000 UTC m=+59.900033795" watchObservedRunningTime="2026-07-20 12:45:47.145210014 +0000 UTC m=+59.900259384"
Jul 20 12:45:47.163840 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:47.163787    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-758d48dd55-tj6b2" podStartSLOduration=4.163771784 podStartE2EDuration="4.163771784s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:45:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:45:47.163242767 +0000 UTC m=+59.918292168" watchObservedRunningTime="2026-07-20 12:45:47.163771784 +0000 UTC m=+59.918821138"
Jul 20 12:45:49.038343 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:49.038308    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rhdn8"
Jul 20 12:45:51.142508 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:51.142460    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mvxsr" event={"ID":"794df699-efc3-4d10-baf2-2ea2ee8e730e","Type":"ContainerStarted","Data":"3da7d6de035e578a6234261067ad1dbbfbd27ee49fb1d00b2384cf91772c3e74"}
Jul 20 12:45:51.144240 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:51.144212    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-ckq4q" event={"ID":"9520cffc-4076-44fb-ac67-6ebf0bb879ca","Type":"ContainerStarted","Data":"2c4497382fc4c161b35e7ad8915c76fc80f74a0868a167639c49988ae48837c7"}
Jul 20 12:45:51.144356 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:51.144253    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-ckq4q" event={"ID":"9520cffc-4076-44fb-ac67-6ebf0bb879ca","Type":"ContainerStarted","Data":"91c5d40f58e8f99c6427c7ca1af2d44aa9a9c93c51f44d0c50ad1dcccb245a34"}
Jul 20 12:45:51.167395 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:51.167345    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mvxsr" podStartSLOduration=1.435184761 podStartE2EDuration="17.167330793s" totalImagesPullingTime="15.732146032s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 12:45:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:45:51.165344069 +0000 UTC m=+63.920393464" watchObservedRunningTime="2026-07-20 12:45:51.167330793 +0000 UTC m=+63.922380169"
Jul 20 12:45:51.181652 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:51.181604    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-ckq4q" podStartSLOduration=3.436819463 podStartE2EDuration="7.181588543s" totalImagesPullingTime="3.74476908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:45:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:45:51.180954743 +0000 UTC m=+63.936004118" watchObservedRunningTime="2026-07-20 12:45:51.181588543 +0000 UTC m=+63.936637917"
Jul 20 12:45:51.741296 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:51.741240    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69d95f68b6-bhfk2"
Jul 20 12:45:51.741296 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:51.741316    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69d95f68b6-bhfk2"
Jul 20 12:45:51.747534 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:51.747507    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69d95f68b6-bhfk2"
Jul 20 12:45:52.100488 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:52.100456    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4j5kp"
Jul 20 12:45:52.152060 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:52.152028    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69d95f68b6-bhfk2"
Jul 20 12:45:53.212856 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.212819    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-pnvnz"]
Jul 20 12:45:53.215135 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.215117    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-pnvnz"
Jul 20 12:45:53.219228 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.218979    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-rz82k\""
Jul 20 12:45:53.220751 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.220733    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 20 12:45:53.220857 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.220755    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 20 12:45:53.221936 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.221912    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-hmvmr"]
Jul 20 12:45:53.224000 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.223983    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hmvmr"
Jul 20 12:45:53.227347 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.227319    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 20 12:45:53.227456 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.227364    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ft8lg\""
Jul 20 12:45:53.227456 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.227419    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 20 12:45:53.227456 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.227361    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 20 12:45:53.228787 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.228766    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-pnvnz"]
Jul 20 12:45:53.229790 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.229768    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-swlsc"]
Jul 20 12:45:53.237713 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.237691    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-swlsc"
Jul 20 12:45:53.241034 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.240948    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 20 12:45:53.241034 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.240962    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 20 12:45:53.241034 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.240995    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-x6lmf\""
Jul 20 12:45:53.241034 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.241017    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 20 12:45:53.244953 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.244931    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-swlsc"]
Jul 20 12:45:53.265457 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.265428    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6c299747-8d0e-4a67-a268-1e81740c43be-sys\") pod \"node-exporter-hmvmr\" (UID: \"6c299747-8d0e-4a67-a268-1e81740c43be\") " pod="openshift-monitoring/node-exporter-hmvmr"
Jul 20 12:45:53.265636 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.265465    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e777b21-974d-41a0-ae44-143b5039300b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-pnvnz\" (UID: \"2e777b21-974d-41a0-ae44-143b5039300b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-pnvnz"
Jul 20 12:45:53.265636 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.265582    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6c299747-8d0e-4a67-a268-1e81740c43be-node-exporter-textfile\") pod \"node-exporter-hmvmr\" (UID: \"6c299747-8d0e-4a67-a268-1e81740c43be\") " pod="openshift-monitoring/node-exporter-hmvmr"
Jul 20 12:45:53.265739 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.265646    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6c299747-8d0e-4a67-a268-1e81740c43be-node-exporter-tls\") pod \"node-exporter-hmvmr\" (UID: \"6c299747-8d0e-4a67-a268-1e81740c43be\") " pod="openshift-monitoring/node-exporter-hmvmr"
Jul 20 12:45:53.265739 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.265675    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2mlf\" (UniqueName: \"kubernetes.io/projected/08dfd872-07ac-491c-b319-6e8da15c7389-kube-api-access-t2mlf\") pod \"kube-state-metrics-56c5594674-swlsc\" (UID: \"08dfd872-07ac-491c-b319-6e8da15c7389\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-swlsc"
Jul 20 12:45:53.265841 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.265747    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6c299747-8d0e-4a67-a268-1e81740c43be-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hmvmr\" (UID: \"6c299747-8d0e-4a67-a268-1e81740c43be\") " pod="openshift-monitoring/node-exporter-hmvmr"
Jul 20 12:45:53.265841 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.265782    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08dfd872-07ac-491c-b319-6e8da15c7389-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-swlsc\" (UID: \"08dfd872-07ac-491c-b319-6e8da15c7389\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-swlsc"
Jul 20 12:45:53.265841 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.265813    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e777b21-974d-41a0-ae44-143b5039300b-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-pnvnz\" (UID: \"2e777b21-974d-41a0-ae44-143b5039300b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-pnvnz"
Jul 20 12:45:53.265975 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.265869    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6c299747-8d0e-4a67-a268-1e81740c43be-node-exporter-accelerators-collector-config\") pod \"node-exporter-hmvmr\" (UID: \"6c299747-8d0e-4a67-a268-1e81740c43be\") " pod="openshift-monitoring/node-exporter-hmvmr"
Jul 20 12:45:53.265975 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.265898    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/08dfd872-07ac-491c-b319-6e8da15c7389-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-swlsc\" (UID: \"08dfd872-07ac-491c-b319-6e8da15c7389\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-swlsc"
Jul 20 12:45:53.266079 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.265972    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/08dfd872-07ac-491c-b319-6e8da15c7389-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-swlsc\" (UID: \"08dfd872-07ac-491c-b319-6e8da15c7389\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-swlsc"
Jul 20 12:45:53.266079 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.266037    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/08dfd872-07ac-491c-b319-6e8da15c7389-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-swlsc\" (UID: \"08dfd872-07ac-491c-b319-6e8da15c7389\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-swlsc"
Jul 20 12:45:53.266079 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.266064    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxclp\" (UniqueName: \"kubernetes.io/projected/2e777b21-974d-41a0-ae44-143b5039300b-kube-api-access-vxclp\") pod \"openshift-state-metrics-79f6958cdf-pnvnz\" (UID: \"2e777b21-974d-41a0-ae44-143b5039300b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-pnvnz"
Jul 20 12:45:53.266253 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.266156    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6c299747-8d0e-4a67-a268-1e81740c43be-root\") pod \"node-exporter-hmvmr\" (UID: \"6c299747-8d0e-4a67-a268-1e81740c43be\") " pod="openshift-monitoring/node-exporter-hmvmr"
Jul 20 12:45:53.266253 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.266182    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6c299747-8d0e-4a67-a268-1e81740c43be-node-exporter-wtmp\") pod \"node-exporter-hmvmr\" (UID: \"6c299747-8d0e-4a67-a268-1e81740c43be\") " pod="openshift-monitoring/node-exporter-hmvmr"
Jul 20 12:45:53.266253 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.266206    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c299747-8d0e-4a67-a268-1e81740c43be-metrics-client-ca\") pod \"node-exporter-hmvmr\" (UID: \"6c299747-8d0e-4a67-a268-1e81740c43be\") " pod="openshift-monitoring/node-exporter-hmvmr"
Jul 20 12:45:53.266253 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.266232    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4hgj\" (UniqueName: \"kubernetes.io/projected/6c299747-8d0e-4a67-a268-1e81740c43be-kube-api-access-x4hgj\") pod \"node-exporter-hmvmr\" (UID: \"6c299747-8d0e-4a67-a268-1e81740c43be\") " pod="openshift-monitoring/node-exporter-hmvmr"
Jul 20 12:45:53.266391 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.266274    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/08dfd872-07ac-491c-b319-6e8da15c7389-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-swlsc\" (UID: \"08dfd872-07ac-491c-b319-6e8da15c7389\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-swlsc"
Jul 20 12:45:53.266391 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.266319    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2e777b21-974d-41a0-ae44-143b5039300b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-pnvnz\" (UID: \"2e777b21-974d-41a0-ae44-143b5039300b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-pnvnz"
Jul 20 12:45:53.367370 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.367332    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6c299747-8d0e-4a67-a268-1e81740c43be-node-exporter-accelerators-collector-config\") pod \"node-exporter-hmvmr\" (UID: \"6c299747-8d0e-4a67-a268-1e81740c43be\") " pod="openshift-monitoring/node-exporter-hmvmr"
Jul 20 12:45:53.367370 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.367371    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/08dfd872-07ac-491c-b319-6e8da15c7389-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-swlsc\" (UID: \"08dfd872-07ac-491c-b319-6e8da15c7389\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-swlsc"
Jul 20 12:45:53.367614 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.367413    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/08dfd872-07ac-491c-b319-6e8da15c7389-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-swlsc\" (UID: \"08dfd872-07ac-491c-b319-6e8da15c7389\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-swlsc"
Jul 20 12:45:53.367614 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.367449    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/08dfd872-07ac-491c-b319-6e8da15c7389-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-swlsc\" (UID: \"08dfd872-07ac-491c-b319-6e8da15c7389\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-swlsc"
Jul 20 12:45:53.367614 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.367473    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxclp\" (UniqueName: \"kubernetes.io/projected/2e777b21-974d-41a0-ae44-143b5039300b-kube-api-access-vxclp\") pod \"openshift-state-metrics-79f6958cdf-pnvnz\" (UID: \"2e777b21-974d-41a0-ae44-143b5039300b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-pnvnz"
Jul 20 12:45:53.367775 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.367628    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6c299747-8d0e-4a67-a268-1e81740c43be-root\") pod \"node-exporter-hmvmr\" (UID: \"6c299747-8d0e-4a67-a268-1e81740c43be\") " pod="openshift-monitoring/node-exporter-hmvmr"
Jul 20 12:45:53.367775 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.367663    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6c299747-8d0e-4a67-a268-1e81740c43be-node-exporter-wtmp\") pod \"node-exporter-hmvmr\" (UID: \"6c299747-8d0e-4a67-a268-1e81740c43be\") " pod="openshift-monitoring/node-exporter-hmvmr"
Jul 20 12:45:53.367775 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.367686    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c299747-8d0e-4a67-a268-1e81740c43be-metrics-client-ca\") pod \"node-exporter-hmvmr\" (UID: \"6c299747-8d0e-4a67-a268-1e81740c43be\") " pod="openshift-monitoring/node-exporter-hmvmr"
Jul 20 12:45:53.367775 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.367713    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4hgj\" (UniqueName: \"kubernetes.io/projected/6c299747-8d0e-4a67-a268-1e81740c43be-kube-api-access-x4hgj\") pod \"node-exporter-hmvmr\" (UID: \"6c299747-8d0e-4a67-a268-1e81740c43be\") " pod="openshift-monitoring/node-exporter-hmvmr"
Jul 20 12:45:53.367775 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.367738    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/08dfd872-07ac-491c-b319-6e8da15c7389-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-swlsc\" (UID: \"08dfd872-07ac-491c-b319-6e8da15c7389\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-swlsc"
Jul 20 12:45:53.368004 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.367766    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6c299747-8d0e-4a67-a268-1e81740c43be-root\") pod \"node-exporter-hmvmr\" (UID: \"6c299747-8d0e-4a67-a268-1e81740c43be\") " pod="openshift-monitoring/node-exporter-hmvmr"
Jul 20 12:45:53.368004 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.367779    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2e777b21-974d-41a0-ae44-143b5039300b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-pnvnz\" (UID: \"2e777b21-974d-41a0-ae44-143b5039300b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-pnvnz"
Jul 20 12:45:53.368004 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.367854    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6c299747-8d0e-4a67-a268-1e81740c43be-sys\") pod \"node-exporter-hmvmr\" (UID: \"6c299747-8d0e-4a67-a268-1e81740c43be\") " pod="openshift-monitoring/node-exporter-hmvmr"
Jul 20 12:45:53.368004 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.367884    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e777b21-974d-41a0-ae44-143b5039300b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-pnvnz\" (UID: \"2e777b21-974d-41a0-ae44-143b5039300b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-pnvnz"
Jul 20 12:45:53.368004 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.367900    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6c299747-8d0e-4a67-a268-1e81740c43be-node-exporter-wtmp\") pod \"node-exporter-hmvmr\" (UID: \"6c299747-8d0e-4a67-a268-1e81740c43be\") " pod="openshift-monitoring/node-exporter-hmvmr"
Jul 20 12:45:53.368004 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.367935    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/08dfd872-07ac-491c-b319-6e8da15c7389-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-swlsc\" (UID: \"08dfd872-07ac-491c-b319-6e8da15c7389\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-swlsc"
Jul 20 12:45:53.368004 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.367958    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6c299747-8d0e-4a67-a268-1e81740c43be-node-exporter-textfile\") pod \"node-exporter-hmvmr\" (UID: \"6c299747-8d0e-4a67-a268-1e81740c43be\") " pod="openshift-monitoring/node-exporter-hmvmr"
Jul 20 12:45:53.368004 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.367998    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6c299747-8d0e-4a67-a268-1e81740c43be-node-exporter-tls\") pod \"node-exporter-hmvmr\" (UID: \"6c299747-8d0e-4a67-a268-1e81740c43be\") " pod="openshift-monitoring/node-exporter-hmvmr"
Jul 20 12:45:53.368461 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.368022    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2mlf\" (UniqueName: \"kubernetes.io/projected/08dfd872-07ac-491c-b319-6e8da15c7389-kube-api-access-t2mlf\") pod \"kube-state-metrics-56c5594674-swlsc\" (UID: \"08dfd872-07ac-491c-b319-6e8da15c7389\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-swlsc"
Jul 20 12:45:53.368461 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.368044    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6c299747-8d0e-4a67-a268-1e81740c43be-node-exporter-accelerators-collector-config\") pod \"node-exporter-hmvmr\" (UID: \"6c299747-8d0e-4a67-a268-1e81740c43be\") " pod="openshift-monitoring/node-exporter-hmvmr"
Jul 20 12:45:53.368461 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.368062    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6c299747-8d0e-4a67-a268-1e81740c43be-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hmvmr\" (UID: \"6c299747-8d0e-4a67-a268-1e81740c43be\") " pod="openshift-monitoring/node-exporter-hmvmr"
Jul 20 12:45:53.368461 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.368120    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08dfd872-07ac-491c-b319-6e8da15c7389-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-swlsc\" (UID: \"08dfd872-07ac-491c-b319-6e8da15c7389\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-swlsc"
Jul 20 12:45:53.368461 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.368146    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e777b21-974d-41a0-ae44-143b5039300b-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-pnvnz\" (UID: \"2e777b21-974d-41a0-ae44-143b5039300b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-pnvnz"
Jul 20 12:45:53.368461 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:53.368171    2570 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 20 12:45:53.368461 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:53.368226    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c299747-8d0e-4a67-a268-1e81740c43be-node-exporter-tls podName:6c299747-8d0e-4a67-a268-1e81740c43be nodeName:}" failed. No retries permitted until 2026-07-20 12:45:53.86820834 +0000 UTC m=+66.623257706 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/6c299747-8d0e-4a67-a268-1e81740c43be-node-exporter-tls") pod "node-exporter-hmvmr" (UID: "6c299747-8d0e-4a67-a268-1e81740c43be") : secret "node-exporter-tls" not found
Jul 20 12:45:53.368461 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.368238    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/08dfd872-07ac-491c-b319-6e8da15c7389-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-swlsc\" (UID: \"08dfd872-07ac-491c-b319-6e8da15c7389\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-swlsc"
Jul 20 12:45:53.368461 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.368254    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6c299747-8d0e-4a67-a268-1e81740c43be-node-exporter-textfile\") pod \"node-exporter-hmvmr\" (UID: \"6c299747-8d0e-4a67-a268-1e81740c43be\") " pod="openshift-monitoring/node-exporter-hmvmr"
Jul 20 12:45:53.368461 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.368311    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6c299747-8d0e-4a67-a268-1e81740c43be-sys\") pod \"node-exporter-hmvmr\" (UID: \"6c299747-8d0e-4a67-a268-1e81740c43be\") " pod="openshift-monitoring/node-exporter-hmvmr"
Jul 20 12:45:53.368461 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.368398    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c299747-8d0e-4a67-a268-1e81740c43be-metrics-client-ca\") pod \"node-exporter-hmvmr\" (UID: \"6c299747-8d0e-4a67-a268-1e81740c43be\") " pod="openshift-monitoring/node-exporter-hmvmr"
Jul 20 12:45:53.368992 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:53.368594    2570 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 20 12:45:53.368992 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:53.368643    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08dfd872-07ac-491c-b319-6e8da15c7389-kube-state-metrics-tls podName:08dfd872-07ac-491c-b319-6e8da15c7389 nodeName:}" failed. No retries permitted until 2026-07-20 12:45:53.868627884 +0000 UTC m=+66.623677236 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/08dfd872-07ac-491c-b319-6e8da15c7389-kube-state-metrics-tls") pod "kube-state-metrics-56c5594674-swlsc" (UID: "08dfd872-07ac-491c-b319-6e8da15c7389") : secret "kube-state-metrics-tls" not found
Jul 20 12:45:53.368992 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.368834    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e777b21-974d-41a0-ae44-143b5039300b-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-pnvnz\" (UID: \"2e777b21-974d-41a0-ae44-143b5039300b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-pnvnz"
Jul 20 12:45:53.368992 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.368903    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08dfd872-07ac-491c-b319-6e8da15c7389-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-swlsc\" (UID: \"08dfd872-07ac-491c-b319-6e8da15c7389\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-swlsc"
Jul 20 12:45:53.370433 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.370400    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/08dfd872-07ac-491c-b319-6e8da15c7389-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-swlsc\" (UID: \"08dfd872-07ac-491c-b319-6e8da15c7389\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-swlsc"
Jul 20 12:45:53.370603 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.370581    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e777b21-974d-41a0-ae44-143b5039300b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-pnvnz\" (UID: \"2e777b21-974d-41a0-ae44-143b5039300b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-pnvnz"
Jul 20 12:45:53.370736 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.370716    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6c299747-8d0e-4a67-a268-1e81740c43be-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hmvmr\" (UID: \"6c299747-8d0e-4a67-a268-1e81740c43be\") " pod="openshift-monitoring/node-exporter-hmvmr"
Jul 20 12:45:53.370785 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.370771    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2e777b21-974d-41a0-ae44-143b5039300b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-pnvnz\" (UID: \"2e777b21-974d-41a0-ae44-143b5039300b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-pnvnz"
Jul 20 12:45:53.379680 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.379657    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxclp\" (UniqueName: \"kubernetes.io/projected/2e777b21-974d-41a0-ae44-143b5039300b-kube-api-access-vxclp\") pod \"openshift-state-metrics-79f6958cdf-pnvnz\" (UID: \"2e777b21-974d-41a0-ae44-143b5039300b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-pnvnz"
Jul 20 12:45:53.380898 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.380880    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4hgj\" (UniqueName: \"kubernetes.io/projected/6c299747-8d0e-4a67-a268-1e81740c43be-kube-api-access-x4hgj\") pod \"node-exporter-hmvmr\" (UID: \"6c299747-8d0e-4a67-a268-1e81740c43be\") " pod="openshift-monitoring/node-exporter-hmvmr"
Jul 20 12:45:53.380998 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.380888    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2mlf\" (UniqueName: \"kubernetes.io/projected/08dfd872-07ac-491c-b319-6e8da15c7389-kube-api-access-t2mlf\") pod \"kube-state-metrics-56c5594674-swlsc\" (UID: \"08dfd872-07ac-491c-b319-6e8da15c7389\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-swlsc"
Jul 20 12:45:53.468905 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.468825    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5fbafa93-14fa-41b3-a202-eb69336c381e-original-pull-secret\") pod \"global-pull-secret-syncer-4dkkp\" (UID: \"5fbafa93-14fa-41b3-a202-eb69336c381e\") " pod="kube-system/global-pull-secret-syncer-4dkkp"
Jul 20 12:45:53.472368 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.472351    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 20 12:45:53.481284 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.481264    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5fbafa93-14fa-41b3-a202-eb69336c381e-original-pull-secret\") pod \"global-pull-secret-syncer-4dkkp\" (UID: \"5fbafa93-14fa-41b3-a202-eb69336c381e\") " pod="kube-system/global-pull-secret-syncer-4dkkp"
Jul 20 12:45:53.522443 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.522412    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dkkp"
Jul 20 12:45:53.524584 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.524560    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-pnvnz"
Jul 20 12:45:53.569946 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.569916    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5e87d68-a096-452b-a6b3-c0815771c37d-metrics-certs\") pod \"network-metrics-daemon-gn69x\" (UID: \"d5e87d68-a096-452b-a6b3-c0815771c37d\") " pod="openshift-multus/network-metrics-daemon-gn69x"
Jul 20 12:45:53.573491 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.573175    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 20 12:45:53.584669 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.584631    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5e87d68-a096-452b-a6b3-c0815771c37d-metrics-certs\") pod \"network-metrics-daemon-gn69x\" (UID: \"d5e87d68-a096-452b-a6b3-c0815771c37d\") " pod="openshift-multus/network-metrics-daemon-gn69x"
Jul 20 12:45:53.657220 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.657193    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-pnvnz"]
Jul 20 12:45:53.659324 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:45:53.659294    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e777b21_974d_41a0_ae44_143b5039300b.slice/crio-4519cbca16e5d8008df75ea4827566fdbd7ca8b01e5b00cd077c31fe7dbe59e8 WatchSource:0}: Error finding container 4519cbca16e5d8008df75ea4827566fdbd7ca8b01e5b00cd077c31fe7dbe59e8: Status 404 returned error can't find the container with id 4519cbca16e5d8008df75ea4827566fdbd7ca8b01e5b00cd077c31fe7dbe59e8
Jul 20 12:45:53.671266 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.671230    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpqcr\" (UniqueName: \"kubernetes.io/projected/d63473a8-86d8-4ad9-a2b0-26a3ab221c57-kube-api-access-vpqcr\") pod \"network-check-target-nt9ss\" (UID: \"d63473a8-86d8-4ad9-a2b0-26a3ab221c57\") " pod="openshift-network-diagnostics/network-check-target-nt9ss"
Jul 20 12:45:53.673976 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.673948    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4dkkp"]
Jul 20 12:45:53.674454 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.674433    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 20 12:45:53.684608 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.684589    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 20 12:45:53.695129 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.695075    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpqcr\" (UniqueName: \"kubernetes.io/projected/d63473a8-86d8-4ad9-a2b0-26a3ab221c57-kube-api-access-vpqcr\") pod \"network-check-target-nt9ss\" (UID: \"d63473a8-86d8-4ad9-a2b0-26a3ab221c57\") " pod="openshift-network-diagnostics/network-check-target-nt9ss"
Jul 20 12:45:53.713322 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.713302    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cg6n8\""
Jul 20 12:45:53.720939 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.720922    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nt9ss"
Jul 20 12:45:53.834163 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.834136    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pvfjj\""
Jul 20 12:45:53.841794 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.841767    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn69x"
Jul 20 12:45:53.854965 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.854933    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nt9ss"]
Jul 20 12:45:53.857918 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:45:53.857895    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd63473a8_86d8_4ad9_a2b0_26a3ab221c57.slice/crio-cca3bd503746a5e9772a7f5083fd1edc3495862906e56e70ec381eae8afd5ded WatchSource:0}: Error finding container cca3bd503746a5e9772a7f5083fd1edc3495862906e56e70ec381eae8afd5ded: Status 404 returned error can't find the container with id cca3bd503746a5e9772a7f5083fd1edc3495862906e56e70ec381eae8afd5ded
Jul 20 12:45:53.874079 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.874047    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/08dfd872-07ac-491c-b319-6e8da15c7389-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-swlsc\" (UID: \"08dfd872-07ac-491c-b319-6e8da15c7389\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-swlsc"
Jul 20 12:45:53.874212 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.874153    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6c299747-8d0e-4a67-a268-1e81740c43be-node-exporter-tls\") pod \"node-exporter-hmvmr\" (UID: \"6c299747-8d0e-4a67-a268-1e81740c43be\") " pod="openshift-monitoring/node-exporter-hmvmr"
Jul 20 12:45:53.876464 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.876438    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6c299747-8d0e-4a67-a268-1e81740c43be-node-exporter-tls\") pod \"node-exporter-hmvmr\" (UID: \"6c299747-8d0e-4a67-a268-1e81740c43be\") " pod="openshift-monitoring/node-exporter-hmvmr"
Jul 20 12:45:53.876592 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.876483    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/08dfd872-07ac-491c-b319-6e8da15c7389-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-swlsc\" (UID: \"08dfd872-07ac-491c-b319-6e8da15c7389\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-swlsc"
Jul 20 12:45:53.926511 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.926467    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-758d48dd55-tj6b2"
Jul 20 12:45:53.926681 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.926583    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-758d48dd55-tj6b2"
Jul 20 12:45:53.932029 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.932006    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-758d48dd55-tj6b2"
Jul 20 12:45:53.970487 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:53.970461    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gn69x"]
Jul 20 12:45:53.972680 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:45:53.972649    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5e87d68_a096_452b_a6b3_c0815771c37d.slice/crio-1a32c86f25b80d6c751cf73a57173652eb2a2438f4127eb66e6314b39389a5a1 WatchSource:0}: Error finding container 1a32c86f25b80d6c751cf73a57173652eb2a2438f4127eb66e6314b39389a5a1: Status 404 returned error can't find the container with id 1a32c86f25b80d6c751cf73a57173652eb2a2438f4127eb66e6314b39389a5a1
Jul 20 12:45:54.133335 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.133291    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hmvmr"
Jul 20 12:45:54.143714 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:45:54.143686    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c299747_8d0e_4a67_a268_1e81740c43be.slice/crio-109197ed1f71ea5af454e0198f1a528e26aa4db7089445883e68f0fa0ec51ad1 WatchSource:0}: Error finding container 109197ed1f71ea5af454e0198f1a528e26aa4db7089445883e68f0fa0ec51ad1: Status 404 returned error can't find the container with id 109197ed1f71ea5af454e0198f1a528e26aa4db7089445883e68f0fa0ec51ad1
Jul 20 12:45:54.147097 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.146949    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-swlsc"
Jul 20 12:45:54.154833 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.154797    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gn69x" event={"ID":"d5e87d68-a096-452b-a6b3-c0815771c37d","Type":"ContainerStarted","Data":"1a32c86f25b80d6c751cf73a57173652eb2a2438f4127eb66e6314b39389a5a1"}
Jul 20 12:45:54.156030 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.156001    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nt9ss" event={"ID":"d63473a8-86d8-4ad9-a2b0-26a3ab221c57","Type":"ContainerStarted","Data":"cca3bd503746a5e9772a7f5083fd1edc3495862906e56e70ec381eae8afd5ded"}
Jul 20 12:45:54.157962 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.157941    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-pnvnz" event={"ID":"2e777b21-974d-41a0-ae44-143b5039300b","Type":"ContainerStarted","Data":"38a9e1a97e8fde3ae6f30c7513cc40c3cc27ed07aa394502f17fec7eb8519263"}
Jul 20 12:45:54.158034 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.157989    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-pnvnz" event={"ID":"2e777b21-974d-41a0-ae44-143b5039300b","Type":"ContainerStarted","Data":"41ab1dcd61080e705de4819079036c029579ea6757245c24c1ddcc1e50c2f23b"}
Jul 20 12:45:54.158034 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.158007    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-pnvnz" event={"ID":"2e777b21-974d-41a0-ae44-143b5039300b","Type":"ContainerStarted","Data":"4519cbca16e5d8008df75ea4827566fdbd7ca8b01e5b00cd077c31fe7dbe59e8"}
Jul 20 12:45:54.159688 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.159670    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hmvmr" event={"ID":"6c299747-8d0e-4a67-a268-1e81740c43be","Type":"ContainerStarted","Data":"109197ed1f71ea5af454e0198f1a528e26aa4db7089445883e68f0fa0ec51ad1"}
Jul 20 12:45:54.160797 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.160776    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4dkkp" event={"ID":"5fbafa93-14fa-41b3-a202-eb69336c381e","Type":"ContainerStarted","Data":"87d91c1f6d4fe522cbd5ca41b76c0c0ed39423bb25186163cf34e8481b0385d0"}
Jul 20 12:45:54.166370 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.166346    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-758d48dd55-tj6b2"
Jul 20 12:45:54.217382 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.217351    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69d95f68b6-bhfk2"]
Jul 20 12:45:54.296131 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.296097    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-swlsc"]
Jul 20 12:45:54.299702 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:45:54.299674    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08dfd872_07ac_491c_b319_6e8da15c7389.slice/crio-9e358f0c1fcc4cad01fd822732bc37fd3f28aedbdf3dcfa4c0dea2a6c69361fa WatchSource:0}: Error finding container 9e358f0c1fcc4cad01fd822732bc37fd3f28aedbdf3dcfa4c0dea2a6c69361fa: Status 404 returned error can't find the container with id 9e358f0c1fcc4cad01fd822732bc37fd3f28aedbdf3dcfa4c0dea2a6c69361fa
Jul 20 12:45:54.307789 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.307766    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 12:45:54.310643 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.310621    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 20 12:45:54.313639 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.313614    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 20 12:45:54.313746 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.313700    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-rpszq\""
Jul 20 12:45:54.313809 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.313755    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 20 12:45:54.314102 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.314072    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 20 12:45:54.314238 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.314164    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 20 12:45:54.314238 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.314183    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 20 12:45:54.314621 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.314599    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 20 12:45:54.314621 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.314618    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 20 12:45:54.315012 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.314993    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 20 12:45:54.323776 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.323753    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 20 12:45:54.327139 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.327114    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 12:45:54.377821 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.377782    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5a6ac1d0-513c-467e-94f9-fa4730f7e5c3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5a6ac1d0-513c-467e-94f9-fa4730f7e5c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 12:45:54.377980 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.377826    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a6ac1d0-513c-467e-94f9-fa4730f7e5c3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5a6ac1d0-513c-467e-94f9-fa4730f7e5c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 12:45:54.377980 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.377911    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5a6ac1d0-513c-467e-94f9-fa4730f7e5c3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5a6ac1d0-513c-467e-94f9-fa4730f7e5c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 12:45:54.377980 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.377976    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5a6ac1d0-513c-467e-94f9-fa4730f7e5c3-config-volume\") pod \"alertmanager-main-0\" (UID: \"5a6ac1d0-513c-467e-94f9-fa4730f7e5c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 12:45:54.378148 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.378009    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5a6ac1d0-513c-467e-94f9-fa4730f7e5c3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5a6ac1d0-513c-467e-94f9-fa4730f7e5c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 12:45:54.378148 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.378046    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a6ac1d0-513c-467e-94f9-fa4730f7e5c3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5a6ac1d0-513c-467e-94f9-fa4730f7e5c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 12:45:54.378148 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.378129    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5a6ac1d0-513c-467e-94f9-fa4730f7e5c3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5a6ac1d0-513c-467e-94f9-fa4730f7e5c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 12:45:54.378288 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.378158    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5a6ac1d0-513c-467e-94f9-fa4730f7e5c3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5a6ac1d0-513c-467e-94f9-fa4730f7e5c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 12:45:54.378288 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.378224    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5a6ac1d0-513c-467e-94f9-fa4730f7e5c3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5a6ac1d0-513c-467e-94f9-fa4730f7e5c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 12:45:54.378288 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.378284    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5a6ac1d0-513c-467e-94f9-fa4730f7e5c3-config-out\") pod \"alertmanager-main-0\" (UID: \"5a6ac1d0-513c-467e-94f9-fa4730f7e5c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 12:45:54.378412 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.378308    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7w6bz\" (UniqueName: \"kubernetes.io/projected/5a6ac1d0-513c-467e-94f9-fa4730f7e5c3-kube-api-access-7w6bz\") pod \"alertmanager-main-0\" (UID: \"5a6ac1d0-513c-467e-94f9-fa4730f7e5c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 12:45:54.378412 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.378341    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5a6ac1d0-513c-467e-94f9-fa4730f7e5c3-web-config\") pod \"alertmanager-main-0\" (UID: \"5a6ac1d0-513c-467e-94f9-fa4730f7e5c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 12:45:54.378412 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.378377    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5a6ac1d0-513c-467e-94f9-fa4730f7e5c3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5a6ac1d0-513c-467e-94f9-fa4730f7e5c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 12:45:54.479915 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.479721    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5a6ac1d0-513c-467e-94f9-fa4730f7e5c3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5a6ac1d0-513c-467e-94f9-fa4730f7e5c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 12:45:54.479915 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.479787    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5a6ac1d0-513c-467e-94f9-fa4730f7e5c3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5a6ac1d0-513c-467e-94f9-fa4730f7e5c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 12:45:54.479915 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.479857    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5a6ac1d0-513c-467e-94f9-fa4730f7e5c3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5a6ac1d0-513c-467e-94f9-fa4730f7e5c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 12:45:54.480236 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.479982    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5a6ac1d0-513c-467e-94f9-fa4730f7e5c3-config-out\") pod \"alertmanager-main-0\" (UID: \"5a6ac1d0-513c-467e-94f9-fa4730f7e5c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 12:45:54.480236 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.480010    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7w6bz\" (UniqueName: \"kubernetes.io/projected/5a6ac1d0-513c-467e-94f9-fa4730f7e5c3-kube-api-access-7w6bz\") pod \"alertmanager-main-0\" (UID: \"5a6ac1d0-513c-467e-94f9-fa4730f7e5c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 12:45:54.480236 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.480045    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5a6ac1d0-513c-467e-94f9-fa4730f7e5c3-web-config\") pod \"alertmanager-main-0\" (UID: \"5a6ac1d0-513c-467e-94f9-fa4730f7e5c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 12:45:54.480236 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.480106    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5a6ac1d0-513c-467e-94f9-fa4730f7e5c3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5a6ac1d0-513c-467e-94f9-fa4730f7e5c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 12:45:54.481533 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.481505    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5a6ac1d0-513c-467e-94f9-fa4730f7e5c3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5a6ac1d0-513c-467e-94f9-fa4730f7e5c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 12:45:54.481656 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.481550    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a6ac1d0-513c-467e-94f9-fa4730f7e5c3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5a6ac1d0-513c-467e-94f9-fa4730f7e5c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 12:45:54.481656 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.481603    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5a6ac1d0-513c-467e-94f9-fa4730f7e5c3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5a6ac1d0-513c-467e-94f9-fa4730f7e5c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 12:45:54.481656 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.481645    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5a6ac1d0-513c-467e-94f9-fa4730f7e5c3-config-volume\") pod \"alertmanager-main-0\" (UID: \"5a6ac1d0-513c-467e-94f9-fa4730f7e5c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 12:45:54.481808 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.481678    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5a6ac1d0-513c-467e-94f9-fa4730f7e5c3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5a6ac1d0-513c-467e-94f9-fa4730f7e5c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 12:45:54.481808 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.481716    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a6ac1d0-513c-467e-94f9-fa4730f7e5c3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5a6ac1d0-513c-467e-94f9-fa4730f7e5c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 12:45:54.482725 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.482405    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a6ac1d0-513c-467e-94f9-fa4730f7e5c3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5a6ac1d0-513c-467e-94f9-fa4730f7e5c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 12:45:54.482725 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.482658    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a6ac1d0-513c-467e-94f9-fa4730f7e5c3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5a6ac1d0-513c-467e-94f9-fa4730f7e5c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 12:45:54.482945 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.482923    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5a6ac1d0-513c-467e-94f9-fa4730f7e5c3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5a6ac1d0-513c-467e-94f9-fa4730f7e5c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 12:45:54.486910 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.486829    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5a6ac1d0-513c-467e-94f9-fa4730f7e5c3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5a6ac1d0-513c-467e-94f9-fa4730f7e5c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 12:45:54.490245 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.490201    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5a6ac1d0-513c-467e-94f9-fa4730f7e5c3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5a6ac1d0-513c-467e-94f9-fa4730f7e5c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 12:45:54.490471 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.490426    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5a6ac1d0-513c-467e-94f9-fa4730f7e5c3-config-volume\") pod \"alertmanager-main-0\" (UID: \"5a6ac1d0-513c-467e-94f9-fa4730f7e5c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 12:45:54.491274 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.491252    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5a6ac1d0-513c-467e-94f9-fa4730f7e5c3-config-out\") pod \"alertmanager-main-0\" (UID: \"5a6ac1d0-513c-467e-94f9-fa4730f7e5c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 12:45:54.491386 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.491280    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5a6ac1d0-513c-467e-94f9-fa4730f7e5c3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5a6ac1d0-513c-467e-94f9-fa4730f7e5c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 12:45:54.491709 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.491674    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5a6ac1d0-513c-467e-94f9-fa4730f7e5c3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5a6ac1d0-513c-467e-94f9-fa4730f7e5c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 12:45:54.492285 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.492219    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5a6ac1d0-513c-467e-94f9-fa4730f7e5c3-web-config\") pod \"alertmanager-main-0\" (UID: \"5a6ac1d0-513c-467e-94f9-fa4730f7e5c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 12:45:54.492807 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.492783    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5a6ac1d0-513c-467e-94f9-fa4730f7e5c3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5a6ac1d0-513c-467e-94f9-fa4730f7e5c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 12:45:54.494651 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.494610    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7w6bz\" (UniqueName: \"kubernetes.io/projected/5a6ac1d0-513c-467e-94f9-fa4730f7e5c3-kube-api-access-7w6bz\") pod \"alertmanager-main-0\" (UID: \"5a6ac1d0-513c-467e-94f9-fa4730f7e5c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 12:45:54.496342 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.496246    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5a6ac1d0-513c-467e-94f9-fa4730f7e5c3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5a6ac1d0-513c-467e-94f9-fa4730f7e5c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 12:45:54.624835 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.624615    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 20 12:45:54.817366 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:54.817209    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 12:45:55.162923 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:45:55.162881    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a6ac1d0_513c_467e_94f9_fa4730f7e5c3.slice/crio-70314095e28a8889a092b386b3abd442221e59a288a6c577daa0b85c912b5c9b WatchSource:0}: Error finding container 70314095e28a8889a092b386b3abd442221e59a288a6c577daa0b85c912b5c9b: Status 404 returned error can't find the container with id 70314095e28a8889a092b386b3abd442221e59a288a6c577daa0b85c912b5c9b
Jul 20 12:45:55.171760 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:55.171265    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-swlsc" event={"ID":"08dfd872-07ac-491c-b319-6e8da15c7389","Type":"ContainerStarted","Data":"9e358f0c1fcc4cad01fd822732bc37fd3f28aedbdf3dcfa4c0dea2a6c69361fa"}
Jul 20 12:45:55.201662 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:55.200379    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-67845f5c74-zgtqw"]
Jul 20 12:45:55.203031 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:55.203007    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-67845f5c74-zgtqw"
Jul 20 12:45:55.208809 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:55.208318    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 20 12:45:55.208809 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:55.208415    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-4wh7n\""
Jul 20 12:45:55.208809 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:55.208558    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 20 12:45:55.208809 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:55.208630    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 20 12:45:55.208809 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:55.208637    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 20 12:45:55.208809 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:55.208705    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-fl2uldni3vu3b\""
Jul 20 12:45:55.208809 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:55.208724    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 20 12:45:55.216918 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:55.216829    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-67845f5c74-zgtqw"]
Jul 20 12:45:55.289984 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:55.289165    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8becd856-1e60-4ce1-9390-2584e406f13e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-67845f5c74-zgtqw\" (UID: \"8becd856-1e60-4ce1-9390-2584e406f13e\") " pod="openshift-monitoring/thanos-querier-67845f5c74-zgtqw"
Jul 20 12:45:55.289984 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:55.289217    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8becd856-1e60-4ce1-9390-2584e406f13e-secret-grpc-tls\") pod \"thanos-querier-67845f5c74-zgtqw\" (UID: \"8becd856-1e60-4ce1-9390-2584e406f13e\") " pod="openshift-monitoring/thanos-querier-67845f5c74-zgtqw"
Jul 20 12:45:55.289984 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:55.289331    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8becd856-1e60-4ce1-9390-2584e406f13e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-67845f5c74-zgtqw\" (UID: \"8becd856-1e60-4ce1-9390-2584e406f13e\") " pod="openshift-monitoring/thanos-querier-67845f5c74-zgtqw"
Jul 20 12:45:55.289984 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:55.289383    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8becd856-1e60-4ce1-9390-2584e406f13e-secret-thanos-querier-tls\") pod \"thanos-querier-67845f5c74-zgtqw\" (UID: \"8becd856-1e60-4ce1-9390-2584e406f13e\") " pod="openshift-monitoring/thanos-querier-67845f5c74-zgtqw"
Jul 20 12:45:55.289984 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:55.289437    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8becd856-1e60-4ce1-9390-2584e406f13e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-67845f5c74-zgtqw\" (UID: \"8becd856-1e60-4ce1-9390-2584e406f13e\") " pod="openshift-monitoring/thanos-querier-67845f5c74-zgtqw"
Jul 20 12:45:55.289984 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:55.289579    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8becd856-1e60-4ce1-9390-2584e406f13e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-67845f5c74-zgtqw\" (UID: \"8becd856-1e60-4ce1-9390-2584e406f13e\") " pod="openshift-monitoring/thanos-querier-67845f5c74-zgtqw"
Jul 20 12:45:55.289984 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:55.289615    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8becd856-1e60-4ce1-9390-2584e406f13e-metrics-client-ca\") pod \"thanos-querier-67845f5c74-zgtqw\" (UID: \"8becd856-1e60-4ce1-9390-2584e406f13e\") " pod="openshift-monitoring/thanos-querier-67845f5c74-zgtqw"
Jul 20 12:45:55.289984 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:55.289650    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6w7jx\" (UniqueName: \"kubernetes.io/projected/8becd856-1e60-4ce1-9390-2584e406f13e-kube-api-access-6w7jx\") pod \"thanos-querier-67845f5c74-zgtqw\" (UID: \"8becd856-1e60-4ce1-9390-2584e406f13e\") " pod="openshift-monitoring/thanos-querier-67845f5c74-zgtqw"
Jul 20 12:45:55.391022 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:55.390310    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8becd856-1e60-4ce1-9390-2584e406f13e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-67845f5c74-zgtqw\" (UID: \"8becd856-1e60-4ce1-9390-2584e406f13e\") " pod="openshift-monitoring/thanos-querier-67845f5c74-zgtqw"
Jul 20 12:45:55.391022 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:55.390366    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8becd856-1e60-4ce1-9390-2584e406f13e-metrics-client-ca\") pod \"thanos-querier-67845f5c74-zgtqw\" (UID: \"8becd856-1e60-4ce1-9390-2584e406f13e\") " pod="openshift-monitoring/thanos-querier-67845f5c74-zgtqw"
Jul 20 12:45:55.391022 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:55.390398    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6w7jx\" (UniqueName: \"kubernetes.io/projected/8becd856-1e60-4ce1-9390-2584e406f13e-kube-api-access-6w7jx\") pod \"thanos-querier-67845f5c74-zgtqw\" (UID: \"8becd856-1e60-4ce1-9390-2584e406f13e\") " pod="openshift-monitoring/thanos-querier-67845f5c74-zgtqw"
Jul 20 12:45:55.391022 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:55.390445    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8becd856-1e60-4ce1-9390-2584e406f13e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-67845f5c74-zgtqw\" (UID: \"8becd856-1e60-4ce1-9390-2584e406f13e\") " pod="openshift-monitoring/thanos-querier-67845f5c74-zgtqw"
Jul 20 12:45:55.391022 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:55.390470    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8becd856-1e60-4ce1-9390-2584e406f13e-secret-grpc-tls\") pod \"thanos-querier-67845f5c74-zgtqw\" (UID: \"8becd856-1e60-4ce1-9390-2584e406f13e\") " pod="openshift-monitoring/thanos-querier-67845f5c74-zgtqw"
Jul 20 12:45:55.391022 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:55.390550    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8becd856-1e60-4ce1-9390-2584e406f13e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-67845f5c74-zgtqw\" (UID: \"8becd856-1e60-4ce1-9390-2584e406f13e\") " pod="openshift-monitoring/thanos-querier-67845f5c74-zgtqw"
Jul 20 12:45:55.391022 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:55.390674    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8becd856-1e60-4ce1-9390-2584e406f13e-secret-thanos-querier-tls\") pod \"thanos-querier-67845f5c74-zgtqw\" (UID: \"8becd856-1e60-4ce1-9390-2584e406f13e\") " pod="openshift-monitoring/thanos-querier-67845f5c74-zgtqw"
Jul 20 12:45:55.391022 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:55.390713    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8becd856-1e60-4ce1-9390-2584e406f13e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-67845f5c74-zgtqw\" (UID: \"8becd856-1e60-4ce1-9390-2584e406f13e\") " pod="openshift-monitoring/thanos-querier-67845f5c74-zgtqw"
Jul 20 12:45:55.391878 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:55.391728    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8becd856-1e60-4ce1-9390-2584e406f13e-metrics-client-ca\") pod \"thanos-querier-67845f5c74-zgtqw\" (UID: \"8becd856-1e60-4ce1-9390-2584e406f13e\") " pod="openshift-monitoring/thanos-querier-67845f5c74-zgtqw"
Jul 20 12:45:55.393681 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:55.393650    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8becd856-1e60-4ce1-9390-2584e406f13e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-67845f5c74-zgtqw\" (UID: \"8becd856-1e60-4ce1-9390-2584e406f13e\") " pod="openshift-monitoring/thanos-querier-67845f5c74-zgtqw"
Jul 20 12:45:55.395925 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:55.395836    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8becd856-1e60-4ce1-9390-2584e406f13e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-67845f5c74-zgtqw\" (UID: \"8becd856-1e60-4ce1-9390-2584e406f13e\") " pod="openshift-monitoring/thanos-querier-67845f5c74-zgtqw"
Jul 20 12:45:55.396962 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:55.396491    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8becd856-1e60-4ce1-9390-2584e406f13e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-67845f5c74-zgtqw\" (UID: \"8becd856-1e60-4ce1-9390-2584e406f13e\") " pod="openshift-monitoring/thanos-querier-67845f5c74-zgtqw"
Jul 20 12:45:55.396962 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:55.396514    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8becd856-1e60-4ce1-9390-2584e406f13e-secret-grpc-tls\") pod \"thanos-querier-67845f5c74-zgtqw\" (UID: \"8becd856-1e60-4ce1-9390-2584e406f13e\") " pod="openshift-monitoring/thanos-querier-67845f5c74-zgtqw"
Jul 20 12:45:55.396962 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:55.396851    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8becd856-1e60-4ce1-9390-2584e406f13e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-67845f5c74-zgtqw\" (UID: \"8becd856-1e60-4ce1-9390-2584e406f13e\") " pod="openshift-monitoring/thanos-querier-67845f5c74-zgtqw"
Jul 20 12:45:55.396962 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:55.396916    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8becd856-1e60-4ce1-9390-2584e406f13e-secret-thanos-querier-tls\") pod \"thanos-querier-67845f5c74-zgtqw\" (UID: \"8becd856-1e60-4ce1-9390-2584e406f13e\") " pod="openshift-monitoring/thanos-querier-67845f5c74-zgtqw"
Jul 20 12:45:55.401496 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:55.401467    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6w7jx\" (UniqueName: \"kubernetes.io/projected/8becd856-1e60-4ce1-9390-2584e406f13e-kube-api-access-6w7jx\") pod \"thanos-querier-67845f5c74-zgtqw\" (UID: \"8becd856-1e60-4ce1-9390-2584e406f13e\") " pod="openshift-monitoring/thanos-querier-67845f5c74-zgtqw"
Jul 20 12:45:55.519692 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:55.519614    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-67845f5c74-zgtqw"
Jul 20 12:45:56.178824 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:56.178780    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5a6ac1d0-513c-467e-94f9-fa4730f7e5c3","Type":"ContainerStarted","Data":"70314095e28a8889a092b386b3abd442221e59a288a6c577daa0b85c912b5c9b"}
Jul 20 12:45:57.530490 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:57.527556    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5cc85db8b5-6q5mm"]
Jul 20 12:45:57.531745 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:57.531703    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5cc85db8b5-6q5mm"
Jul 20 12:45:57.534775 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:57.534749    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 20 12:45:57.536758 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:57.536730    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 20 12:45:57.536893 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:57.536769    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 20 12:45:57.536893 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:57.536811    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-6whgv\""
Jul 20 12:45:57.537067 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:57.537048    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 20 12:45:57.537158 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:57.537106    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dmc90p642ianv\""
Jul 20 12:45:57.539281 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:57.539259    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5cc85db8b5-6q5mm"]
Jul 20 12:45:57.614157 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:57.614109    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/25199219-4d87-4b02-aa1b-fa90bce96534-client-ca-bundle\") pod \"metrics-server-5cc85db8b5-6q5mm\" (UID: \"25199219-4d87-4b02-aa1b-fa90bce96534\") " pod="openshift-monitoring/metrics-server-5cc85db8b5-6q5mm"
Jul 20 12:45:57.614346 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:57.614204    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/25199219-4d87-4b02-aa1b-fa90bce96534-metrics-server-audit-profiles\") pod \"metrics-server-5cc85db8b5-6q5mm\" (UID: \"25199219-4d87-4b02-aa1b-fa90bce96534\") " pod="openshift-monitoring/metrics-server-5cc85db8b5-6q5mm"
Jul 20 12:45:57.614346 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:57.614237    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/25199219-4d87-4b02-aa1b-fa90bce96534-audit-log\") pod \"metrics-server-5cc85db8b5-6q5mm\" (UID: \"25199219-4d87-4b02-aa1b-fa90bce96534\") " pod="openshift-monitoring/metrics-server-5cc85db8b5-6q5mm"
Jul 20 12:45:57.614346 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:57.614289    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/25199219-4d87-4b02-aa1b-fa90bce96534-secret-metrics-server-client-certs\") pod \"metrics-server-5cc85db8b5-6q5mm\" (UID: \"25199219-4d87-4b02-aa1b-fa90bce96534\") " pod="openshift-monitoring/metrics-server-5cc85db8b5-6q5mm"
Jul 20 12:45:57.614346 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:57.614314    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6fcw\" (UniqueName: \"kubernetes.io/projected/25199219-4d87-4b02-aa1b-fa90bce96534-kube-api-access-r6fcw\") pod \"metrics-server-5cc85db8b5-6q5mm\" (UID: \"25199219-4d87-4b02-aa1b-fa90bce96534\") " pod="openshift-monitoring/metrics-server-5cc85db8b5-6q5mm"
Jul 20 12:45:57.614553 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:57.614379    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25199219-4d87-4b02-aa1b-fa90bce96534-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5cc85db8b5-6q5mm\" (UID: \"25199219-4d87-4b02-aa1b-fa90bce96534\") " pod="openshift-monitoring/metrics-server-5cc85db8b5-6q5mm"
Jul 20 12:45:57.614553 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:57.614466    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/25199219-4d87-4b02-aa1b-fa90bce96534-secret-metrics-server-tls\") pod \"metrics-server-5cc85db8b5-6q5mm\" (UID: \"25199219-4d87-4b02-aa1b-fa90bce96534\") " pod="openshift-monitoring/metrics-server-5cc85db8b5-6q5mm"
Jul 20 12:45:57.715431 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:57.715391    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/25199219-4d87-4b02-aa1b-fa90bce96534-client-ca-bundle\") pod \"metrics-server-5cc85db8b5-6q5mm\" (UID: \"25199219-4d87-4b02-aa1b-fa90bce96534\") " pod="openshift-monitoring/metrics-server-5cc85db8b5-6q5mm"
Jul 20 12:45:57.715631 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:57.715463    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/25199219-4d87-4b02-aa1b-fa90bce96534-metrics-server-audit-profiles\") pod \"metrics-server-5cc85db8b5-6q5mm\" (UID: \"25199219-4d87-4b02-aa1b-fa90bce96534\") " pod="openshift-monitoring/metrics-server-5cc85db8b5-6q5mm"
Jul 20 12:45:57.715631 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:57.715496    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/25199219-4d87-4b02-aa1b-fa90bce96534-audit-log\") pod \"metrics-server-5cc85db8b5-6q5mm\" (UID: \"25199219-4d87-4b02-aa1b-fa90bce96534\") " pod="openshift-monitoring/metrics-server-5cc85db8b5-6q5mm"
Jul 20 12:45:57.715631 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:57.715530    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/25199219-4d87-4b02-aa1b-fa90bce96534-secret-metrics-server-client-certs\") pod \"metrics-server-5cc85db8b5-6q5mm\" (UID: \"25199219-4d87-4b02-aa1b-fa90bce96534\") " pod="openshift-monitoring/metrics-server-5cc85db8b5-6q5mm"
Jul 20 12:45:57.715631 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:57.715553    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6fcw\" (UniqueName: \"kubernetes.io/projected/25199219-4d87-4b02-aa1b-fa90bce96534-kube-api-access-r6fcw\") pod \"metrics-server-5cc85db8b5-6q5mm\" (UID: \"25199219-4d87-4b02-aa1b-fa90bce96534\") " pod="openshift-monitoring/metrics-server-5cc85db8b5-6q5mm"
Jul 20 12:45:57.715992 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:57.715891    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25199219-4d87-4b02-aa1b-fa90bce96534-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5cc85db8b5-6q5mm\" (UID: \"25199219-4d87-4b02-aa1b-fa90bce96534\") " pod="openshift-monitoring/metrics-server-5cc85db8b5-6q5mm"
Jul 20 12:45:57.715992 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:57.715955    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/25199219-4d87-4b02-aa1b-fa90bce96534-audit-log\") pod \"metrics-server-5cc85db8b5-6q5mm\" (UID: \"25199219-4d87-4b02-aa1b-fa90bce96534\") " pod="openshift-monitoring/metrics-server-5cc85db8b5-6q5mm"
Jul 20 12:45:57.716190 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:57.715999    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/25199219-4d87-4b02-aa1b-fa90bce96534-secret-metrics-server-tls\") pod \"metrics-server-5cc85db8b5-6q5mm\" (UID: \"25199219-4d87-4b02-aa1b-fa90bce96534\") " pod="openshift-monitoring/metrics-server-5cc85db8b5-6q5mm"
Jul 20 12:45:57.716607 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:57.716563    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25199219-4d87-4b02-aa1b-fa90bce96534-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5cc85db8b5-6q5mm\" (UID: \"25199219-4d87-4b02-aa1b-fa90bce96534\") " pod="openshift-monitoring/metrics-server-5cc85db8b5-6q5mm"
Jul 20 12:45:57.716698 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:57.716680    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/25199219-4d87-4b02-aa1b-fa90bce96534-metrics-server-audit-profiles\") pod \"metrics-server-5cc85db8b5-6q5mm\" (UID: \"25199219-4d87-4b02-aa1b-fa90bce96534\") " pod="openshift-monitoring/metrics-server-5cc85db8b5-6q5mm"
Jul 20 12:45:57.718332 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:57.718308    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/25199219-4d87-4b02-aa1b-fa90bce96534-secret-metrics-server-client-certs\") pod \"metrics-server-5cc85db8b5-6q5mm\" (UID: \"25199219-4d87-4b02-aa1b-fa90bce96534\") " pod="openshift-monitoring/metrics-server-5cc85db8b5-6q5mm"
Jul 20 12:45:57.718849 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:57.718821    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/25199219-4d87-4b02-aa1b-fa90bce96534-secret-metrics-server-tls\") pod \"metrics-server-5cc85db8b5-6q5mm\" (UID: \"25199219-4d87-4b02-aa1b-fa90bce96534\") " pod="openshift-monitoring/metrics-server-5cc85db8b5-6q5mm"
Jul 20 12:45:57.718940 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:57.718903    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/25199219-4d87-4b02-aa1b-fa90bce96534-client-ca-bundle\") pod \"metrics-server-5cc85db8b5-6q5mm\" (UID: \"25199219-4d87-4b02-aa1b-fa90bce96534\") " pod="openshift-monitoring/metrics-server-5cc85db8b5-6q5mm"
Jul 20 12:45:57.724551 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:57.724530    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6fcw\" (UniqueName: \"kubernetes.io/projected/25199219-4d87-4b02-aa1b-fa90bce96534-kube-api-access-r6fcw\") pod \"metrics-server-5cc85db8b5-6q5mm\" (UID: \"25199219-4d87-4b02-aa1b-fa90bce96534\") " pod="openshift-monitoring/metrics-server-5cc85db8b5-6q5mm"
Jul 20 12:45:57.843066 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:57.843027    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5cc85db8b5-6q5mm"
Jul 20 12:45:58.013843 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.013809    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-kxx8r"]
Jul 20 12:45:58.016217 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.016195    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-kxx8r"
Jul 20 12:45:58.020798 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.019243    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-2b8mr\""
Jul 20 12:45:58.020798 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.019264    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 20 12:45:58.024345 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.024320    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-kxx8r"]
Jul 20 12:45:58.119012 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.118917    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/31fbd371-0bef-4a1b-b1b3-ad2bc3326531-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-kxx8r\" (UID: \"31fbd371-0bef-4a1b-b1b3-ad2bc3326531\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-kxx8r"
Jul 20 12:45:58.119012 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.118978    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgttl\" (UniqueName: \"kubernetes.io/projected/31fbd371-0bef-4a1b-b1b3-ad2bc3326531-kube-api-access-qgttl\") pod \"monitoring-plugin-7b7b7bc8bf-kxx8r\" (UID: \"31fbd371-0bef-4a1b-b1b3-ad2bc3326531\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-kxx8r"
Jul 20 12:45:58.220428 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.220390    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/31fbd371-0bef-4a1b-b1b3-ad2bc3326531-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-kxx8r\" (UID: \"31fbd371-0bef-4a1b-b1b3-ad2bc3326531\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-kxx8r"
Jul 20 12:45:58.220602 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.220459    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgttl\" (UniqueName: \"kubernetes.io/projected/31fbd371-0bef-4a1b-b1b3-ad2bc3326531-kube-api-access-qgttl\") pod \"monitoring-plugin-7b7b7bc8bf-kxx8r\" (UID: \"31fbd371-0bef-4a1b-b1b3-ad2bc3326531\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-kxx8r"
Jul 20 12:45:58.220602 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:58.220568    2570 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 20 12:45:58.220724 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:45:58.220657    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31fbd371-0bef-4a1b-b1b3-ad2bc3326531-monitoring-plugin-cert podName:31fbd371-0bef-4a1b-b1b3-ad2bc3326531 nodeName:}" failed. No retries permitted until 2026-07-20 12:45:58.720636641 +0000 UTC m=+71.475686007 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/31fbd371-0bef-4a1b-b1b3-ad2bc3326531-monitoring-plugin-cert") pod "monitoring-plugin-7b7b7bc8bf-kxx8r" (UID: "31fbd371-0bef-4a1b-b1b3-ad2bc3326531") : secret "monitoring-plugin-cert" not found
Jul 20 12:45:58.232356 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.232322    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgttl\" (UniqueName: \"kubernetes.io/projected/31fbd371-0bef-4a1b-b1b3-ad2bc3326531-kube-api-access-qgttl\") pod \"monitoring-plugin-7b7b7bc8bf-kxx8r\" (UID: \"31fbd371-0bef-4a1b-b1b3-ad2bc3326531\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-kxx8r"
Jul 20 12:45:58.429054 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.428979    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7887f4667d-pvnj4"]
Jul 20 12:45:58.431513 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.431487    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7887f4667d-pvnj4"
Jul 20 12:45:58.434463 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.434438    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-flwkq\""
Jul 20 12:45:58.434814 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.434796    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 20 12:45:58.434897 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.434841    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 20 12:45:58.434993 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.434942    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 20 12:45:58.435097 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.435069    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 20 12:45:58.436214 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.436197    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 20 12:45:58.441729 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.441703    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 20 12:45:58.445068 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.445045    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7887f4667d-pvnj4"]
Jul 20 12:45:58.489509 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.489472    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-84968b9df5-9dhhp"]
Jul 20 12:45:58.492650 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.492625    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84968b9df5-9dhhp"
Jul 20 12:45:58.508494 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.505131    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84968b9df5-9dhhp"]
Jul 20 12:45:58.523220 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.523190    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjpdl\" (UniqueName: \"kubernetes.io/projected/61ae98cd-ecaa-4d2b-a9c5-bd0531eb143d-kube-api-access-tjpdl\") pod \"telemeter-client-7887f4667d-pvnj4\" (UID: \"61ae98cd-ecaa-4d2b-a9c5-bd0531eb143d\") " pod="openshift-monitoring/telemeter-client-7887f4667d-pvnj4"
Jul 20 12:45:58.523382 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.523234    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/61ae98cd-ecaa-4d2b-a9c5-bd0531eb143d-federate-client-tls\") pod \"telemeter-client-7887f4667d-pvnj4\" (UID: \"61ae98cd-ecaa-4d2b-a9c5-bd0531eb143d\") " pod="openshift-monitoring/telemeter-client-7887f4667d-pvnj4"
Jul 20 12:45:58.523382 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.523323    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/61ae98cd-ecaa-4d2b-a9c5-bd0531eb143d-telemeter-client-tls\") pod \"telemeter-client-7887f4667d-pvnj4\" (UID: \"61ae98cd-ecaa-4d2b-a9c5-bd0531eb143d\") " pod="openshift-monitoring/telemeter-client-7887f4667d-pvnj4"
Jul 20 12:45:58.523484 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.523381    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61ae98cd-ecaa-4d2b-a9c5-bd0531eb143d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7887f4667d-pvnj4\" (UID: \"61ae98cd-ecaa-4d2b-a9c5-bd0531eb143d\") " pod="openshift-monitoring/telemeter-client-7887f4667d-pvnj4"
Jul 20 12:45:58.523484 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.523468    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61ae98cd-ecaa-4d2b-a9c5-bd0531eb143d-serving-certs-ca-bundle\") pod \"telemeter-client-7887f4667d-pvnj4\" (UID: \"61ae98cd-ecaa-4d2b-a9c5-bd0531eb143d\") " pod="openshift-monitoring/telemeter-client-7887f4667d-pvnj4"
Jul 20 12:45:58.523545 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.523513    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/61ae98cd-ecaa-4d2b-a9c5-bd0531eb143d-secret-telemeter-client\") pod \"telemeter-client-7887f4667d-pvnj4\" (UID: \"61ae98cd-ecaa-4d2b-a9c5-bd0531eb143d\") " pod="openshift-monitoring/telemeter-client-7887f4667d-pvnj4"
Jul 20 12:45:58.523611 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.523585    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/61ae98cd-ecaa-4d2b-a9c5-bd0531eb143d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7887f4667d-pvnj4\" (UID: \"61ae98cd-ecaa-4d2b-a9c5-bd0531eb143d\") " pod="openshift-monitoring/telemeter-client-7887f4667d-pvnj4"
Jul 20 12:45:58.523655 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.523617    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61ae98cd-ecaa-4d2b-a9c5-bd0531eb143d-metrics-client-ca\") pod \"telemeter-client-7887f4667d-pvnj4\" (UID: \"61ae98cd-ecaa-4d2b-a9c5-bd0531eb143d\") " pod="openshift-monitoring/telemeter-client-7887f4667d-pvnj4"
Jul 20 12:45:58.624895 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.624843    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3fada112-ead2-4d2e-adb9-960bd62d7af7-console-config\") pod \"console-84968b9df5-9dhhp\" (UID: \"3fada112-ead2-4d2e-adb9-960bd62d7af7\") " pod="openshift-console/console-84968b9df5-9dhhp"
Jul 20 12:45:58.625381 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.624914    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/61ae98cd-ecaa-4d2b-a9c5-bd0531eb143d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7887f4667d-pvnj4\" (UID: \"61ae98cd-ecaa-4d2b-a9c5-bd0531eb143d\") " pod="openshift-monitoring/telemeter-client-7887f4667d-pvnj4"
Jul 20 12:45:58.625381 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.624945    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61ae98cd-ecaa-4d2b-a9c5-bd0531eb143d-metrics-client-ca\") pod \"telemeter-client-7887f4667d-pvnj4\" (UID: \"61ae98cd-ecaa-4d2b-a9c5-bd0531eb143d\") " pod="openshift-monitoring/telemeter-client-7887f4667d-pvnj4"
Jul 20 12:45:58.625381 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.624985    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3fada112-ead2-4d2e-adb9-960bd62d7af7-console-oauth-config\") pod \"console-84968b9df5-9dhhp\" (UID: \"3fada112-ead2-4d2e-adb9-960bd62d7af7\") " pod="openshift-console/console-84968b9df5-9dhhp"
Jul 20 12:45:58.625381 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.625014    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjpdl\" (UniqueName: \"kubernetes.io/projected/61ae98cd-ecaa-4d2b-a9c5-bd0531eb143d-kube-api-access-tjpdl\") pod \"telemeter-client-7887f4667d-pvnj4\" (UID: \"61ae98cd-ecaa-4d2b-a9c5-bd0531eb143d\") " pod="openshift-monitoring/telemeter-client-7887f4667d-pvnj4"
Jul 20 12:45:58.625381 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.625044    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/61ae98cd-ecaa-4d2b-a9c5-bd0531eb143d-federate-client-tls\") pod \"telemeter-client-7887f4667d-pvnj4\" (UID: \"61ae98cd-ecaa-4d2b-a9c5-bd0531eb143d\") " pod="openshift-monitoring/telemeter-client-7887f4667d-pvnj4"
Jul 20 12:45:58.625381 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.625117    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fada112-ead2-4d2e-adb9-960bd62d7af7-trusted-ca-bundle\") pod \"console-84968b9df5-9dhhp\" (UID: \"3fada112-ead2-4d2e-adb9-960bd62d7af7\") " pod="openshift-console/console-84968b9df5-9dhhp"
Jul 20 12:45:58.625381 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.625182    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3fada112-ead2-4d2e-adb9-960bd62d7af7-console-serving-cert\") pod \"console-84968b9df5-9dhhp\" (UID: \"3fada112-ead2-4d2e-adb9-960bd62d7af7\") " pod="openshift-console/console-84968b9df5-9dhhp"
Jul 20 12:45:58.625381 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.625220    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3fada112-ead2-4d2e-adb9-960bd62d7af7-oauth-serving-cert\") pod \"console-84968b9df5-9dhhp\" (UID: \"3fada112-ead2-4d2e-adb9-960bd62d7af7\") " pod="openshift-console/console-84968b9df5-9dhhp"
Jul 20 12:45:58.625381 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.625253    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/61ae98cd-ecaa-4d2b-a9c5-bd0531eb143d-telemeter-client-tls\") pod \"telemeter-client-7887f4667d-pvnj4\" (UID: \"61ae98cd-ecaa-4d2b-a9c5-bd0531eb143d\") " pod="openshift-monitoring/telemeter-client-7887f4667d-pvnj4"
Jul 20 12:45:58.625381 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.625315    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61ae98cd-ecaa-4d2b-a9c5-bd0531eb143d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7887f4667d-pvnj4\" (UID: \"61ae98cd-ecaa-4d2b-a9c5-bd0531eb143d\") " pod="openshift-monitoring/telemeter-client-7887f4667d-pvnj4"
Jul 20 12:45:58.625381 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.625366    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7ng9\" (UniqueName: \"kubernetes.io/projected/3fada112-ead2-4d2e-adb9-960bd62d7af7-kube-api-access-m7ng9\") pod \"console-84968b9df5-9dhhp\" (UID: \"3fada112-ead2-4d2e-adb9-960bd62d7af7\") " pod="openshift-console/console-84968b9df5-9dhhp"
Jul 20 12:45:58.625913 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.625404    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61ae98cd-ecaa-4d2b-a9c5-bd0531eb143d-serving-certs-ca-bundle\") pod \"telemeter-client-7887f4667d-pvnj4\" (UID: \"61ae98cd-ecaa-4d2b-a9c5-bd0531eb143d\") " pod="openshift-monitoring/telemeter-client-7887f4667d-pvnj4"
Jul 20 12:45:58.625913 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.625452    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/61ae98cd-ecaa-4d2b-a9c5-bd0531eb143d-secret-telemeter-client\") pod \"telemeter-client-7887f4667d-pvnj4\" (UID: \"61ae98cd-ecaa-4d2b-a9c5-bd0531eb143d\") " pod="openshift-monitoring/telemeter-client-7887f4667d-pvnj4"
Jul 20 12:45:58.625913 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.625484    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3fada112-ead2-4d2e-adb9-960bd62d7af7-service-ca\") pod \"console-84968b9df5-9dhhp\" (UID: \"3fada112-ead2-4d2e-adb9-960bd62d7af7\") " pod="openshift-console/console-84968b9df5-9dhhp"
Jul 20 12:45:58.625913 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.625831    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61ae98cd-ecaa-4d2b-a9c5-bd0531eb143d-metrics-client-ca\") pod \"telemeter-client-7887f4667d-pvnj4\" (UID: \"61ae98cd-ecaa-4d2b-a9c5-bd0531eb143d\") " pod="openshift-monitoring/telemeter-client-7887f4667d-pvnj4"
Jul 20 12:45:58.626165 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.626141    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61ae98cd-ecaa-4d2b-a9c5-bd0531eb143d-serving-certs-ca-bundle\") pod \"telemeter-client-7887f4667d-pvnj4\" (UID: \"61ae98cd-ecaa-4d2b-a9c5-bd0531eb143d\") " pod="openshift-monitoring/telemeter-client-7887f4667d-pvnj4"
Jul 20 12:45:58.626254 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.626234    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61ae98cd-ecaa-4d2b-a9c5-bd0531eb143d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7887f4667d-pvnj4\" (UID: \"61ae98cd-ecaa-4d2b-a9c5-bd0531eb143d\") " pod="openshift-monitoring/telemeter-client-7887f4667d-pvnj4"
Jul 20 12:45:58.627849 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.627818    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/61ae98cd-ecaa-4d2b-a9c5-bd0531eb143d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7887f4667d-pvnj4\" (UID: \"61ae98cd-ecaa-4d2b-a9c5-bd0531eb143d\") " pod="openshift-monitoring/telemeter-client-7887f4667d-pvnj4"
Jul 20 12:45:58.627979 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.627958    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/61ae98cd-ecaa-4d2b-a9c5-bd0531eb143d-telemeter-client-tls\") pod \"telemeter-client-7887f4667d-pvnj4\" (UID: \"61ae98cd-ecaa-4d2b-a9c5-bd0531eb143d\") " pod="openshift-monitoring/telemeter-client-7887f4667d-pvnj4"
Jul 20 12:45:58.628480 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.628453    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/61ae98cd-ecaa-4d2b-a9c5-bd0531eb143d-federate-client-tls\") pod \"telemeter-client-7887f4667d-pvnj4\" (UID: \"61ae98cd-ecaa-4d2b-a9c5-bd0531eb143d\") " pod="openshift-monitoring/telemeter-client-7887f4667d-pvnj4"
Jul 20 12:45:58.628480 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.628466    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/61ae98cd-ecaa-4d2b-a9c5-bd0531eb143d-secret-telemeter-client\") pod \"telemeter-client-7887f4667d-pvnj4\" (UID: \"61ae98cd-ecaa-4d2b-a9c5-bd0531eb143d\") " pod="openshift-monitoring/telemeter-client-7887f4667d-pvnj4"
Jul 20 12:45:58.634165 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.634141    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjpdl\" (UniqueName: \"kubernetes.io/projected/61ae98cd-ecaa-4d2b-a9c5-bd0531eb143d-kube-api-access-tjpdl\") pod \"telemeter-client-7887f4667d-pvnj4\" (UID: \"61ae98cd-ecaa-4d2b-a9c5-bd0531eb143d\") " pod="openshift-monitoring/telemeter-client-7887f4667d-pvnj4"
Jul 20 12:45:58.726611 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.726515    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3fada112-ead2-4d2e-adb9-960bd62d7af7-oauth-serving-cert\") pod \"console-84968b9df5-9dhhp\" (UID: \"3fada112-ead2-4d2e-adb9-960bd62d7af7\") " pod="openshift-console/console-84968b9df5-9dhhp"
Jul 20 12:45:58.726611 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.726592    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/31fbd371-0bef-4a1b-b1b3-ad2bc3326531-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-kxx8r\" (UID: \"31fbd371-0bef-4a1b-b1b3-ad2bc3326531\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-kxx8r"
Jul 20 12:45:58.726824 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.726622    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7ng9\" (UniqueName: \"kubernetes.io/projected/3fada112-ead2-4d2e-adb9-960bd62d7af7-kube-api-access-m7ng9\") pod \"console-84968b9df5-9dhhp\" (UID: \"3fada112-ead2-4d2e-adb9-960bd62d7af7\") " pod="openshift-console/console-84968b9df5-9dhhp"
Jul 20 12:45:58.726824 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.726681    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3fada112-ead2-4d2e-adb9-960bd62d7af7-service-ca\") pod \"console-84968b9df5-9dhhp\" (UID: \"3fada112-ead2-4d2e-adb9-960bd62d7af7\") " pod="openshift-console/console-84968b9df5-9dhhp"
Jul 20 12:45:58.726824 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.726718    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3fada112-ead2-4d2e-adb9-960bd62d7af7-console-config\") pod \"console-84968b9df5-9dhhp\" (UID: \"3fada112-ead2-4d2e-adb9-960bd62d7af7\") " pod="openshift-console/console-84968b9df5-9dhhp"
Jul 20 12:45:58.726824 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.726757    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3fada112-ead2-4d2e-adb9-960bd62d7af7-console-oauth-config\") pod \"console-84968b9df5-9dhhp\" (UID: \"3fada112-ead2-4d2e-adb9-960bd62d7af7\") " pod="openshift-console/console-84968b9df5-9dhhp"
Jul 20 12:45:58.726824 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.726781    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fada112-ead2-4d2e-adb9-960bd62d7af7-trusted-ca-bundle\") pod \"console-84968b9df5-9dhhp\" (UID: \"3fada112-ead2-4d2e-adb9-960bd62d7af7\") " pod="openshift-console/console-84968b9df5-9dhhp"
Jul 20 12:45:58.727042 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.726829    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3fada112-ead2-4d2e-adb9-960bd62d7af7-console-serving-cert\") pod \"console-84968b9df5-9dhhp\" (UID: \"3fada112-ead2-4d2e-adb9-960bd62d7af7\") " pod="openshift-console/console-84968b9df5-9dhhp"
Jul 20 12:45:58.727437 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.727380    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3fada112-ead2-4d2e-adb9-960bd62d7af7-oauth-serving-cert\") pod \"console-84968b9df5-9dhhp\" (UID: \"3fada112-ead2-4d2e-adb9-960bd62d7af7\") " pod="openshift-console/console-84968b9df5-9dhhp"
Jul 20 12:45:58.727647 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.727624    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3fada112-ead2-4d2e-adb9-960bd62d7af7-console-config\") pod \"console-84968b9df5-9dhhp\" (UID: \"3fada112-ead2-4d2e-adb9-960bd62d7af7\") " pod="openshift-console/console-84968b9df5-9dhhp"
Jul 20 12:45:58.727756 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.727679    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3fada112-ead2-4d2e-adb9-960bd62d7af7-service-ca\") pod \"console-84968b9df5-9dhhp\" (UID: \"3fada112-ead2-4d2e-adb9-960bd62d7af7\") " pod="openshift-console/console-84968b9df5-9dhhp"
Jul 20 12:45:58.728193 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.728157    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fada112-ead2-4d2e-adb9-960bd62d7af7-trusted-ca-bundle\") pod \"console-84968b9df5-9dhhp\" (UID: \"3fada112-ead2-4d2e-adb9-960bd62d7af7\") " pod="openshift-console/console-84968b9df5-9dhhp"
Jul 20 12:45:58.729537 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.729515    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/31fbd371-0bef-4a1b-b1b3-ad2bc3326531-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-kxx8r\" (UID: \"31fbd371-0bef-4a1b-b1b3-ad2bc3326531\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-kxx8r"
Jul 20 12:45:58.729672 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.729562    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3fada112-ead2-4d2e-adb9-960bd62d7af7-console-serving-cert\") pod \"console-84968b9df5-9dhhp\" (UID: \"3fada112-ead2-4d2e-adb9-960bd62d7af7\") " pod="openshift-console/console-84968b9df5-9dhhp"
Jul 20 12:45:58.730404 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.730360    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3fada112-ead2-4d2e-adb9-960bd62d7af7-console-oauth-config\") pod \"console-84968b9df5-9dhhp\" (UID: \"3fada112-ead2-4d2e-adb9-960bd62d7af7\") " pod="openshift-console/console-84968b9df5-9dhhp"
Jul 20 12:45:58.736023 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.736000    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7ng9\" (UniqueName: \"kubernetes.io/projected/3fada112-ead2-4d2e-adb9-960bd62d7af7-kube-api-access-m7ng9\") pod \"console-84968b9df5-9dhhp\" (UID: \"3fada112-ead2-4d2e-adb9-960bd62d7af7\") " pod="openshift-console/console-84968b9df5-9dhhp"
Jul 20 12:45:58.743826 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.743797    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7887f4667d-pvnj4"
Jul 20 12:45:58.810430 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.810379    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84968b9df5-9dhhp"
Jul 20 12:45:58.928945 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:58.928907    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-kxx8r"
Jul 20 12:45:59.896871 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:59.895452    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-67845f5c74-zgtqw"]
Jul 20 12:45:59.946621 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:45:59.931240    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5cc85db8b5-6q5mm"]
Jul 20 12:46:00.044208 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:00.035196    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-kxx8r"]
Jul 20 12:46:00.092698 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:00.092585    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84968b9df5-9dhhp"]
Jul 20 12:46:00.143154 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:00.140764    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7887f4667d-pvnj4"]
Jul 20 12:46:00.150607 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:46:00.150576    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fada112_ead2_4d2e_adb9_960bd62d7af7.slice/crio-23528b6cd97ed5e395e8e2348ce24fdf6c3dd95625dbf8336c9c1ef8fe30a05a WatchSource:0}: Error finding container 23528b6cd97ed5e395e8e2348ce24fdf6c3dd95625dbf8336c9c1ef8fe30a05a: Status 404 returned error can't find the container with id 23528b6cd97ed5e395e8e2348ce24fdf6c3dd95625dbf8336c9c1ef8fe30a05a
Jul 20 12:46:00.151382 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:46:00.150820    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61ae98cd_ecaa_4d2b_a9c5_bd0531eb143d.slice/crio-149e7c9266a626224f0287b963afda26487be1e1fe33996943f5fd72c50a9c1b WatchSource:0}: Error finding container 149e7c9266a626224f0287b963afda26487be1e1fe33996943f5fd72c50a9c1b: Status 404 returned error can't find the container with id 149e7c9266a626224f0287b963afda26487be1e1fe33996943f5fd72c50a9c1b
Jul 20 12:46:00.201693 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:00.201620    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gn69x" event={"ID":"d5e87d68-a096-452b-a6b3-c0815771c37d","Type":"ContainerStarted","Data":"1109730c2c7435552027351d8e34cf289c99b4dbcc0dfed0734d0212d2c893a0"}
Jul 20 12:46:00.205393 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:00.205160    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nt9ss" event={"ID":"d63473a8-86d8-4ad9-a2b0-26a3ab221c57","Type":"ContainerStarted","Data":"02d56b8b0a6ad1f866959a9bf5f78cfef45a45377c158d53a72a0de69f5decc4"}
Jul 20 12:46:00.205393 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:00.205252    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nt9ss"
Jul 20 12:46:00.217307 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:00.213649    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-pnvnz" event={"ID":"2e777b21-974d-41a0-ae44-143b5039300b","Type":"ContainerStarted","Data":"ec7ed6ae22e9fecdd70fc83700c3545e3c1bc4feba520175edd156c69f49caf4"}
Jul 20 12:46:00.221077 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:00.220984    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-swlsc" event={"ID":"08dfd872-07ac-491c-b319-6e8da15c7389","Type":"ContainerStarted","Data":"a2bfdc60cef981f94b0cb04720a7643a447923ad5eb5495d38bbb0d3f84e716b"}
Jul 20 12:46:00.226256 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:00.225799    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-nt9ss" podStartSLOduration=66.355684776 podStartE2EDuration="1m12.225779171s" totalImagesPullingTime="5.870094395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:44:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:46:00.224182417 +0000 UTC m=+72.979231790" watchObservedRunningTime="2026-07-20 12:46:00.225779171 +0000 UTC m=+72.980828526"
Jul 20 12:46:00.229143 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:00.229117    2570 generic.go:356] "Generic (PLEG): container finished" podID="5a6ac1d0-513c-467e-94f9-fa4730f7e5c3" containerID="fa6047a92d83f210e83bcdeac09ef57c404773063ae7ea3f2052bb137381fd16" exitCode=0
Jul 20 12:46:00.229369 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:00.229271    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5a6ac1d0-513c-467e-94f9-fa4730f7e5c3","Type":"ContainerDied","Data":"fa6047a92d83f210e83bcdeac09ef57c404773063ae7ea3f2052bb137381fd16"}
Jul 20 12:46:00.231977 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:00.231945    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67845f5c74-zgtqw" event={"ID":"8becd856-1e60-4ce1-9390-2584e406f13e","Type":"ContainerStarted","Data":"80fc6c7ca90bd8202d4ae962de0561fa97afea80f67f1d10f7a71483837f25a9"}
Jul 20 12:46:00.233514 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:00.233485    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7887f4667d-pvnj4" event={"ID":"61ae98cd-ecaa-4d2b-a9c5-bd0531eb143d","Type":"ContainerStarted","Data":"149e7c9266a626224f0287b963afda26487be1e1fe33996943f5fd72c50a9c1b"}
Jul 20 12:46:00.236512 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:00.235762    2570 generic.go:356] "Generic (PLEG): container finished" podID="6c299747-8d0e-4a67-a268-1e81740c43be" containerID="1cef6cd3702bbbfc40d327eeb5e34a015c7c7f8976ce34a46c5f44b173650ac8" exitCode=0
Jul 20 12:46:00.236512 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:00.235833    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hmvmr" event={"ID":"6c299747-8d0e-4a67-a268-1e81740c43be","Type":"ContainerDied","Data":"1cef6cd3702bbbfc40d327eeb5e34a015c7c7f8976ce34a46c5f44b173650ac8"}
Jul 20 12:46:00.240792 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:00.240325    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4dkkp" event={"ID":"5fbafa93-14fa-41b3-a202-eb69336c381e","Type":"ContainerStarted","Data":"c6ac223599f2b3d2f63d0aba84ba5a87855f6502dcedbda3b6da85cb97e76a76"}
Jul 20 12:46:00.245378 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:00.244993    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-pnvnz" podStartSLOduration=1.689153937 podStartE2EDuration="7.244976258s" totalImagesPullingTime="5.555822321s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:45:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:46:00.244461 +0000 UTC m=+72.999510397" watchObservedRunningTime="2026-07-20 12:46:00.244976258 +0000 UTC m=+73.000025631"
Jul 20 12:46:00.245530 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:00.245504    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5cc85db8b5-6q5mm" event={"ID":"25199219-4d87-4b02-aa1b-fa90bce96534","Type":"ContainerStarted","Data":"847ce8b7cb109670cec6ce53b22bfaf80cda3f3c30712686d684cd871d85e130"}
Jul 20 12:46:00.257494 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:00.257433    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84968b9df5-9dhhp" event={"ID":"3fada112-ead2-4d2e-adb9-960bd62d7af7","Type":"ContainerStarted","Data":"23528b6cd97ed5e395e8e2348ce24fdf6c3dd95625dbf8336c9c1ef8fe30a05a"}
Jul 20 12:46:00.259457 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:00.259405    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-kxx8r" event={"ID":"31fbd371-0bef-4a1b-b1b3-ad2bc3326531","Type":"ContainerStarted","Data":"931ebc291849a293e67328b7071a9367be24ff7c787a3bac469be1e00fd703eb"}
Jul 20 12:46:00.275253 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:00.274398    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4dkkp" podStartSLOduration=66.2376416 podStartE2EDuration="1m12.274376826s" totalImagesPullingTime="6.036735226s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 12:44:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:46:00.273533837 +0000 UTC m=+73.028583215" watchObservedRunningTime="2026-07-20 12:46:00.274376826 +0000 UTC m=+73.029426201"
Jul 20 12:46:01.272112 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:01.271675    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hmvmr" event={"ID":"6c299747-8d0e-4a67-a268-1e81740c43be","Type":"ContainerStarted","Data":"471f8dd98f6d6483dddd1428f8c105c5e2fc90dc99072e8b5c01b07fd6349fb7"}
Jul 20 12:46:01.272112 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:01.271764    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hmvmr" event={"ID":"6c299747-8d0e-4a67-a268-1e81740c43be","Type":"ContainerStarted","Data":"64b2f03188df43a3faf70b53bcb3f65100be06c4cf422e6bf2e679558119e416"}
Jul 20 12:46:01.276120 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:01.274856    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84968b9df5-9dhhp" event={"ID":"3fada112-ead2-4d2e-adb9-960bd62d7af7","Type":"ContainerStarted","Data":"9921f23ac89bb14b332906b1d8a0427fee07976b034a792c20756e066f40a65f"}
Jul 20 12:46:01.280855 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:01.280825    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gn69x" event={"ID":"d5e87d68-a096-452b-a6b3-c0815771c37d","Type":"ContainerStarted","Data":"ce8e5f0610bd4d7ea0bcf6ebcc82360431669a5ce7942cee90548c2e122eaeea"}
Jul 20 12:46:01.285815 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:01.285779    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-swlsc" event={"ID":"08dfd872-07ac-491c-b319-6e8da15c7389","Type":"ContainerStarted","Data":"91864ae5ea027ce97d0cb67583ee9e2870e98dac54c4c4acfb9adea4cc5dbb62"}
Jul 20 12:46:01.285980 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:01.285858    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-swlsc" event={"ID":"08dfd872-07ac-491c-b319-6e8da15c7389","Type":"ContainerStarted","Data":"e8886799bea2caa2fa092860bcf27d095bbe9b8f284b336db4f677fe6cf45208"}
Jul 20 12:46:01.296221 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:01.295913    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-84968b9df5-9dhhp" podStartSLOduration=3.295896227 podStartE2EDuration="3.295896227s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:45:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:46:00.341008354 +0000 UTC m=+73.096057728" watchObservedRunningTime="2026-07-20 12:46:01.295896227 +0000 UTC m=+74.050945600"
Jul 20 12:46:01.297223 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:01.296976    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-hmvmr" podStartSLOduration=2.931494483 podStartE2EDuration="8.296961256s" totalImagesPullingTime="5.160269452s" totalInitContainerRuntime="205.197321ms" isStatefulPod=true podCreationTimestamp="2026-07-20 12:45:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:46:01.296287183 +0000 UTC m=+74.051336558" watchObservedRunningTime="2026-07-20 12:46:01.296961256 +0000 UTC m=+74.052010631"
Jul 20 12:46:01.320244 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:01.319313    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-swlsc" podStartSLOduration=2.9825684089999998 podStartE2EDuration="8.31929056s" totalImagesPullingTime="5.336722151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:45:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:46:01.318224854 +0000 UTC m=+74.073274255" watchObservedRunningTime="2026-07-20 12:46:01.31929056 +0000 UTC m=+74.074339936"
Jul 20 12:46:01.338565 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:01.338238    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gn69x" podStartSLOduration=67.67422063 podStartE2EDuration="1m13.338216954s" totalImagesPullingTime="5.663996324s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:44:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:46:01.337141934 +0000 UTC m=+74.092191333" watchObservedRunningTime="2026-07-20 12:46:01.338216954 +0000 UTC m=+74.093266329"
Jul 20 12:46:04.305294 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:04.305198    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5cc85db8b5-6q5mm" event={"ID":"25199219-4d87-4b02-aa1b-fa90bce96534","Type":"ContainerStarted","Data":"16ff92ec235d9b72d48718064c93177310034bef85db750231f1e2b223be86b9"}
Jul 20 12:46:04.306790 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:04.306765    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-kxx8r" event={"ID":"31fbd371-0bef-4a1b-b1b3-ad2bc3326531","Type":"ContainerStarted","Data":"abf1f8038f09f73663a2e880241d0981a978649f25a47b330912a007746a1da7"}
Jul 20 12:46:04.306969 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:04.306905    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-kxx8r"
Jul 20 12:46:04.310843 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:04.310814    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5a6ac1d0-513c-467e-94f9-fa4730f7e5c3","Type":"ContainerStarted","Data":"4d3fddd5cdaf6864a64eda064bc38825ee5a74d6a854dab286a0a299801f8a66"}
Jul 20 12:46:04.311167 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:04.311147    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5a6ac1d0-513c-467e-94f9-fa4730f7e5c3","Type":"ContainerStarted","Data":"c3faae764c85401d453c3f1aad39ad6abb2d90160f9519c3012d08e71ecf3724"}
Jul 20 12:46:04.311308 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:04.311295    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5a6ac1d0-513c-467e-94f9-fa4730f7e5c3","Type":"ContainerStarted","Data":"ed898db8094544ddf61d4f2970e9b6040ebe3c3b116f6f9d5146fa67b465f9f3"}
Jul 20 12:46:04.311439 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:04.311427    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5a6ac1d0-513c-467e-94f9-fa4730f7e5c3","Type":"ContainerStarted","Data":"ddcfec388d7c86487bf15118bc98494e536e6fdfa7aee8f6ac84221eff0902af"}
Jul 20 12:46:04.311561 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:04.311550    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5a6ac1d0-513c-467e-94f9-fa4730f7e5c3","Type":"ContainerStarted","Data":"a8598746082ea738985584b29b55248b78909548aa338719b9eca5c1e20a24c0"}
Jul 20 12:46:04.315336 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:04.313235    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-kxx8r"
Jul 20 12:46:04.318104 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:04.318057    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67845f5c74-zgtqw" event={"ID":"8becd856-1e60-4ce1-9390-2584e406f13e","Type":"ContainerStarted","Data":"85b19713721300e0b4c9dc7ebbce5156ffa34db6a664a632265cbcebd8ef7e04"}
Jul 20 12:46:04.318214 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:04.318134    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67845f5c74-zgtqw" event={"ID":"8becd856-1e60-4ce1-9390-2584e406f13e","Type":"ContainerStarted","Data":"8248ffeebc7810f7126beab89d5b8708092628e303a76f7ebd0532a876adf85c"}
Jul 20 12:46:04.318214 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:04.318160    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67845f5c74-zgtqw" event={"ID":"8becd856-1e60-4ce1-9390-2584e406f13e","Type":"ContainerStarted","Data":"7e9018e6758598a49a80b4be476f9e32efabd3471df38669bd9d3687e7640a7a"}
Jul 20 12:46:04.320222 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:04.320201    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7887f4667d-pvnj4" event={"ID":"61ae98cd-ecaa-4d2b-a9c5-bd0531eb143d","Type":"ContainerStarted","Data":"4b8de388c5f494f5ba0f6cc2811089d3b9164ab72ee1831bc7216dce2c0557f9"}
Jul 20 12:46:04.320325 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:04.320240    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7887f4667d-pvnj4" event={"ID":"61ae98cd-ecaa-4d2b-a9c5-bd0531eb143d","Type":"ContainerStarted","Data":"81a8ffe26af31e869e592d11bcc93a54cee5cce41d7f22063f9c3208259aeca9"}
Jul 20 12:46:04.320325 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:04.320257    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7887f4667d-pvnj4" event={"ID":"61ae98cd-ecaa-4d2b-a9c5-bd0531eb143d","Type":"ContainerStarted","Data":"3bad320b0a3870beec48481a9388d69471b8162e3359589fcc7dc0924e771460"}
Jul 20 12:46:04.325690 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:04.325642    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5cc85db8b5-6q5mm" podStartSLOduration=3.577588612 podStartE2EDuration="7.325630734s" totalImagesPullingTime="3.748042122s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:45:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:46:04.324258445 +0000 UTC m=+77.079307831" watchObservedRunningTime="2026-07-20 12:46:04.325630734 +0000 UTC m=+77.080680108"
Jul 20 12:46:04.349129 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:04.349053    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7887f4667d-pvnj4" podStartSLOduration=2.786024947 podStartE2EDuration="6.349033076s" totalImagesPullingTime="3.563008129s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:45:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:46:04.346271624 +0000 UTC m=+77.101321084" watchObservedRunningTime="2026-07-20 12:46:04.349033076 +0000 UTC m=+77.104082451"
Jul 20 12:46:04.364191 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:04.364132    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-kxx8r" podStartSLOduration=3.7071687349999998 podStartE2EDuration="7.364115015s" totalImagesPullingTime="3.65694628s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:45:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:46:04.364051417 +0000 UTC m=+77.119100793" watchObservedRunningTime="2026-07-20 12:46:04.364115015 +0000 UTC m=+77.119164386"
Jul 20 12:46:05.239013 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:05.238975    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84968b9df5-9dhhp"]
Jul 20 12:46:05.276933 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:05.276901    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-868bd7cfdc-2zgrr"]
Jul 20 12:46:05.281996 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:05.281970    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-868bd7cfdc-2zgrr"
Jul 20 12:46:05.287814 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:05.287786    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-868bd7cfdc-2zgrr"]
Jul 20 12:46:05.329143 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:05.329103    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5a6ac1d0-513c-467e-94f9-fa4730f7e5c3","Type":"ContainerStarted","Data":"8fe6e863b3dd2b007d346b449657e697e4a80ff9c6ffee8d9d0e5b0d9a432d08"}
Jul 20 12:46:05.331824 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:05.331791    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67845f5c74-zgtqw" event={"ID":"8becd856-1e60-4ce1-9390-2584e406f13e","Type":"ContainerStarted","Data":"8383bf7d1d6c8e9950b5c8ed308982de83d69b48539639a1b9f591e92aeddeaa"}
Jul 20 12:46:05.360916 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:05.360732    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.239145057 podStartE2EDuration="11.360711533s" totalImagesPullingTime="9.094386996s" totalInitContainerRuntime="27.17948ms" isStatefulPod=false podCreationTimestamp="2026-07-20 12:45:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:46:05.359552976 +0000 UTC m=+78.114602352" watchObservedRunningTime="2026-07-20 12:46:05.360711533 +0000 UTC m=+78.115760917"
Jul 20 12:46:05.404655 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:05.404580    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a7903c1a-8bc0-4c80-b680-ac2031af08e1-oauth-serving-cert\") pod \"console-868bd7cfdc-2zgrr\" (UID: \"a7903c1a-8bc0-4c80-b680-ac2031af08e1\") " pod="openshift-console/console-868bd7cfdc-2zgrr"
Jul 20 12:46:05.404655 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:05.404636    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a7903c1a-8bc0-4c80-b680-ac2031af08e1-service-ca\") pod \"console-868bd7cfdc-2zgrr\" (UID: \"a7903c1a-8bc0-4c80-b680-ac2031af08e1\") " pod="openshift-console/console-868bd7cfdc-2zgrr"
Jul 20 12:46:05.404989 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:05.404838    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a7903c1a-8bc0-4c80-b680-ac2031af08e1-console-config\") pod \"console-868bd7cfdc-2zgrr\" (UID: \"a7903c1a-8bc0-4c80-b680-ac2031af08e1\") " pod="openshift-console/console-868bd7cfdc-2zgrr"
Jul 20 12:46:05.404989 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:05.404908    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a7903c1a-8bc0-4c80-b680-ac2031af08e1-console-oauth-config\") pod \"console-868bd7cfdc-2zgrr\" (UID: \"a7903c1a-8bc0-4c80-b680-ac2031af08e1\") " pod="openshift-console/console-868bd7cfdc-2zgrr"
Jul 20 12:46:05.406250 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:05.405758    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87hrb\" (UniqueName: \"kubernetes.io/projected/a7903c1a-8bc0-4c80-b680-ac2031af08e1-kube-api-access-87hrb\") pod \"console-868bd7cfdc-2zgrr\" (UID: \"a7903c1a-8bc0-4c80-b680-ac2031af08e1\") " pod="openshift-console/console-868bd7cfdc-2zgrr"
Jul 20 12:46:05.406250 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:05.405800    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a7903c1a-8bc0-4c80-b680-ac2031af08e1-console-serving-cert\") pod \"console-868bd7cfdc-2zgrr\" (UID: \"a7903c1a-8bc0-4c80-b680-ac2031af08e1\") " pod="openshift-console/console-868bd7cfdc-2zgrr"
Jul 20 12:46:05.406250 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:05.405941    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7903c1a-8bc0-4c80-b680-ac2031af08e1-trusted-ca-bundle\") pod \"console-868bd7cfdc-2zgrr\" (UID: \"a7903c1a-8bc0-4c80-b680-ac2031af08e1\") " pod="openshift-console/console-868bd7cfdc-2zgrr"
Jul 20 12:46:05.507460 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:05.507369    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a7903c1a-8bc0-4c80-b680-ac2031af08e1-oauth-serving-cert\") pod \"console-868bd7cfdc-2zgrr\" (UID: \"a7903c1a-8bc0-4c80-b680-ac2031af08e1\") " pod="openshift-console/console-868bd7cfdc-2zgrr"
Jul 20 12:46:05.507460 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:05.507423    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a7903c1a-8bc0-4c80-b680-ac2031af08e1-service-ca\") pod \"console-868bd7cfdc-2zgrr\" (UID: \"a7903c1a-8bc0-4c80-b680-ac2031af08e1\") " pod="openshift-console/console-868bd7cfdc-2zgrr"
Jul 20 12:46:05.507666 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:05.507476    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a7903c1a-8bc0-4c80-b680-ac2031af08e1-console-config\") pod \"console-868bd7cfdc-2zgrr\" (UID: \"a7903c1a-8bc0-4c80-b680-ac2031af08e1\") " pod="openshift-console/console-868bd7cfdc-2zgrr"
Jul 20 12:46:05.507666 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:05.507511    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a7903c1a-8bc0-4c80-b680-ac2031af08e1-console-oauth-config\") pod \"console-868bd7cfdc-2zgrr\" (UID: \"a7903c1a-8bc0-4c80-b680-ac2031af08e1\") " pod="openshift-console/console-868bd7cfdc-2zgrr"
Jul 20 12:46:05.507666 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:05.507573    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87hrb\" (UniqueName: \"kubernetes.io/projected/a7903c1a-8bc0-4c80-b680-ac2031af08e1-kube-api-access-87hrb\") pod \"console-868bd7cfdc-2zgrr\" (UID: \"a7903c1a-8bc0-4c80-b680-ac2031af08e1\") " pod="openshift-console/console-868bd7cfdc-2zgrr"
Jul 20 12:46:05.507666 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:05.507601    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a7903c1a-8bc0-4c80-b680-ac2031af08e1-console-serving-cert\") pod \"console-868bd7cfdc-2zgrr\" (UID: \"a7903c1a-8bc0-4c80-b680-ac2031af08e1\") " pod="openshift-console/console-868bd7cfdc-2zgrr"
Jul 20 12:46:05.507884 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:05.507683    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7903c1a-8bc0-4c80-b680-ac2031af08e1-trusted-ca-bundle\") pod \"console-868bd7cfdc-2zgrr\" (UID: \"a7903c1a-8bc0-4c80-b680-ac2031af08e1\") " pod="openshift-console/console-868bd7cfdc-2zgrr"
Jul 20 12:46:05.508394 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:05.508328    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a7903c1a-8bc0-4c80-b680-ac2031af08e1-oauth-serving-cert\") pod \"console-868bd7cfdc-2zgrr\" (UID: \"a7903c1a-8bc0-4c80-b680-ac2031af08e1\") " pod="openshift-console/console-868bd7cfdc-2zgrr"
Jul 20 12:46:05.508507 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:05.508409    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a7903c1a-8bc0-4c80-b680-ac2031af08e1-console-config\") pod \"console-868bd7cfdc-2zgrr\" (UID: \"a7903c1a-8bc0-4c80-b680-ac2031af08e1\") " pod="openshift-console/console-868bd7cfdc-2zgrr"
Jul 20 12:46:05.508507 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:05.508461    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a7903c1a-8bc0-4c80-b680-ac2031af08e1-service-ca\") pod \"console-868bd7cfdc-2zgrr\" (UID: \"a7903c1a-8bc0-4c80-b680-ac2031af08e1\") " pod="openshift-console/console-868bd7cfdc-2zgrr"
Jul 20 12:46:05.509284 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:05.509259    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7903c1a-8bc0-4c80-b680-ac2031af08e1-trusted-ca-bundle\") pod \"console-868bd7cfdc-2zgrr\" (UID: \"a7903c1a-8bc0-4c80-b680-ac2031af08e1\") " pod="openshift-console/console-868bd7cfdc-2zgrr"
Jul 20 12:46:05.510391 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:05.510364    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a7903c1a-8bc0-4c80-b680-ac2031af08e1-console-oauth-config\") pod \"console-868bd7cfdc-2zgrr\" (UID: \"a7903c1a-8bc0-4c80-b680-ac2031af08e1\") " pod="openshift-console/console-868bd7cfdc-2zgrr"
Jul 20 12:46:05.510728 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:05.510700    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a7903c1a-8bc0-4c80-b680-ac2031af08e1-console-serving-cert\") pod \"console-868bd7cfdc-2zgrr\" (UID: \"a7903c1a-8bc0-4c80-b680-ac2031af08e1\") " pod="openshift-console/console-868bd7cfdc-2zgrr"
Jul 20 12:46:05.516760 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:05.516740    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87hrb\" (UniqueName: \"kubernetes.io/projected/a7903c1a-8bc0-4c80-b680-ac2031af08e1-kube-api-access-87hrb\") pod \"console-868bd7cfdc-2zgrr\" (UID: \"a7903c1a-8bc0-4c80-b680-ac2031af08e1\") " pod="openshift-console/console-868bd7cfdc-2zgrr"
Jul 20 12:46:05.597195 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:05.597153    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-868bd7cfdc-2zgrr"
Jul 20 12:46:05.732440 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:05.732400    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-868bd7cfdc-2zgrr"]
Jul 20 12:46:05.734790 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:46:05.734752    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7903c1a_8bc0_4c80_b680_ac2031af08e1.slice/crio-3a1cbe6b582dacf095cfc5b07c389c8474dd99c25dd2324609767ccc1c400b8b WatchSource:0}: Error finding container 3a1cbe6b582dacf095cfc5b07c389c8474dd99c25dd2324609767ccc1c400b8b: Status 404 returned error can't find the container with id 3a1cbe6b582dacf095cfc5b07c389c8474dd99c25dd2324609767ccc1c400b8b
Jul 20 12:46:06.338609 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:06.338531    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-868bd7cfdc-2zgrr" event={"ID":"a7903c1a-8bc0-4c80-b680-ac2031af08e1","Type":"ContainerStarted","Data":"d8126cb0da408e3fd1475782d5780d921f5eaa25d508441f40e436fb9a39bfb5"}
Jul 20 12:46:06.338989 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:06.338625    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-868bd7cfdc-2zgrr" event={"ID":"a7903c1a-8bc0-4c80-b680-ac2031af08e1","Type":"ContainerStarted","Data":"3a1cbe6b582dacf095cfc5b07c389c8474dd99c25dd2324609767ccc1c400b8b"}
Jul 20 12:46:06.341390 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:06.341358    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67845f5c74-zgtqw" event={"ID":"8becd856-1e60-4ce1-9390-2584e406f13e","Type":"ContainerStarted","Data":"f35f11d40311524fda4e63ddb381b2977f9daf9368fc4440cb35ca22291e75a3"}
Jul 20 12:46:06.341503 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:06.341420    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67845f5c74-zgtqw" event={"ID":"8becd856-1e60-4ce1-9390-2584e406f13e","Type":"ContainerStarted","Data":"7396e14e7177b3aace6d3573c47cc9675bcd10b185bf8c233e322413566fdd3c"}
Jul 20 12:46:06.361313 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:06.361261    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-868bd7cfdc-2zgrr" podStartSLOduration=1.361244623 podStartE2EDuration="1.361244623s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:46:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:46:06.359150856 +0000 UTC m=+79.114200252" watchObservedRunningTime="2026-07-20 12:46:06.361244623 +0000 UTC m=+79.116293996"
Jul 20 12:46:06.385515 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:06.385451    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-67845f5c74-zgtqw" podStartSLOduration=6.395763278 podStartE2EDuration="11.385435919s" totalImagesPullingTime="4.989672641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:45:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:46:06.384587409 +0000 UTC m=+79.139636809" watchObservedRunningTime="2026-07-20 12:46:06.385435919 +0000 UTC m=+79.140485292"
Jul 20 12:46:07.345532 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:07.345501    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-67845f5c74-zgtqw"
Jul 20 12:46:08.359642 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:08.359607    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-67845f5c74-zgtqw"
Jul 20 12:46:08.810779 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:08.810694    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84968b9df5-9dhhp"
Jul 20 12:46:15.597651 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:15.597509    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-868bd7cfdc-2zgrr"
Jul 20 12:46:15.597651 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:15.597581    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-868bd7cfdc-2zgrr"
Jul 20 12:46:15.602327 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:15.602302    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-868bd7cfdc-2zgrr"
Jul 20 12:46:16.389335 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:16.389299    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-868bd7cfdc-2zgrr"
Jul 20 12:46:16.443268 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:16.443232    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-758d48dd55-tj6b2"]
Jul 20 12:46:17.843973 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:17.843933    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5cc85db8b5-6q5mm"
Jul 20 12:46:17.844387 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:17.843993    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5cc85db8b5-6q5mm"
Jul 20 12:46:19.241681 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:19.241616    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-69d95f68b6-bhfk2" podUID="8ef0d58e-006c-4b3f-b1ce-c15211ca5a84" containerName="console" containerID="cri-o://9433d14b0733afe7c733d6721db1c636a3e34210cb855e40bca0b77126e1a228" gracePeriod=15
Jul 20 12:46:20.026755 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:20.026727    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69d95f68b6-bhfk2"
Jul 20 12:46:20.144813 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:20.144724    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5gh4d\" (UniqueName: \"kubernetes.io/projected/8ef0d58e-006c-4b3f-b1ce-c15211ca5a84-kube-api-access-5gh4d\") pod \"8ef0d58e-006c-4b3f-b1ce-c15211ca5a84\" (UID: \"8ef0d58e-006c-4b3f-b1ce-c15211ca5a84\") "
Jul 20 12:46:20.144813 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:20.144777    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8ef0d58e-006c-4b3f-b1ce-c15211ca5a84-console-serving-cert\") pod \"8ef0d58e-006c-4b3f-b1ce-c15211ca5a84\" (UID: \"8ef0d58e-006c-4b3f-b1ce-c15211ca5a84\") "
Jul 20 12:46:20.144813 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:20.144802    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8ef0d58e-006c-4b3f-b1ce-c15211ca5a84-service-ca\") pod \"8ef0d58e-006c-4b3f-b1ce-c15211ca5a84\" (UID: \"8ef0d58e-006c-4b3f-b1ce-c15211ca5a84\") "
Jul 20 12:46:20.145072 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:20.144847    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8ef0d58e-006c-4b3f-b1ce-c15211ca5a84-oauth-serving-cert\") pod \"8ef0d58e-006c-4b3f-b1ce-c15211ca5a84\" (UID: \"8ef0d58e-006c-4b3f-b1ce-c15211ca5a84\") "
Jul 20 12:46:20.145072 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:20.144900    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8ef0d58e-006c-4b3f-b1ce-c15211ca5a84-console-oauth-config\") pod \"8ef0d58e-006c-4b3f-b1ce-c15211ca5a84\" (UID: \"8ef0d58e-006c-4b3f-b1ce-c15211ca5a84\") "
Jul 20 12:46:20.145072 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:20.144942    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8ef0d58e-006c-4b3f-b1ce-c15211ca5a84-console-config\") pod \"8ef0d58e-006c-4b3f-b1ce-c15211ca5a84\" (UID: \"8ef0d58e-006c-4b3f-b1ce-c15211ca5a84\") "
Jul 20 12:46:20.145340 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:20.145310    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ef0d58e-006c-4b3f-b1ce-c15211ca5a84-service-ca" (OuterVolumeSpecName: "service-ca") pod "8ef0d58e-006c-4b3f-b1ce-c15211ca5a84" (UID: "8ef0d58e-006c-4b3f-b1ce-c15211ca5a84"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 12:46:20.145407 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:20.145335    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ef0d58e-006c-4b3f-b1ce-c15211ca5a84-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8ef0d58e-006c-4b3f-b1ce-c15211ca5a84" (UID: "8ef0d58e-006c-4b3f-b1ce-c15211ca5a84"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 12:46:20.145461 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:20.145439    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ef0d58e-006c-4b3f-b1ce-c15211ca5a84-console-config" (OuterVolumeSpecName: "console-config") pod "8ef0d58e-006c-4b3f-b1ce-c15211ca5a84" (UID: "8ef0d58e-006c-4b3f-b1ce-c15211ca5a84"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 12:46:20.147264 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:20.147237    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ef0d58e-006c-4b3f-b1ce-c15211ca5a84-kube-api-access-5gh4d" (OuterVolumeSpecName: "kube-api-access-5gh4d") pod "8ef0d58e-006c-4b3f-b1ce-c15211ca5a84" (UID: "8ef0d58e-006c-4b3f-b1ce-c15211ca5a84"). InnerVolumeSpecName "kube-api-access-5gh4d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 12:46:20.147497 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:20.147477    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ef0d58e-006c-4b3f-b1ce-c15211ca5a84-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8ef0d58e-006c-4b3f-b1ce-c15211ca5a84" (UID: "8ef0d58e-006c-4b3f-b1ce-c15211ca5a84"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 12:46:20.147569 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:20.147550    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ef0d58e-006c-4b3f-b1ce-c15211ca5a84-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8ef0d58e-006c-4b3f-b1ce-c15211ca5a84" (UID: "8ef0d58e-006c-4b3f-b1ce-c15211ca5a84"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 12:46:20.246541 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:20.246498    2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8ef0d58e-006c-4b3f-b1ce-c15211ca5a84-oauth-serving-cert\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:46:20.246541 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:20.246527    2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8ef0d58e-006c-4b3f-b1ce-c15211ca5a84-console-oauth-config\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:46:20.246541 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:20.246545    2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8ef0d58e-006c-4b3f-b1ce-c15211ca5a84-console-config\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:46:20.246541 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:20.246554    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5gh4d\" (UniqueName: \"kubernetes.io/projected/8ef0d58e-006c-4b3f-b1ce-c15211ca5a84-kube-api-access-5gh4d\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:46:20.247023 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:20.246564    2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8ef0d58e-006c-4b3f-b1ce-c15211ca5a84-console-serving-cert\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:46:20.247023 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:20.246590    2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8ef0d58e-006c-4b3f-b1ce-c15211ca5a84-service-ca\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:46:20.407316 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:20.407230    2570 generic.go:356] "Generic (PLEG): container finished" podID="8ef0d58e-006c-4b3f-b1ce-c15211ca5a84" containerID="9433d14b0733afe7c733d6721db1c636a3e34210cb855e40bca0b77126e1a228" exitCode=0
Jul 20 12:46:20.407316 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:20.407285    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69d95f68b6-bhfk2"
Jul 20 12:46:20.407316 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:20.407294    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69d95f68b6-bhfk2" event={"ID":"8ef0d58e-006c-4b3f-b1ce-c15211ca5a84","Type":"ContainerDied","Data":"9433d14b0733afe7c733d6721db1c636a3e34210cb855e40bca0b77126e1a228"}
Jul 20 12:46:20.407572 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:20.407370    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69d95f68b6-bhfk2" event={"ID":"8ef0d58e-006c-4b3f-b1ce-c15211ca5a84","Type":"ContainerDied","Data":"f0de8102a3669cbdc6eb342a23b79262b77b9a3082589ea580daffb21e79b24a"}
Jul 20 12:46:20.407572 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:20.407397    2570 scope.go:117] "RemoveContainer" containerID="9433d14b0733afe7c733d6721db1c636a3e34210cb855e40bca0b77126e1a228"
Jul 20 12:46:20.416334 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:20.416316    2570 scope.go:117] "RemoveContainer" containerID="9433d14b0733afe7c733d6721db1c636a3e34210cb855e40bca0b77126e1a228"
Jul 20 12:46:20.416593 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:46:20.416568    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9433d14b0733afe7c733d6721db1c636a3e34210cb855e40bca0b77126e1a228\": container with ID starting with 9433d14b0733afe7c733d6721db1c636a3e34210cb855e40bca0b77126e1a228 not found: ID does not exist" containerID="9433d14b0733afe7c733d6721db1c636a3e34210cb855e40bca0b77126e1a228"
Jul 20 12:46:20.416659 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:20.416600    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9433d14b0733afe7c733d6721db1c636a3e34210cb855e40bca0b77126e1a228"} err="failed to get container status \"9433d14b0733afe7c733d6721db1c636a3e34210cb855e40bca0b77126e1a228\": rpc error: code = NotFound desc = could not find container \"9433d14b0733afe7c733d6721db1c636a3e34210cb855e40bca0b77126e1a228\": container with ID starting with 9433d14b0733afe7c733d6721db1c636a3e34210cb855e40bca0b77126e1a228 not found: ID does not exist"
Jul 20 12:46:20.429210 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:20.429188    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69d95f68b6-bhfk2"]
Jul 20 12:46:20.432904 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:20.432878    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-69d95f68b6-bhfk2"]
Jul 20 12:46:21.806719 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:21.806683    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ef0d58e-006c-4b3f-b1ce-c15211ca5a84" path="/var/lib/kubelet/pods/8ef0d58e-006c-4b3f-b1ce-c15211ca5a84/volumes"
Jul 20 12:46:30.261774 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:30.261712    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-84968b9df5-9dhhp" podUID="3fada112-ead2-4d2e-adb9-960bd62d7af7" containerName="console" containerID="cri-o://9921f23ac89bb14b332906b1d8a0427fee07976b034a792c20756e066f40a65f" gracePeriod=15
Jul 20 12:46:30.452989 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:30.452956    2570 generic.go:356] "Generic (PLEG): container finished" podID="3fada112-ead2-4d2e-adb9-960bd62d7af7" containerID="9921f23ac89bb14b332906b1d8a0427fee07976b034a792c20756e066f40a65f" exitCode=0
Jul 20 12:46:30.453178 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:30.453002    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84968b9df5-9dhhp" event={"ID":"3fada112-ead2-4d2e-adb9-960bd62d7af7","Type":"ContainerDied","Data":"9921f23ac89bb14b332906b1d8a0427fee07976b034a792c20756e066f40a65f"}
Jul 20 12:46:31.035558 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:31.035522    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84968b9df5-9dhhp"
Jul 20 12:46:31.132257 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:31.132217    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3fada112-ead2-4d2e-adb9-960bd62d7af7-console-serving-cert\") pod \"3fada112-ead2-4d2e-adb9-960bd62d7af7\" (UID: \"3fada112-ead2-4d2e-adb9-960bd62d7af7\") "
Jul 20 12:46:31.132445 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:31.132294    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3fada112-ead2-4d2e-adb9-960bd62d7af7-oauth-serving-cert\") pod \"3fada112-ead2-4d2e-adb9-960bd62d7af7\" (UID: \"3fada112-ead2-4d2e-adb9-960bd62d7af7\") "
Jul 20 12:46:31.132445 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:31.132326    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m7ng9\" (UniqueName: \"kubernetes.io/projected/3fada112-ead2-4d2e-adb9-960bd62d7af7-kube-api-access-m7ng9\") pod \"3fada112-ead2-4d2e-adb9-960bd62d7af7\" (UID: \"3fada112-ead2-4d2e-adb9-960bd62d7af7\") "
Jul 20 12:46:31.132445 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:31.132362    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fada112-ead2-4d2e-adb9-960bd62d7af7-trusted-ca-bundle\") pod \"3fada112-ead2-4d2e-adb9-960bd62d7af7\" (UID: \"3fada112-ead2-4d2e-adb9-960bd62d7af7\") "
Jul 20 12:46:31.132445 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:31.132391    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3fada112-ead2-4d2e-adb9-960bd62d7af7-service-ca\") pod \"3fada112-ead2-4d2e-adb9-960bd62d7af7\" (UID: \"3fada112-ead2-4d2e-adb9-960bd62d7af7\") "
Jul 20 12:46:31.132445 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:31.132427    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3fada112-ead2-4d2e-adb9-960bd62d7af7-console-config\") pod \"3fada112-ead2-4d2e-adb9-960bd62d7af7\" (UID: \"3fada112-ead2-4d2e-adb9-960bd62d7af7\") "
Jul 20 12:46:31.132671 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:31.132450    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3fada112-ead2-4d2e-adb9-960bd62d7af7-console-oauth-config\") pod \"3fada112-ead2-4d2e-adb9-960bd62d7af7\" (UID: \"3fada112-ead2-4d2e-adb9-960bd62d7af7\") "
Jul 20 12:46:31.132881 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:31.132759    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fada112-ead2-4d2e-adb9-960bd62d7af7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3fada112-ead2-4d2e-adb9-960bd62d7af7" (UID: "3fada112-ead2-4d2e-adb9-960bd62d7af7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 12:46:31.132999 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:31.132877    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fada112-ead2-4d2e-adb9-960bd62d7af7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3fada112-ead2-4d2e-adb9-960bd62d7af7" (UID: "3fada112-ead2-4d2e-adb9-960bd62d7af7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 12:46:31.132999 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:31.132894    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fada112-ead2-4d2e-adb9-960bd62d7af7-service-ca" (OuterVolumeSpecName: "service-ca") pod "3fada112-ead2-4d2e-adb9-960bd62d7af7" (UID: "3fada112-ead2-4d2e-adb9-960bd62d7af7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 12:46:31.132999 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:31.132943    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fada112-ead2-4d2e-adb9-960bd62d7af7-console-config" (OuterVolumeSpecName: "console-config") pod "3fada112-ead2-4d2e-adb9-960bd62d7af7" (UID: "3fada112-ead2-4d2e-adb9-960bd62d7af7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 12:46:31.134752 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:31.134727    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fada112-ead2-4d2e-adb9-960bd62d7af7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3fada112-ead2-4d2e-adb9-960bd62d7af7" (UID: "3fada112-ead2-4d2e-adb9-960bd62d7af7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 12:46:31.134971 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:31.134947    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fada112-ead2-4d2e-adb9-960bd62d7af7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3fada112-ead2-4d2e-adb9-960bd62d7af7" (UID: "3fada112-ead2-4d2e-adb9-960bd62d7af7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 12:46:31.135037 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:31.134983    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fada112-ead2-4d2e-adb9-960bd62d7af7-kube-api-access-m7ng9" (OuterVolumeSpecName: "kube-api-access-m7ng9") pod "3fada112-ead2-4d2e-adb9-960bd62d7af7" (UID: "3fada112-ead2-4d2e-adb9-960bd62d7af7"). InnerVolumeSpecName "kube-api-access-m7ng9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 12:46:31.233669 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:31.233627    2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3fada112-ead2-4d2e-adb9-960bd62d7af7-console-serving-cert\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:46:31.233669 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:31.233663    2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3fada112-ead2-4d2e-adb9-960bd62d7af7-oauth-serving-cert\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:46:31.233669 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:31.233672    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m7ng9\" (UniqueName: \"kubernetes.io/projected/3fada112-ead2-4d2e-adb9-960bd62d7af7-kube-api-access-m7ng9\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:46:31.233669 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:31.233682    2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fada112-ead2-4d2e-adb9-960bd62d7af7-trusted-ca-bundle\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:46:31.233975 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:31.233694    2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3fada112-ead2-4d2e-adb9-960bd62d7af7-service-ca\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:46:31.233975 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:31.233702    2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3fada112-ead2-4d2e-adb9-960bd62d7af7-console-config\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:46:31.233975 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:31.233710    2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3fada112-ead2-4d2e-adb9-960bd62d7af7-console-oauth-config\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:46:31.292433 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:31.292400    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-nt9ss"
Jul 20 12:46:31.458668 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:31.458591    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84968b9df5-9dhhp"
Jul 20 12:46:31.458668 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:31.458624    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84968b9df5-9dhhp" event={"ID":"3fada112-ead2-4d2e-adb9-960bd62d7af7","Type":"ContainerDied","Data":"23528b6cd97ed5e395e8e2348ce24fdf6c3dd95625dbf8336c9c1ef8fe30a05a"}
Jul 20 12:46:31.458862 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:31.458686    2570 scope.go:117] "RemoveContainer" containerID="9921f23ac89bb14b332906b1d8a0427fee07976b034a792c20756e066f40a65f"
Jul 20 12:46:31.482537 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:31.482506    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84968b9df5-9dhhp"]
Jul 20 12:46:31.486195 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:31.486168    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-84968b9df5-9dhhp"]
Jul 20 12:46:31.807323 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:31.807244    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fada112-ead2-4d2e-adb9-960bd62d7af7" path="/var/lib/kubelet/pods/3fada112-ead2-4d2e-adb9-960bd62d7af7/volumes"
Jul 20 12:46:37.849455 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:37.849420    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5cc85db8b5-6q5mm"
Jul 20 12:46:37.853865 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:37.853840    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5cc85db8b5-6q5mm"
Jul 20 12:46:41.465788 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:41.465737    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-758d48dd55-tj6b2" podUID="ca8af42a-dd23-4216-8455-4671eeebd8e2" containerName="console" containerID="cri-o://e9f3aa49bb7c40654cc36ac0fbe24d14cd584e6417f2ce7690fbfd15754bff38" gracePeriod=15
Jul 20 12:46:41.739310 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:41.739281    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-758d48dd55-tj6b2"
Jul 20 12:46:41.833306 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:41.833261    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ca8af42a-dd23-4216-8455-4671eeebd8e2-oauth-serving-cert\") pod \"ca8af42a-dd23-4216-8455-4671eeebd8e2\" (UID: \"ca8af42a-dd23-4216-8455-4671eeebd8e2\") "
Jul 20 12:46:41.833306 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:41.833312    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca8af42a-dd23-4216-8455-4671eeebd8e2-trusted-ca-bundle\") pod \"ca8af42a-dd23-4216-8455-4671eeebd8e2\" (UID: \"ca8af42a-dd23-4216-8455-4671eeebd8e2\") "
Jul 20 12:46:41.833560 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:41.833358    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ca8af42a-dd23-4216-8455-4671eeebd8e2-console-config\") pod \"ca8af42a-dd23-4216-8455-4671eeebd8e2\" (UID: \"ca8af42a-dd23-4216-8455-4671eeebd8e2\") "
Jul 20 12:46:41.833560 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:41.833384    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ca8af42a-dd23-4216-8455-4671eeebd8e2-service-ca\") pod \"ca8af42a-dd23-4216-8455-4671eeebd8e2\" (UID: \"ca8af42a-dd23-4216-8455-4671eeebd8e2\") "
Jul 20 12:46:41.833560 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:41.833421    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ca8af42a-dd23-4216-8455-4671eeebd8e2-console-oauth-config\") pod \"ca8af42a-dd23-4216-8455-4671eeebd8e2\" (UID: \"ca8af42a-dd23-4216-8455-4671eeebd8e2\") "
Jul 20 12:46:41.833560 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:41.833454    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2vwbs\" (UniqueName: \"kubernetes.io/projected/ca8af42a-dd23-4216-8455-4671eeebd8e2-kube-api-access-2vwbs\") pod \"ca8af42a-dd23-4216-8455-4671eeebd8e2\" (UID: \"ca8af42a-dd23-4216-8455-4671eeebd8e2\") "
Jul 20 12:46:41.833560 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:41.833492    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ca8af42a-dd23-4216-8455-4671eeebd8e2-console-serving-cert\") pod \"ca8af42a-dd23-4216-8455-4671eeebd8e2\" (UID: \"ca8af42a-dd23-4216-8455-4671eeebd8e2\") "
Jul 20 12:46:41.833809 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:41.833726    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca8af42a-dd23-4216-8455-4671eeebd8e2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ca8af42a-dd23-4216-8455-4671eeebd8e2" (UID: "ca8af42a-dd23-4216-8455-4671eeebd8e2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 12:46:41.833861 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:41.833824    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca8af42a-dd23-4216-8455-4671eeebd8e2-service-ca" (OuterVolumeSpecName: "service-ca") pod "ca8af42a-dd23-4216-8455-4671eeebd8e2" (UID: "ca8af42a-dd23-4216-8455-4671eeebd8e2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 12:46:41.833962 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:41.833834    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca8af42a-dd23-4216-8455-4671eeebd8e2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ca8af42a-dd23-4216-8455-4671eeebd8e2" (UID: "ca8af42a-dd23-4216-8455-4671eeebd8e2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 12:46:41.834076 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:41.834062    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca8af42a-dd23-4216-8455-4671eeebd8e2-console-config" (OuterVolumeSpecName: "console-config") pod "ca8af42a-dd23-4216-8455-4671eeebd8e2" (UID: "ca8af42a-dd23-4216-8455-4671eeebd8e2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 12:46:41.835804 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:41.835778    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca8af42a-dd23-4216-8455-4671eeebd8e2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ca8af42a-dd23-4216-8455-4671eeebd8e2" (UID: "ca8af42a-dd23-4216-8455-4671eeebd8e2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 12:46:41.835904 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:41.835800    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca8af42a-dd23-4216-8455-4671eeebd8e2-kube-api-access-2vwbs" (OuterVolumeSpecName: "kube-api-access-2vwbs") pod "ca8af42a-dd23-4216-8455-4671eeebd8e2" (UID: "ca8af42a-dd23-4216-8455-4671eeebd8e2"). InnerVolumeSpecName "kube-api-access-2vwbs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 12:46:41.835904 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:41.835841    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca8af42a-dd23-4216-8455-4671eeebd8e2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ca8af42a-dd23-4216-8455-4671eeebd8e2" (UID: "ca8af42a-dd23-4216-8455-4671eeebd8e2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 12:46:41.934985 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:41.934924    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2vwbs\" (UniqueName: \"kubernetes.io/projected/ca8af42a-dd23-4216-8455-4671eeebd8e2-kube-api-access-2vwbs\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:46:41.934985 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:41.934975    2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ca8af42a-dd23-4216-8455-4671eeebd8e2-console-serving-cert\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:46:41.934985 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:41.934986    2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ca8af42a-dd23-4216-8455-4671eeebd8e2-oauth-serving-cert\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:46:41.934985 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:41.934995    2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca8af42a-dd23-4216-8455-4671eeebd8e2-trusted-ca-bundle\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:46:41.934985 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:41.935004    2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ca8af42a-dd23-4216-8455-4671eeebd8e2-console-config\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:46:41.935346 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:41.935014    2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ca8af42a-dd23-4216-8455-4671eeebd8e2-service-ca\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:46:41.935346 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:41.935023    2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ca8af42a-dd23-4216-8455-4671eeebd8e2-console-oauth-config\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:46:42.523540 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:42.523501    2570 generic.go:356] "Generic (PLEG): container finished" podID="ca8af42a-dd23-4216-8455-4671eeebd8e2" containerID="e9f3aa49bb7c40654cc36ac0fbe24d14cd584e6417f2ce7690fbfd15754bff38" exitCode=0
Jul 20 12:46:42.524005 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:42.523549    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-758d48dd55-tj6b2"
Jul 20 12:46:42.524005 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:42.523559    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-758d48dd55-tj6b2" event={"ID":"ca8af42a-dd23-4216-8455-4671eeebd8e2","Type":"ContainerDied","Data":"e9f3aa49bb7c40654cc36ac0fbe24d14cd584e6417f2ce7690fbfd15754bff38"}
Jul 20 12:46:42.524005 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:42.523608    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-758d48dd55-tj6b2" event={"ID":"ca8af42a-dd23-4216-8455-4671eeebd8e2","Type":"ContainerDied","Data":"6d175c946482e82748cdf9fe01426f8b41b0e65fbcc3fce7c83f7e1363bc7398"}
Jul 20 12:46:42.524005 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:42.523636    2570 scope.go:117] "RemoveContainer" containerID="e9f3aa49bb7c40654cc36ac0fbe24d14cd584e6417f2ce7690fbfd15754bff38"
Jul 20 12:46:42.532934 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:42.532916    2570 scope.go:117] "RemoveContainer" containerID="e9f3aa49bb7c40654cc36ac0fbe24d14cd584e6417f2ce7690fbfd15754bff38"
Jul 20 12:46:42.533244 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:46:42.533221    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9f3aa49bb7c40654cc36ac0fbe24d14cd584e6417f2ce7690fbfd15754bff38\": container with ID starting with e9f3aa49bb7c40654cc36ac0fbe24d14cd584e6417f2ce7690fbfd15754bff38 not found: ID does not exist" containerID="e9f3aa49bb7c40654cc36ac0fbe24d14cd584e6417f2ce7690fbfd15754bff38"
Jul 20 12:46:42.533306 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:42.533255    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9f3aa49bb7c40654cc36ac0fbe24d14cd584e6417f2ce7690fbfd15754bff38"} err="failed to get container status \"e9f3aa49bb7c40654cc36ac0fbe24d14cd584e6417f2ce7690fbfd15754bff38\": rpc error: code = NotFound desc = could not find container \"e9f3aa49bb7c40654cc36ac0fbe24d14cd584e6417f2ce7690fbfd15754bff38\": container with ID starting with e9f3aa49bb7c40654cc36ac0fbe24d14cd584e6417f2ce7690fbfd15754bff38 not found: ID does not exist"
Jul 20 12:46:42.545309 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:42.545266    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-758d48dd55-tj6b2"]
Jul 20 12:46:42.552067 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:42.552037    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-758d48dd55-tj6b2"]
Jul 20 12:46:43.807037 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:46:43.807002    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca8af42a-dd23-4216-8455-4671eeebd8e2" path="/var/lib/kubelet/pods/ca8af42a-dd23-4216-8455-4671eeebd8e2/volumes"
Jul 20 12:47:19.434624 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:19.434580    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-544cff9648-cl7tb"]
Jul 20 12:47:19.435267 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:19.435047    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ef0d58e-006c-4b3f-b1ce-c15211ca5a84" containerName="console"
Jul 20 12:47:19.435267 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:19.435067    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ef0d58e-006c-4b3f-b1ce-c15211ca5a84" containerName="console"
Jul 20 12:47:19.435267 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:19.435117    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca8af42a-dd23-4216-8455-4671eeebd8e2" containerName="console"
Jul 20 12:47:19.435267 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:19.435126    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca8af42a-dd23-4216-8455-4671eeebd8e2" containerName="console"
Jul 20 12:47:19.435267 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:19.435146    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fada112-ead2-4d2e-adb9-960bd62d7af7" containerName="console"
Jul 20 12:47:19.435267 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:19.435155    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fada112-ead2-4d2e-adb9-960bd62d7af7" containerName="console"
Jul 20 12:47:19.435267 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:19.435241    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ef0d58e-006c-4b3f-b1ce-c15211ca5a84" containerName="console"
Jul 20 12:47:19.435267 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:19.435252    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fada112-ead2-4d2e-adb9-960bd62d7af7" containerName="console"
Jul 20 12:47:19.435267 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:19.435263    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca8af42a-dd23-4216-8455-4671eeebd8e2" containerName="console"
Jul 20 12:47:19.437365 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:19.437346    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-544cff9648-cl7tb"
Jul 20 12:47:19.449667 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:19.449644    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-544cff9648-cl7tb"]
Jul 20 12:47:19.456483 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:19.456447    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/29ff3c94-5680-4e80-bac9-3677175508c4-console-serving-cert\") pod \"console-544cff9648-cl7tb\" (UID: \"29ff3c94-5680-4e80-bac9-3677175508c4\") " pod="openshift-console/console-544cff9648-cl7tb"
Jul 20 12:47:19.456604 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:19.456492    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5tdr\" (UniqueName: \"kubernetes.io/projected/29ff3c94-5680-4e80-bac9-3677175508c4-kube-api-access-w5tdr\") pod \"console-544cff9648-cl7tb\" (UID: \"29ff3c94-5680-4e80-bac9-3677175508c4\") " pod="openshift-console/console-544cff9648-cl7tb"
Jul 20 12:47:19.456604 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:19.456539    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29ff3c94-5680-4e80-bac9-3677175508c4-trusted-ca-bundle\") pod \"console-544cff9648-cl7tb\" (UID: \"29ff3c94-5680-4e80-bac9-3677175508c4\") " pod="openshift-console/console-544cff9648-cl7tb"
Jul 20 12:47:19.456604 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:19.456562    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/29ff3c94-5680-4e80-bac9-3677175508c4-console-config\") pod \"console-544cff9648-cl7tb\" (UID: \"29ff3c94-5680-4e80-bac9-3677175508c4\") " pod="openshift-console/console-544cff9648-cl7tb"
Jul 20 12:47:19.456740 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:19.456667    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/29ff3c94-5680-4e80-bac9-3677175508c4-service-ca\") pod \"console-544cff9648-cl7tb\" (UID: \"29ff3c94-5680-4e80-bac9-3677175508c4\") " pod="openshift-console/console-544cff9648-cl7tb"
Jul 20 12:47:19.456740 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:19.456702    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/29ff3c94-5680-4e80-bac9-3677175508c4-oauth-serving-cert\") pod \"console-544cff9648-cl7tb\" (UID: \"29ff3c94-5680-4e80-bac9-3677175508c4\") " pod="openshift-console/console-544cff9648-cl7tb"
Jul 20 12:47:19.456833 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:19.456753    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/29ff3c94-5680-4e80-bac9-3677175508c4-console-oauth-config\") pod \"console-544cff9648-cl7tb\" (UID: \"29ff3c94-5680-4e80-bac9-3677175508c4\") " pod="openshift-console/console-544cff9648-cl7tb"
Jul 20 12:47:19.557842 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:19.557801    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5tdr\" (UniqueName: \"kubernetes.io/projected/29ff3c94-5680-4e80-bac9-3677175508c4-kube-api-access-w5tdr\") pod \"console-544cff9648-cl7tb\" (UID: \"29ff3c94-5680-4e80-bac9-3677175508c4\") " pod="openshift-console/console-544cff9648-cl7tb"
Jul 20 12:47:19.557842 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:19.557846    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29ff3c94-5680-4e80-bac9-3677175508c4-trusted-ca-bundle\") pod \"console-544cff9648-cl7tb\" (UID: \"29ff3c94-5680-4e80-bac9-3677175508c4\") " pod="openshift-console/console-544cff9648-cl7tb"
Jul 20 12:47:19.558070 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:19.557864    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/29ff3c94-5680-4e80-bac9-3677175508c4-console-config\") pod \"console-544cff9648-cl7tb\" (UID: \"29ff3c94-5680-4e80-bac9-3677175508c4\") " pod="openshift-console/console-544cff9648-cl7tb"
Jul 20 12:47:19.558070 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:19.557906    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/29ff3c94-5680-4e80-bac9-3677175508c4-service-ca\") pod \"console-544cff9648-cl7tb\" (UID: \"29ff3c94-5680-4e80-bac9-3677175508c4\") " pod="openshift-console/console-544cff9648-cl7tb"
Jul 20 12:47:19.558070 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:19.557920    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/29ff3c94-5680-4e80-bac9-3677175508c4-oauth-serving-cert\") pod \"console-544cff9648-cl7tb\" (UID: \"29ff3c94-5680-4e80-bac9-3677175508c4\") " pod="openshift-console/console-544cff9648-cl7tb"
Jul 20 12:47:19.558070 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:19.557936    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/29ff3c94-5680-4e80-bac9-3677175508c4-console-oauth-config\") pod \"console-544cff9648-cl7tb\" (UID: \"29ff3c94-5680-4e80-bac9-3677175508c4\") " pod="openshift-console/console-544cff9648-cl7tb"
Jul 20 12:47:19.558070 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:19.557992    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/29ff3c94-5680-4e80-bac9-3677175508c4-console-serving-cert\") pod \"console-544cff9648-cl7tb\" (UID: \"29ff3c94-5680-4e80-bac9-3677175508c4\") " pod="openshift-console/console-544cff9648-cl7tb"
Jul 20 12:47:19.558701 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:19.558640    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/29ff3c94-5680-4e80-bac9-3677175508c4-service-ca\") pod \"console-544cff9648-cl7tb\" (UID: \"29ff3c94-5680-4e80-bac9-3677175508c4\") " pod="openshift-console/console-544cff9648-cl7tb"
Jul 20 12:47:19.558808 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:19.558768    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/29ff3c94-5680-4e80-bac9-3677175508c4-console-config\") pod \"console-544cff9648-cl7tb\" (UID: \"29ff3c94-5680-4e80-bac9-3677175508c4\") " pod="openshift-console/console-544cff9648-cl7tb"
Jul 20 12:47:19.558851 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:19.558837    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29ff3c94-5680-4e80-bac9-3677175508c4-trusted-ca-bundle\") pod \"console-544cff9648-cl7tb\" (UID: \"29ff3c94-5680-4e80-bac9-3677175508c4\") " pod="openshift-console/console-544cff9648-cl7tb"
Jul 20 12:47:19.558893 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:19.558837    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/29ff3c94-5680-4e80-bac9-3677175508c4-oauth-serving-cert\") pod \"console-544cff9648-cl7tb\" (UID: \"29ff3c94-5680-4e80-bac9-3677175508c4\") " pod="openshift-console/console-544cff9648-cl7tb"
Jul 20 12:47:19.560399 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:19.560376    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/29ff3c94-5680-4e80-bac9-3677175508c4-console-serving-cert\") pod \"console-544cff9648-cl7tb\" (UID: \"29ff3c94-5680-4e80-bac9-3677175508c4\") " pod="openshift-console/console-544cff9648-cl7tb"
Jul 20 12:47:19.560477 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:19.560414    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/29ff3c94-5680-4e80-bac9-3677175508c4-console-oauth-config\") pod \"console-544cff9648-cl7tb\" (UID: \"29ff3c94-5680-4e80-bac9-3677175508c4\") " pod="openshift-console/console-544cff9648-cl7tb"
Jul 20 12:47:19.566991 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:19.566971    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5tdr\" (UniqueName: \"kubernetes.io/projected/29ff3c94-5680-4e80-bac9-3677175508c4-kube-api-access-w5tdr\") pod \"console-544cff9648-cl7tb\" (UID: \"29ff3c94-5680-4e80-bac9-3677175508c4\") " pod="openshift-console/console-544cff9648-cl7tb"
Jul 20 12:47:19.746294 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:19.746215    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-544cff9648-cl7tb"
Jul 20 12:47:19.870452 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:19.870414    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-544cff9648-cl7tb"]
Jul 20 12:47:19.872818 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:47:19.872792    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29ff3c94_5680_4e80_bac9_3677175508c4.slice/crio-8ec6488a0df40e545baedb08b16792ecf35b348a0b15628d061429a35e1bf1e4 WatchSource:0}: Error finding container 8ec6488a0df40e545baedb08b16792ecf35b348a0b15628d061429a35e1bf1e4: Status 404 returned error can't find the container with id 8ec6488a0df40e545baedb08b16792ecf35b348a0b15628d061429a35e1bf1e4
Jul 20 12:47:20.680274 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:20.680244    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-544cff9648-cl7tb" event={"ID":"29ff3c94-5680-4e80-bac9-3677175508c4","Type":"ContainerStarted","Data":"6d692d2d6d77ef1dd62dc2255a1ded2960d8a495077427fd5910fa9248e71cb5"}
Jul 20 12:47:20.680664 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:20.680294    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-544cff9648-cl7tb" event={"ID":"29ff3c94-5680-4e80-bac9-3677175508c4","Type":"ContainerStarted","Data":"8ec6488a0df40e545baedb08b16792ecf35b348a0b15628d061429a35e1bf1e4"}
Jul 20 12:47:20.698343 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:20.698284    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-544cff9648-cl7tb" podStartSLOduration=1.698266463 podStartE2EDuration="1.698266463s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:47:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:47:20.697426968 +0000 UTC m=+153.452476346" watchObservedRunningTime="2026-07-20 12:47:20.698266463 +0000 UTC m=+153.453315838"
Jul 20 12:47:29.746844 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:29.746809    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-544cff9648-cl7tb"
Jul 20 12:47:29.747382 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:29.746875    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-544cff9648-cl7tb"
Jul 20 12:47:29.751700 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:29.751675    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-544cff9648-cl7tb"
Jul 20 12:47:30.721461 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:30.721432    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-544cff9648-cl7tb"
Jul 20 12:47:30.788210 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:30.788175    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-868bd7cfdc-2zgrr"]
Jul 20 12:47:55.814105 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:55.814050    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-868bd7cfdc-2zgrr" podUID="a7903c1a-8bc0-4c80-b680-ac2031af08e1" containerName="console" containerID="cri-o://d8126cb0da408e3fd1475782d5780d921f5eaa25d508441f40e436fb9a39bfb5" gracePeriod=15
Jul 20 12:47:56.056275 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:56.056254    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-868bd7cfdc-2zgrr"
Jul 20 12:47:56.182641 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:56.182587    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a7903c1a-8bc0-4c80-b680-ac2031af08e1-service-ca\") pod \"a7903c1a-8bc0-4c80-b680-ac2031af08e1\" (UID: \"a7903c1a-8bc0-4c80-b680-ac2031af08e1\") "
Jul 20 12:47:56.182825 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:56.182669    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7903c1a-8bc0-4c80-b680-ac2031af08e1-trusted-ca-bundle\") pod \"a7903c1a-8bc0-4c80-b680-ac2031af08e1\" (UID: \"a7903c1a-8bc0-4c80-b680-ac2031af08e1\") "
Jul 20 12:47:56.182825 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:56.182713    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-87hrb\" (UniqueName: \"kubernetes.io/projected/a7903c1a-8bc0-4c80-b680-ac2031af08e1-kube-api-access-87hrb\") pod \"a7903c1a-8bc0-4c80-b680-ac2031af08e1\" (UID: \"a7903c1a-8bc0-4c80-b680-ac2031af08e1\") "
Jul 20 12:47:56.182825 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:56.182736    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a7903c1a-8bc0-4c80-b680-ac2031af08e1-console-serving-cert\") pod \"a7903c1a-8bc0-4c80-b680-ac2031af08e1\" (UID: \"a7903c1a-8bc0-4c80-b680-ac2031af08e1\") "
Jul 20 12:47:56.182825 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:56.182767    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a7903c1a-8bc0-4c80-b680-ac2031af08e1-oauth-serving-cert\") pod \"a7903c1a-8bc0-4c80-b680-ac2031af08e1\" (UID: \"a7903c1a-8bc0-4c80-b680-ac2031af08e1\") "
Jul 20 12:47:56.182825 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:56.182790    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a7903c1a-8bc0-4c80-b680-ac2031af08e1-console-config\") pod \"a7903c1a-8bc0-4c80-b680-ac2031af08e1\" (UID: \"a7903c1a-8bc0-4c80-b680-ac2031af08e1\") "
Jul 20 12:47:56.183076 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:56.182837    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a7903c1a-8bc0-4c80-b680-ac2031af08e1-console-oauth-config\") pod \"a7903c1a-8bc0-4c80-b680-ac2031af08e1\" (UID: \"a7903c1a-8bc0-4c80-b680-ac2031af08e1\") "
Jul 20 12:47:56.183171 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:56.183120    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7903c1a-8bc0-4c80-b680-ac2031af08e1-service-ca" (OuterVolumeSpecName: "service-ca") pod "a7903c1a-8bc0-4c80-b680-ac2031af08e1" (UID: "a7903c1a-8bc0-4c80-b680-ac2031af08e1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 12:47:56.183245 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:56.183217    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7903c1a-8bc0-4c80-b680-ac2031af08e1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a7903c1a-8bc0-4c80-b680-ac2031af08e1" (UID: "a7903c1a-8bc0-4c80-b680-ac2031af08e1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 12:47:56.183296 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:56.183247    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7903c1a-8bc0-4c80-b680-ac2031af08e1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a7903c1a-8bc0-4c80-b680-ac2031af08e1" (UID: "a7903c1a-8bc0-4c80-b680-ac2031af08e1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 12:47:56.183296 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:56.183260    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7903c1a-8bc0-4c80-b680-ac2031af08e1-console-config" (OuterVolumeSpecName: "console-config") pod "a7903c1a-8bc0-4c80-b680-ac2031af08e1" (UID: "a7903c1a-8bc0-4c80-b680-ac2031af08e1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 12:47:56.184871 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:56.184842    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7903c1a-8bc0-4c80-b680-ac2031af08e1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a7903c1a-8bc0-4c80-b680-ac2031af08e1" (UID: "a7903c1a-8bc0-4c80-b680-ac2031af08e1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 12:47:56.184979 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:56.184905    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7903c1a-8bc0-4c80-b680-ac2031af08e1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a7903c1a-8bc0-4c80-b680-ac2031af08e1" (UID: "a7903c1a-8bc0-4c80-b680-ac2031af08e1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 12:47:56.184979 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:56.184913    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7903c1a-8bc0-4c80-b680-ac2031af08e1-kube-api-access-87hrb" (OuterVolumeSpecName: "kube-api-access-87hrb") pod "a7903c1a-8bc0-4c80-b680-ac2031af08e1" (UID: "a7903c1a-8bc0-4c80-b680-ac2031af08e1"). InnerVolumeSpecName "kube-api-access-87hrb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 12:47:56.283535 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:56.283490    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-87hrb\" (UniqueName: \"kubernetes.io/projected/a7903c1a-8bc0-4c80-b680-ac2031af08e1-kube-api-access-87hrb\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:47:56.283535 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:56.283528    2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a7903c1a-8bc0-4c80-b680-ac2031af08e1-console-serving-cert\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:47:56.283535 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:56.283539    2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a7903c1a-8bc0-4c80-b680-ac2031af08e1-oauth-serving-cert\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:47:56.283784 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:56.283549    2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a7903c1a-8bc0-4c80-b680-ac2031af08e1-console-config\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:47:56.283784 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:56.283557    2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a7903c1a-8bc0-4c80-b680-ac2031af08e1-console-oauth-config\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:47:56.283784 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:56.283566    2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a7903c1a-8bc0-4c80-b680-ac2031af08e1-service-ca\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:47:56.283784 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:56.283575    2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7903c1a-8bc0-4c80-b680-ac2031af08e1-trusted-ca-bundle\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:47:56.818841 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:56.818805    2570 generic.go:356] "Generic (PLEG): container finished" podID="a7903c1a-8bc0-4c80-b680-ac2031af08e1" containerID="d8126cb0da408e3fd1475782d5780d921f5eaa25d508441f40e436fb9a39bfb5" exitCode=0
Jul 20 12:47:56.819311 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:56.818853    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-868bd7cfdc-2zgrr"
Jul 20 12:47:56.819311 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:56.818865    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-868bd7cfdc-2zgrr" event={"ID":"a7903c1a-8bc0-4c80-b680-ac2031af08e1","Type":"ContainerDied","Data":"d8126cb0da408e3fd1475782d5780d921f5eaa25d508441f40e436fb9a39bfb5"}
Jul 20 12:47:56.819311 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:56.818906    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-868bd7cfdc-2zgrr" event={"ID":"a7903c1a-8bc0-4c80-b680-ac2031af08e1","Type":"ContainerDied","Data":"3a1cbe6b582dacf095cfc5b07c389c8474dd99c25dd2324609767ccc1c400b8b"}
Jul 20 12:47:56.819311 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:56.818925    2570 scope.go:117] "RemoveContainer" containerID="d8126cb0da408e3fd1475782d5780d921f5eaa25d508441f40e436fb9a39bfb5"
Jul 20 12:47:56.827425 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:56.827402    2570 scope.go:117] "RemoveContainer" containerID="d8126cb0da408e3fd1475782d5780d921f5eaa25d508441f40e436fb9a39bfb5"
Jul 20 12:47:56.827681 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:47:56.827664    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8126cb0da408e3fd1475782d5780d921f5eaa25d508441f40e436fb9a39bfb5\": container with ID starting with d8126cb0da408e3fd1475782d5780d921f5eaa25d508441f40e436fb9a39bfb5 not found: ID does not exist" containerID="d8126cb0da408e3fd1475782d5780d921f5eaa25d508441f40e436fb9a39bfb5"
Jul 20 12:47:56.827730 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:56.827688    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8126cb0da408e3fd1475782d5780d921f5eaa25d508441f40e436fb9a39bfb5"} err="failed to get container status \"d8126cb0da408e3fd1475782d5780d921f5eaa25d508441f40e436fb9a39bfb5\": rpc error: code = NotFound desc = could not find container \"d8126cb0da408e3fd1475782d5780d921f5eaa25d508441f40e436fb9a39bfb5\": container with ID starting with d8126cb0da408e3fd1475782d5780d921f5eaa25d508441f40e436fb9a39bfb5 not found: ID does not exist"
Jul 20 12:47:56.840612 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:56.840577    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-868bd7cfdc-2zgrr"]
Jul 20 12:47:56.844549 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:56.844516    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-868bd7cfdc-2zgrr"]
Jul 20 12:47:57.806347 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:47:57.806312    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7903c1a-8bc0-4c80-b680-ac2031af08e1" path="/var/lib/kubelet/pods/a7903c1a-8bc0-4c80-b680-ac2031af08e1/volumes"
Jul 20 12:48:19.235521 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:19.235479    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rfhjt"]
Jul 20 12:48:19.235981 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:19.235818    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7903c1a-8bc0-4c80-b680-ac2031af08e1" containerName="console"
Jul 20 12:48:19.235981 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:19.235828    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7903c1a-8bc0-4c80-b680-ac2031af08e1" containerName="console"
Jul 20 12:48:19.235981 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:19.235875    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7903c1a-8bc0-4c80-b680-ac2031af08e1" containerName="console"
Jul 20 12:48:19.237859 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:19.237840    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rfhjt"
Jul 20 12:48:19.241007 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:19.240981    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 20 12:48:19.241198 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:19.241041    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vf8f2\""
Jul 20 12:48:19.242729 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:19.242706    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 20 12:48:19.248839 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:19.248808    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rfhjt"]
Jul 20 12:48:19.264554 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:19.264514    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e617be06-be3f-4411-9111-157ab72624f0-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rfhjt\" (UID: \"e617be06-be3f-4411-9111-157ab72624f0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rfhjt"
Jul 20 12:48:19.264554 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:19.264559    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e617be06-be3f-4411-9111-157ab72624f0-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rfhjt\" (UID: \"e617be06-be3f-4411-9111-157ab72624f0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rfhjt"
Jul 20 12:48:19.264754 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:19.264633    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lp5wb\" (UniqueName: \"kubernetes.io/projected/e617be06-be3f-4411-9111-157ab72624f0-kube-api-access-lp5wb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rfhjt\" (UID: \"e617be06-be3f-4411-9111-157ab72624f0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rfhjt"
Jul 20 12:48:19.365868 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:19.365829    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e617be06-be3f-4411-9111-157ab72624f0-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rfhjt\" (UID: \"e617be06-be3f-4411-9111-157ab72624f0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rfhjt"
Jul 20 12:48:19.366013 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:19.365894    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lp5wb\" (UniqueName: \"kubernetes.io/projected/e617be06-be3f-4411-9111-157ab72624f0-kube-api-access-lp5wb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rfhjt\" (UID: \"e617be06-be3f-4411-9111-157ab72624f0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rfhjt"
Jul 20 12:48:19.366013 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:19.365927    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e617be06-be3f-4411-9111-157ab72624f0-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rfhjt\" (UID: \"e617be06-be3f-4411-9111-157ab72624f0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rfhjt"
Jul 20 12:48:19.366288 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:19.366272    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e617be06-be3f-4411-9111-157ab72624f0-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rfhjt\" (UID: \"e617be06-be3f-4411-9111-157ab72624f0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rfhjt"
Jul 20 12:48:19.366327 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:19.366280    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e617be06-be3f-4411-9111-157ab72624f0-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rfhjt\" (UID: \"e617be06-be3f-4411-9111-157ab72624f0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rfhjt"
Jul 20 12:48:19.375527 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:19.375494    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lp5wb\" (UniqueName: \"kubernetes.io/projected/e617be06-be3f-4411-9111-157ab72624f0-kube-api-access-lp5wb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rfhjt\" (UID: \"e617be06-be3f-4411-9111-157ab72624f0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rfhjt"
Jul 20 12:48:19.547916 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:19.547819    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rfhjt"
Jul 20 12:48:19.679155 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:19.679126    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rfhjt"]
Jul 20 12:48:19.681171 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:48:19.681138    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode617be06_be3f_4411_9111_157ab72624f0.slice/crio-db601b94ecb4564f7bdd942cb7b4045ea597d875a35bf2ec316ae470b4d68950 WatchSource:0}: Error finding container db601b94ecb4564f7bdd942cb7b4045ea597d875a35bf2ec316ae470b4d68950: Status 404 returned error can't find the container with id db601b94ecb4564f7bdd942cb7b4045ea597d875a35bf2ec316ae470b4d68950
Jul 20 12:48:19.912830 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:19.912785    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rfhjt" event={"ID":"e617be06-be3f-4411-9111-157ab72624f0","Type":"ContainerStarted","Data":"db601b94ecb4564f7bdd942cb7b4045ea597d875a35bf2ec316ae470b4d68950"}
Jul 20 12:48:26.945634 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:26.945598    2570 generic.go:356] "Generic (PLEG): container finished" podID="e617be06-be3f-4411-9111-157ab72624f0" containerID="1743edcc5607a901a0a94bcd9772eae907520f225f716a41667e2e0186096c2b" exitCode=0
Jul 20 12:48:26.946043 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:26.945690    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rfhjt" event={"ID":"e617be06-be3f-4411-9111-157ab72624f0","Type":"ContainerDied","Data":"1743edcc5607a901a0a94bcd9772eae907520f225f716a41667e2e0186096c2b"}
Jul 20 12:48:29.961378 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:29.961344    2570 generic.go:356] "Generic (PLEG): container finished" podID="e617be06-be3f-4411-9111-157ab72624f0" containerID="3bd4332f5650babc03b7cfad902714113db02257eef2dc5de670f603503c14a9" exitCode=0
Jul 20 12:48:29.961774 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:29.961392    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rfhjt" event={"ID":"e617be06-be3f-4411-9111-157ab72624f0","Type":"ContainerDied","Data":"3bd4332f5650babc03b7cfad902714113db02257eef2dc5de670f603503c14a9"}
Jul 20 12:48:36.993830 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:36.993737    2570 generic.go:356] "Generic (PLEG): container finished" podID="e617be06-be3f-4411-9111-157ab72624f0" containerID="f3eb26612ba231371f466e0471452b2aa9402254d5dfd62896dbefe3a71e3c71" exitCode=0
Jul 20 12:48:36.993830 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:36.993814    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rfhjt" event={"ID":"e617be06-be3f-4411-9111-157ab72624f0","Type":"ContainerDied","Data":"f3eb26612ba231371f466e0471452b2aa9402254d5dfd62896dbefe3a71e3c71"}
Jul 20 12:48:38.127326 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:38.127292    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rfhjt"
Jul 20 12:48:38.239727 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:38.239671    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e617be06-be3f-4411-9111-157ab72624f0-bundle\") pod \"e617be06-be3f-4411-9111-157ab72624f0\" (UID: \"e617be06-be3f-4411-9111-157ab72624f0\") "
Jul 20 12:48:38.239905 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:38.239752    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lp5wb\" (UniqueName: \"kubernetes.io/projected/e617be06-be3f-4411-9111-157ab72624f0-kube-api-access-lp5wb\") pod \"e617be06-be3f-4411-9111-157ab72624f0\" (UID: \"e617be06-be3f-4411-9111-157ab72624f0\") "
Jul 20 12:48:38.239905 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:38.239800    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e617be06-be3f-4411-9111-157ab72624f0-util\") pod \"e617be06-be3f-4411-9111-157ab72624f0\" (UID: \"e617be06-be3f-4411-9111-157ab72624f0\") "
Jul 20 12:48:38.240351 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:38.240325    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e617be06-be3f-4411-9111-157ab72624f0-bundle" (OuterVolumeSpecName: "bundle") pod "e617be06-be3f-4411-9111-157ab72624f0" (UID: "e617be06-be3f-4411-9111-157ab72624f0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 12:48:38.242034 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:38.242006    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e617be06-be3f-4411-9111-157ab72624f0-kube-api-access-lp5wb" (OuterVolumeSpecName: "kube-api-access-lp5wb") pod "e617be06-be3f-4411-9111-157ab72624f0" (UID: "e617be06-be3f-4411-9111-157ab72624f0"). InnerVolumeSpecName "kube-api-access-lp5wb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 12:48:38.244208 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:38.244182    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e617be06-be3f-4411-9111-157ab72624f0-util" (OuterVolumeSpecName: "util") pod "e617be06-be3f-4411-9111-157ab72624f0" (UID: "e617be06-be3f-4411-9111-157ab72624f0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 12:48:38.340882 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:38.340844    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lp5wb\" (UniqueName: \"kubernetes.io/projected/e617be06-be3f-4411-9111-157ab72624f0-kube-api-access-lp5wb\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:48:38.340882 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:38.340877    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e617be06-be3f-4411-9111-157ab72624f0-util\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:48:38.340882 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:38.340887    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e617be06-be3f-4411-9111-157ab72624f0-bundle\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:48:39.004118 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:39.004077    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rfhjt"
Jul 20 12:48:39.004118 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:39.004077    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rfhjt" event={"ID":"e617be06-be3f-4411-9111-157ab72624f0","Type":"ContainerDied","Data":"db601b94ecb4564f7bdd942cb7b4045ea597d875a35bf2ec316ae470b4d68950"}
Jul 20 12:48:39.004322 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:39.004146    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="db601b94ecb4564f7bdd942cb7b4045ea597d875a35bf2ec316ae470b4d68950"
Jul 20 12:48:41.972014 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:41.971979    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sl8x8"]
Jul 20 12:48:41.972517 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:41.972491    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e617be06-be3f-4411-9111-157ab72624f0" containerName="pull"
Jul 20 12:48:41.972517 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:41.972511    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e617be06-be3f-4411-9111-157ab72624f0" containerName="pull"
Jul 20 12:48:41.972631 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:41.972547    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e617be06-be3f-4411-9111-157ab72624f0" containerName="extract"
Jul 20 12:48:41.972631 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:41.972557    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e617be06-be3f-4411-9111-157ab72624f0" containerName="extract"
Jul 20 12:48:41.972631 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:41.972570    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e617be06-be3f-4411-9111-157ab72624f0" containerName="util"
Jul 20 12:48:41.972631 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:41.972578    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e617be06-be3f-4411-9111-157ab72624f0" containerName="util"
Jul 20 12:48:41.972813 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:41.972661    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="e617be06-be3f-4411-9111-157ab72624f0" containerName="extract"
Jul 20 12:48:42.002451 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:42.002411    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sl8x8"]
Jul 20 12:48:42.002631 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:42.002546    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sl8x8"
Jul 20 12:48:42.005816 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:42.005790    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 20 12:48:42.005960 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:42.005799    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-lkz4v\""
Jul 20 12:48:42.005960 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:42.005799    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 20 12:48:42.175897 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:42.175850    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc849106-d49b-4684-84e0-b2f19620bf85-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-sl8x8\" (UID: \"bc849106-d49b-4684-84e0-b2f19620bf85\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sl8x8"
Jul 20 12:48:42.176061 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:42.175979    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfxpn\" (UniqueName: \"kubernetes.io/projected/bc849106-d49b-4684-84e0-b2f19620bf85-kube-api-access-pfxpn\") pod \"cert-manager-operator-controller-manager-55c444bf86-sl8x8\" (UID: \"bc849106-d49b-4684-84e0-b2f19620bf85\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sl8x8"
Jul 20 12:48:42.276967 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:42.276872    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfxpn\" (UniqueName: \"kubernetes.io/projected/bc849106-d49b-4684-84e0-b2f19620bf85-kube-api-access-pfxpn\") pod \"cert-manager-operator-controller-manager-55c444bf86-sl8x8\" (UID: \"bc849106-d49b-4684-84e0-b2f19620bf85\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sl8x8"
Jul 20 12:48:42.276967 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:42.276944    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc849106-d49b-4684-84e0-b2f19620bf85-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-sl8x8\" (UID: \"bc849106-d49b-4684-84e0-b2f19620bf85\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sl8x8"
Jul 20 12:48:42.277375 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:42.277353    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc849106-d49b-4684-84e0-b2f19620bf85-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-sl8x8\" (UID: \"bc849106-d49b-4684-84e0-b2f19620bf85\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sl8x8"
Jul 20 12:48:42.286473 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:42.286430    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfxpn\" (UniqueName: \"kubernetes.io/projected/bc849106-d49b-4684-84e0-b2f19620bf85-kube-api-access-pfxpn\") pod \"cert-manager-operator-controller-manager-55c444bf86-sl8x8\" (UID: \"bc849106-d49b-4684-84e0-b2f19620bf85\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sl8x8"
Jul 20 12:48:42.311316 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:42.311278    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sl8x8"
Jul 20 12:48:42.473824 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:42.473792    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sl8x8"]
Jul 20 12:48:42.477945 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:48:42.477912    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc849106_d49b_4684_84e0_b2f19620bf85.slice/crio-513b53f4004f51dcfca08f2a964c0bd2f3f6f396a942704d407563ca0ff7fcca WatchSource:0}: Error finding container 513b53f4004f51dcfca08f2a964c0bd2f3f6f396a942704d407563ca0ff7fcca: Status 404 returned error can't find the container with id 513b53f4004f51dcfca08f2a964c0bd2f3f6f396a942704d407563ca0ff7fcca
Jul 20 12:48:43.021167 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:43.021118    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sl8x8" event={"ID":"bc849106-d49b-4684-84e0-b2f19620bf85","Type":"ContainerStarted","Data":"513b53f4004f51dcfca08f2a964c0bd2f3f6f396a942704d407563ca0ff7fcca"}
Jul 20 12:48:45.032629 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:45.032532    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sl8x8" event={"ID":"bc849106-d49b-4684-84e0-b2f19620bf85","Type":"ContainerStarted","Data":"b72891fb8d0a98ff4cc7c3c12069abd0786d291cdeb8da83a26abff8b7929419"}
Jul 20 12:48:45.076915 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:45.076855    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sl8x8" podStartSLOduration=1.8792022940000002 podStartE2EDuration="4.076838834s" totalImagesPullingTime="2.19763654s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:48:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:48:45.075589065 +0000 UTC m=+237.830638439" watchObservedRunningTime="2026-07-20 12:48:45.076838834 +0000 UTC m=+237.831888209"
Jul 20 12:48:46.312518 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:46.312477    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzbbj8"]
Jul 20 12:48:46.328881 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:46.328851    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzbbj8"]
Jul 20 12:48:46.329032 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:46.328955    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzbbj8"
Jul 20 12:48:46.332329 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:46.332297    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vf8f2\""
Jul 20 12:48:46.332490 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:46.332463    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 20 12:48:46.334325 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:46.334304    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 20 12:48:46.517189 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:46.517148    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5b25f3b8-ec9e-4041-838e-bcb380a4c82b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzbbj8\" (UID: \"5b25f3b8-ec9e-4041-838e-bcb380a4c82b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzbbj8"
Jul 20 12:48:46.517373 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:46.517231    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdxb6\" (UniqueName: \"kubernetes.io/projected/5b25f3b8-ec9e-4041-838e-bcb380a4c82b-kube-api-access-qdxb6\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzbbj8\" (UID: \"5b25f3b8-ec9e-4041-838e-bcb380a4c82b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzbbj8"
Jul 20 12:48:46.517373 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:46.517261    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5b25f3b8-ec9e-4041-838e-bcb380a4c82b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzbbj8\" (UID: \"5b25f3b8-ec9e-4041-838e-bcb380a4c82b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzbbj8"
Jul 20 12:48:46.618482 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:46.618436    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdxb6\" (UniqueName: \"kubernetes.io/projected/5b25f3b8-ec9e-4041-838e-bcb380a4c82b-kube-api-access-qdxb6\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzbbj8\" (UID: \"5b25f3b8-ec9e-4041-838e-bcb380a4c82b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzbbj8"
Jul 20 12:48:46.618671 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:46.618548    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5b25f3b8-ec9e-4041-838e-bcb380a4c82b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzbbj8\" (UID: \"5b25f3b8-ec9e-4041-838e-bcb380a4c82b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzbbj8"
Jul 20 12:48:46.618671 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:46.618603    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5b25f3b8-ec9e-4041-838e-bcb380a4c82b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzbbj8\" (UID: \"5b25f3b8-ec9e-4041-838e-bcb380a4c82b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzbbj8"
Jul 20 12:48:46.618937 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:46.618919    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5b25f3b8-ec9e-4041-838e-bcb380a4c82b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzbbj8\" (UID: \"5b25f3b8-ec9e-4041-838e-bcb380a4c82b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzbbj8"
Jul 20 12:48:46.618978 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:46.618951    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5b25f3b8-ec9e-4041-838e-bcb380a4c82b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzbbj8\" (UID: \"5b25f3b8-ec9e-4041-838e-bcb380a4c82b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzbbj8"
Jul 20 12:48:46.628938 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:46.628905    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdxb6\" (UniqueName: \"kubernetes.io/projected/5b25f3b8-ec9e-4041-838e-bcb380a4c82b-kube-api-access-qdxb6\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzbbj8\" (UID: \"5b25f3b8-ec9e-4041-838e-bcb380a4c82b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzbbj8"
Jul 20 12:48:46.639270 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:46.639244    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzbbj8"
Jul 20 12:48:46.792314 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:46.792233    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzbbj8"]
Jul 20 12:48:46.794494 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:48:46.794465    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b25f3b8_ec9e_4041_838e_bcb380a4c82b.slice/crio-49e3e5110f05f833b46345a676772f1ba0de13fe461e897d8d022937e3b65652 WatchSource:0}: Error finding container 49e3e5110f05f833b46345a676772f1ba0de13fe461e897d8d022937e3b65652: Status 404 returned error can't find the container with id 49e3e5110f05f833b46345a676772f1ba0de13fe461e897d8d022937e3b65652
Jul 20 12:48:47.045902 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:47.045864    2570 generic.go:356] "Generic (PLEG): container finished" podID="5b25f3b8-ec9e-4041-838e-bcb380a4c82b" containerID="6c60c058bd7e09c435e769936b66542ebccaf687fbd8678f94f88683024cd239" exitCode=0
Jul 20 12:48:47.046109 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:47.045955    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzbbj8" event={"ID":"5b25f3b8-ec9e-4041-838e-bcb380a4c82b","Type":"ContainerDied","Data":"6c60c058bd7e09c435e769936b66542ebccaf687fbd8678f94f88683024cd239"}
Jul 20 12:48:47.046109 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:47.045992    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzbbj8" event={"ID":"5b25f3b8-ec9e-4041-838e-bcb380a4c82b","Type":"ContainerStarted","Data":"49e3e5110f05f833b46345a676772f1ba0de13fe461e897d8d022937e3b65652"}
Jul 20 12:48:49.140982 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:49.140945    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-hcfbh"]
Jul 20 12:48:49.143339 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:49.143322    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hcfbh"
Jul 20 12:48:49.146422 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:49.146393    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 20 12:48:49.147970 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:49.147947    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 20 12:48:49.148067 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:49.147948    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-9bmpk\""
Jul 20 12:48:49.153215 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:49.153192    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-hcfbh"]
Jul 20 12:48:49.240799 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:49.240715    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b81f75a8-3611-44c2-a40b-c094032b19c4-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-hcfbh\" (UID: \"b81f75a8-3611-44c2-a40b-c094032b19c4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hcfbh"
Jul 20 12:48:49.240799 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:49.240773    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zq9z\" (UniqueName: \"kubernetes.io/projected/b81f75a8-3611-44c2-a40b-c094032b19c4-kube-api-access-5zq9z\") pod \"cert-manager-cainjector-559cdd8c87-hcfbh\" (UID: \"b81f75a8-3611-44c2-a40b-c094032b19c4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hcfbh"
Jul 20 12:48:49.341461 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:49.341420    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zq9z\" (UniqueName: \"kubernetes.io/projected/b81f75a8-3611-44c2-a40b-c094032b19c4-kube-api-access-5zq9z\") pod \"cert-manager-cainjector-559cdd8c87-hcfbh\" (UID: \"b81f75a8-3611-44c2-a40b-c094032b19c4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hcfbh"
Jul 20 12:48:49.341639 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:49.341585    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b81f75a8-3611-44c2-a40b-c094032b19c4-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-hcfbh\" (UID: \"b81f75a8-3611-44c2-a40b-c094032b19c4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hcfbh"
Jul 20 12:48:49.350835 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:49.350801    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b81f75a8-3611-44c2-a40b-c094032b19c4-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-hcfbh\" (UID: \"b81f75a8-3611-44c2-a40b-c094032b19c4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hcfbh"
Jul 20 12:48:49.350970 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:49.350906    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zq9z\" (UniqueName: \"kubernetes.io/projected/b81f75a8-3611-44c2-a40b-c094032b19c4-kube-api-access-5zq9z\") pod \"cert-manager-cainjector-559cdd8c87-hcfbh\" (UID: \"b81f75a8-3611-44c2-a40b-c094032b19c4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hcfbh"
Jul 20 12:48:49.487718 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:49.487677    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hcfbh"
Jul 20 12:48:49.618934 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:49.618894    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-hcfbh"]
Jul 20 12:48:49.621809 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:48:49.621780    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb81f75a8_3611_44c2_a40b_c094032b19c4.slice/crio-5ba74b82730697c2f51ede7b8f483561f6681a79932295e3b4a1a2094063df5e WatchSource:0}: Error finding container 5ba74b82730697c2f51ede7b8f483561f6681a79932295e3b4a1a2094063df5e: Status 404 returned error can't find the container with id 5ba74b82730697c2f51ede7b8f483561f6681a79932295e3b4a1a2094063df5e
Jul 20 12:48:50.061575 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:50.061534    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hcfbh" event={"ID":"b81f75a8-3611-44c2-a40b-c094032b19c4","Type":"ContainerStarted","Data":"5ba74b82730697c2f51ede7b8f483561f6681a79932295e3b4a1a2094063df5e"}
Jul 20 12:48:50.063300 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:50.063274    2570 generic.go:356] "Generic (PLEG): container finished" podID="5b25f3b8-ec9e-4041-838e-bcb380a4c82b" containerID="62e06ae816a91e030a553b9165fe6a201829d74ceaa715b680c077a4d5109998" exitCode=0
Jul 20 12:48:50.063423 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:50.063333    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzbbj8" event={"ID":"5b25f3b8-ec9e-4041-838e-bcb380a4c82b","Type":"ContainerDied","Data":"62e06ae816a91e030a553b9165fe6a201829d74ceaa715b680c077a4d5109998"}
Jul 20 12:48:51.071101 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:51.071038    2570 generic.go:356] "Generic (PLEG): container finished" podID="5b25f3b8-ec9e-4041-838e-bcb380a4c82b" containerID="00aa0a1a95aa1cf7de4ad657e1b26df11b4f12658037b426247c883c13a0a61d" exitCode=0
Jul 20 12:48:51.071576 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:51.071128    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzbbj8" event={"ID":"5b25f3b8-ec9e-4041-838e-bcb380a4c82b","Type":"ContainerDied","Data":"00aa0a1a95aa1cf7de4ad657e1b26df11b4f12658037b426247c883c13a0a61d"}
Jul 20 12:48:52.230184 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:52.230147    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzbbj8"
Jul 20 12:48:52.367218 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:52.367173    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5b25f3b8-ec9e-4041-838e-bcb380a4c82b-bundle\") pod \"5b25f3b8-ec9e-4041-838e-bcb380a4c82b\" (UID: \"5b25f3b8-ec9e-4041-838e-bcb380a4c82b\") "
Jul 20 12:48:52.367400 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:52.367305    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5b25f3b8-ec9e-4041-838e-bcb380a4c82b-util\") pod \"5b25f3b8-ec9e-4041-838e-bcb380a4c82b\" (UID: \"5b25f3b8-ec9e-4041-838e-bcb380a4c82b\") "
Jul 20 12:48:52.367400 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:52.367339    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qdxb6\" (UniqueName: \"kubernetes.io/projected/5b25f3b8-ec9e-4041-838e-bcb380a4c82b-kube-api-access-qdxb6\") pod \"5b25f3b8-ec9e-4041-838e-bcb380a4c82b\" (UID: \"5b25f3b8-ec9e-4041-838e-bcb380a4c82b\") "
Jul 20 12:48:52.367631 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:52.367605    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b25f3b8-ec9e-4041-838e-bcb380a4c82b-bundle" (OuterVolumeSpecName: "bundle") pod "5b25f3b8-ec9e-4041-838e-bcb380a4c82b" (UID: "5b25f3b8-ec9e-4041-838e-bcb380a4c82b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 12:48:52.369426 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:52.369397    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b25f3b8-ec9e-4041-838e-bcb380a4c82b-kube-api-access-qdxb6" (OuterVolumeSpecName: "kube-api-access-qdxb6") pod "5b25f3b8-ec9e-4041-838e-bcb380a4c82b" (UID: "5b25f3b8-ec9e-4041-838e-bcb380a4c82b"). InnerVolumeSpecName "kube-api-access-qdxb6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 12:48:52.371968 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:52.371948    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b25f3b8-ec9e-4041-838e-bcb380a4c82b-util" (OuterVolumeSpecName: "util") pod "5b25f3b8-ec9e-4041-838e-bcb380a4c82b" (UID: "5b25f3b8-ec9e-4041-838e-bcb380a4c82b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 12:48:52.468993 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:52.468951    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5b25f3b8-ec9e-4041-838e-bcb380a4c82b-util\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:48:52.468993 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:52.468988    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qdxb6\" (UniqueName: \"kubernetes.io/projected/5b25f3b8-ec9e-4041-838e-bcb380a4c82b-kube-api-access-qdxb6\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:48:52.468993 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:52.468998    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5b25f3b8-ec9e-4041-838e-bcb380a4c82b-bundle\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:48:53.082028 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:53.081987    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hcfbh" event={"ID":"b81f75a8-3611-44c2-a40b-c094032b19c4","Type":"ContainerStarted","Data":"221447ba2c8a50480ddefd79b11f1b9d2cec0312e8a92388ced6d0795e292a0b"}
Jul 20 12:48:53.083873 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:53.083849    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzbbj8" event={"ID":"5b25f3b8-ec9e-4041-838e-bcb380a4c82b","Type":"ContainerDied","Data":"49e3e5110f05f833b46345a676772f1ba0de13fe461e897d8d022937e3b65652"}
Jul 20 12:48:53.083998 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:53.083873    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzbbj8"
Jul 20 12:48:53.083998 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:53.083888    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="49e3e5110f05f833b46345a676772f1ba0de13fe461e897d8d022937e3b65652"
Jul 20 12:48:53.101021 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:53.100972    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hcfbh" podStartSLOduration=1.699062519 podStartE2EDuration="4.100955856s" totalImagesPullingTime="2.401893337s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:48:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:48:53.099939471 +0000 UTC m=+245.854988848" watchObservedRunningTime="2026-07-20 12:48:53.100955856 +0000 UTC m=+245.856005230"
Jul 20 12:48:53.549471 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:53.549392    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-lzvv6"]
Jul 20 12:48:53.549828 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:53.549718    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b25f3b8-ec9e-4041-838e-bcb380a4c82b" containerName="util"
Jul 20 12:48:53.549828 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:53.549729    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b25f3b8-ec9e-4041-838e-bcb380a4c82b" containerName="util"
Jul 20 12:48:53.549828 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:53.549738    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b25f3b8-ec9e-4041-838e-bcb380a4c82b" containerName="pull"
Jul 20 12:48:53.549828 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:53.549743    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b25f3b8-ec9e-4041-838e-bcb380a4c82b" containerName="pull"
Jul 20 12:48:53.549828 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:53.549757    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b25f3b8-ec9e-4041-838e-bcb380a4c82b" containerName="extract"
Jul 20 12:48:53.549828 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:53.549762    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b25f3b8-ec9e-4041-838e-bcb380a4c82b" containerName="extract"
Jul 20 12:48:53.550006 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:53.549839    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b25f3b8-ec9e-4041-838e-bcb380a4c82b" containerName="extract"
Jul 20 12:48:53.553635 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:53.553617    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-lzvv6"
Jul 20 12:48:53.556590 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:53.556570    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-k7fcs\""
Jul 20 12:48:53.561063 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:53.561017    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-lzvv6"]
Jul 20 12:48:53.578395 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:53.578360    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/34bbb3a9-7e44-4b5b-b854-84b989939912-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-lzvv6\" (UID: \"34bbb3a9-7e44-4b5b-b854-84b989939912\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lzvv6"
Jul 20 12:48:53.578567 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:53.578461    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57j7r\" (UniqueName: \"kubernetes.io/projected/34bbb3a9-7e44-4b5b-b854-84b989939912-kube-api-access-57j7r\") pod \"cert-manager-webhook-6486ffd997-lzvv6\" (UID: \"34bbb3a9-7e44-4b5b-b854-84b989939912\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lzvv6"
Jul 20 12:48:53.679302 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:53.679263    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57j7r\" (UniqueName: \"kubernetes.io/projected/34bbb3a9-7e44-4b5b-b854-84b989939912-kube-api-access-57j7r\") pod \"cert-manager-webhook-6486ffd997-lzvv6\" (UID: \"34bbb3a9-7e44-4b5b-b854-84b989939912\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lzvv6"
Jul 20 12:48:53.679477 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:53.679324    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/34bbb3a9-7e44-4b5b-b854-84b989939912-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-lzvv6\" (UID: \"34bbb3a9-7e44-4b5b-b854-84b989939912\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lzvv6"
Jul 20 12:48:53.688096 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:53.688059    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/34bbb3a9-7e44-4b5b-b854-84b989939912-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-lzvv6\" (UID: \"34bbb3a9-7e44-4b5b-b854-84b989939912\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lzvv6"
Jul 20 12:48:53.688225 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:53.688209    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-57j7r\" (UniqueName: \"kubernetes.io/projected/34bbb3a9-7e44-4b5b-b854-84b989939912-kube-api-access-57j7r\") pod \"cert-manager-webhook-6486ffd997-lzvv6\" (UID: \"34bbb3a9-7e44-4b5b-b854-84b989939912\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lzvv6"
Jul 20 12:48:53.863255 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:53.863215    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-lzvv6"
Jul 20 12:48:53.999332 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:53.999298    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-lzvv6"]
Jul 20 12:48:54.003481 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:48:54.003454    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod34bbb3a9_7e44_4b5b_b854_84b989939912.slice/crio-543999e33907f3f54884eccd6b4b911b61a613d78a63d565920ac3af0c333d25 WatchSource:0}: Error finding container 543999e33907f3f54884eccd6b4b911b61a613d78a63d565920ac3af0c333d25: Status 404 returned error can't find the container with id 543999e33907f3f54884eccd6b4b911b61a613d78a63d565920ac3af0c333d25
Jul 20 12:48:54.090570 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:54.090523    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-lzvv6" event={"ID":"34bbb3a9-7e44-4b5b-b854-84b989939912","Type":"ContainerStarted","Data":"69edb0332a73b53028ef63feb79cbfde7edb23f248800d2c3b12874e4b626182"}
Jul 20 12:48:54.090766 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:54.090583    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-lzvv6" event={"ID":"34bbb3a9-7e44-4b5b-b854-84b989939912","Type":"ContainerStarted","Data":"543999e33907f3f54884eccd6b4b911b61a613d78a63d565920ac3af0c333d25"}
Jul 20 12:48:54.090870 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:54.090834    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-lzvv6"
Jul 20 12:48:54.108630 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:54.108578    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-lzvv6" podStartSLOduration=1.108561825 podStartE2EDuration="1.108561825s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:48:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:48:54.107566456 +0000 UTC m=+246.862615828" watchObservedRunningTime="2026-07-20 12:48:54.108561825 +0000 UTC m=+246.863611199"
Jul 20 12:48:56.036198 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:56.036158    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-kp5sl"]
Jul 20 12:48:56.039540 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:56.039518    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-kp5sl"
Jul 20 12:48:56.042828 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:56.042806    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-92s5k\""
Jul 20 12:48:56.049563 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:56.049539    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-kp5sl"]
Jul 20 12:48:56.095352 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:56.095316    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d087eb3-820e-47f8-ae93-c01e415da1a2-bound-sa-token\") pod \"cert-manager-55b4d954d5-kp5sl\" (UID: \"0d087eb3-820e-47f8-ae93-c01e415da1a2\") " pod="cert-manager/cert-manager-55b4d954d5-kp5sl"
Jul 20 12:48:56.095515 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:56.095369    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6q4jp\" (UniqueName: \"kubernetes.io/projected/0d087eb3-820e-47f8-ae93-c01e415da1a2-kube-api-access-6q4jp\") pod \"cert-manager-55b4d954d5-kp5sl\" (UID: \"0d087eb3-820e-47f8-ae93-c01e415da1a2\") " pod="cert-manager/cert-manager-55b4d954d5-kp5sl"
Jul 20 12:48:56.196234 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:56.196199    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d087eb3-820e-47f8-ae93-c01e415da1a2-bound-sa-token\") pod \"cert-manager-55b4d954d5-kp5sl\" (UID: \"0d087eb3-820e-47f8-ae93-c01e415da1a2\") " pod="cert-manager/cert-manager-55b4d954d5-kp5sl"
Jul 20 12:48:56.196426 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:56.196286    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6q4jp\" (UniqueName: \"kubernetes.io/projected/0d087eb3-820e-47f8-ae93-c01e415da1a2-kube-api-access-6q4jp\") pod \"cert-manager-55b4d954d5-kp5sl\" (UID: \"0d087eb3-820e-47f8-ae93-c01e415da1a2\") " pod="cert-manager/cert-manager-55b4d954d5-kp5sl"
Jul 20 12:48:56.206966 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:56.206937    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d087eb3-820e-47f8-ae93-c01e415da1a2-bound-sa-token\") pod \"cert-manager-55b4d954d5-kp5sl\" (UID: \"0d087eb3-820e-47f8-ae93-c01e415da1a2\") " pod="cert-manager/cert-manager-55b4d954d5-kp5sl"
Jul 20 12:48:56.207164 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:56.207140    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6q4jp\" (UniqueName: \"kubernetes.io/projected/0d087eb3-820e-47f8-ae93-c01e415da1a2-kube-api-access-6q4jp\") pod \"cert-manager-55b4d954d5-kp5sl\" (UID: \"0d087eb3-820e-47f8-ae93-c01e415da1a2\") " pod="cert-manager/cert-manager-55b4d954d5-kp5sl"
Jul 20 12:48:56.349562 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:56.349524    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-kp5sl"
Jul 20 12:48:56.482929 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:56.482903    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-kp5sl"]
Jul 20 12:48:56.484374 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:48:56.484344    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d087eb3_820e_47f8_ae93_c01e415da1a2.slice/crio-b21ae2228d531fef435bacba7814ec2461d923d1d92f383d60ffd2bf1b721dbc WatchSource:0}: Error finding container b21ae2228d531fef435bacba7814ec2461d923d1d92f383d60ffd2bf1b721dbc: Status 404 returned error can't find the container with id b21ae2228d531fef435bacba7814ec2461d923d1d92f383d60ffd2bf1b721dbc
Jul 20 12:48:57.105573 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:57.105533    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-kp5sl" event={"ID":"0d087eb3-820e-47f8-ae93-c01e415da1a2","Type":"ContainerStarted","Data":"954c515cf190b0882c5fb9b52ebd5e767c637fb40a542c16d30414a38df6e603"}
Jul 20 12:48:57.105967 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:57.105581    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-kp5sl" event={"ID":"0d087eb3-820e-47f8-ae93-c01e415da1a2","Type":"ContainerStarted","Data":"b21ae2228d531fef435bacba7814ec2461d923d1d92f383d60ffd2bf1b721dbc"}
Jul 20 12:48:57.124311 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:48:57.124254    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-kp5sl" podStartSLOduration=1.124238055 podStartE2EDuration="1.124238055s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:48:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:48:57.122887884 +0000 UTC m=+249.877937259" watchObservedRunningTime="2026-07-20 12:48:57.124238055 +0000 UTC m=+249.879287430"
Jul 20 12:49:00.097443 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:00.097408    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-lzvv6"
Jul 20 12:49:06.344305 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:06.344270    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7k44f"]
Jul 20 12:49:06.348028 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:06.348010    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7k44f"
Jul 20 12:49:06.351397 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:06.351370    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 20 12:49:06.351565 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:06.351395    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 20 12:49:06.352949 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:06.352925    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vf8f2\""
Jul 20 12:49:06.356608 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:06.356583    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7k44f"]
Jul 20 12:49:06.386811 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:06.386772    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8570740d-24f7-486c-9c15-69b726a8f673-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7k44f\" (UID: \"8570740d-24f7-486c-9c15-69b726a8f673\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7k44f"
Jul 20 12:49:06.387011 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:06.386836    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8570740d-24f7-486c-9c15-69b726a8f673-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7k44f\" (UID: \"8570740d-24f7-486c-9c15-69b726a8f673\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7k44f"
Jul 20 12:49:06.387011 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:06.386950    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xp5tv\" (UniqueName: \"kubernetes.io/projected/8570740d-24f7-486c-9c15-69b726a8f673-kube-api-access-xp5tv\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7k44f\" (UID: \"8570740d-24f7-486c-9c15-69b726a8f673\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7k44f"
Jul 20 12:49:06.487711 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:06.487647    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8570740d-24f7-486c-9c15-69b726a8f673-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7k44f\" (UID: \"8570740d-24f7-486c-9c15-69b726a8f673\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7k44f"
Jul 20 12:49:06.487921 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:06.487756    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xp5tv\" (UniqueName: \"kubernetes.io/projected/8570740d-24f7-486c-9c15-69b726a8f673-kube-api-access-xp5tv\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7k44f\" (UID: \"8570740d-24f7-486c-9c15-69b726a8f673\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7k44f"
Jul 20 12:49:06.487921 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:06.487811    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8570740d-24f7-486c-9c15-69b726a8f673-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7k44f\" (UID: \"8570740d-24f7-486c-9c15-69b726a8f673\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7k44f"
Jul 20 12:49:06.488069 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:06.488046    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8570740d-24f7-486c-9c15-69b726a8f673-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7k44f\" (UID: \"8570740d-24f7-486c-9c15-69b726a8f673\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7k44f"
Jul 20 12:49:06.488201 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:06.488183    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8570740d-24f7-486c-9c15-69b726a8f673-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7k44f\" (UID: \"8570740d-24f7-486c-9c15-69b726a8f673\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7k44f"
Jul 20 12:49:06.497947 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:06.497920    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xp5tv\" (UniqueName: \"kubernetes.io/projected/8570740d-24f7-486c-9c15-69b726a8f673-kube-api-access-xp5tv\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7k44f\" (UID: \"8570740d-24f7-486c-9c15-69b726a8f673\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7k44f"
Jul 20 12:49:06.659051 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:06.658963    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7k44f"
Jul 20 12:49:06.791448 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:06.791419    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7k44f"]
Jul 20 12:49:06.793280 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:49:06.793252    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8570740d_24f7_486c_9c15_69b726a8f673.slice/crio-5f19aba5dd46d3d3effd9b845d8f729d31e484eab66ddb99e0ca7e2923367877 WatchSource:0}: Error finding container 5f19aba5dd46d3d3effd9b845d8f729d31e484eab66ddb99e0ca7e2923367877: Status 404 returned error can't find the container with id 5f19aba5dd46d3d3effd9b845d8f729d31e484eab66ddb99e0ca7e2923367877
Jul 20 12:49:07.156751 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:07.156713    2570 generic.go:356] "Generic (PLEG): container finished" podID="8570740d-24f7-486c-9c15-69b726a8f673" containerID="37ac1f906986a6470d77542975505da1cc24a1feb35208feb6f6ae0765520217" exitCode=0
Jul 20 12:49:07.156937 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:07.156794    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7k44f" event={"ID":"8570740d-24f7-486c-9c15-69b726a8f673","Type":"ContainerDied","Data":"37ac1f906986a6470d77542975505da1cc24a1feb35208feb6f6ae0765520217"}
Jul 20 12:49:07.156937 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:07.156853    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7k44f" event={"ID":"8570740d-24f7-486c-9c15-69b726a8f673","Type":"ContainerStarted","Data":"5f19aba5dd46d3d3effd9b845d8f729d31e484eab66ddb99e0ca7e2923367877"}
Jul 20 12:49:09.167513 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:09.167472    2570 generic.go:356] "Generic (PLEG): container finished" podID="8570740d-24f7-486c-9c15-69b726a8f673" containerID="a5dd1996836e9ab2fcaf04655181e35e426c20ee514d4181cfed74d7e2c74a43" exitCode=0
Jul 20 12:49:09.167885 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:09.167562    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7k44f" event={"ID":"8570740d-24f7-486c-9c15-69b726a8f673","Type":"ContainerDied","Data":"a5dd1996836e9ab2fcaf04655181e35e426c20ee514d4181cfed74d7e2c74a43"}
Jul 20 12:49:10.173739 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:10.173703    2570 generic.go:356] "Generic (PLEG): container finished" podID="8570740d-24f7-486c-9c15-69b726a8f673" containerID="e3f384c29b0accb81216bba5a2c54d5fa70fbed4e0d6490913bdc5b0a1e73f20" exitCode=0
Jul 20 12:49:10.174154 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:10.173781    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7k44f" event={"ID":"8570740d-24f7-486c-9c15-69b726a8f673","Type":"ContainerDied","Data":"e3f384c29b0accb81216bba5a2c54d5fa70fbed4e0d6490913bdc5b0a1e73f20"}
Jul 20 12:49:11.307419 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:11.307395    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7k44f"
Jul 20 12:49:11.328825 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:11.328796    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8570740d-24f7-486c-9c15-69b726a8f673-util\") pod \"8570740d-24f7-486c-9c15-69b726a8f673\" (UID: \"8570740d-24f7-486c-9c15-69b726a8f673\") "
Jul 20 12:49:11.329002 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:11.328853    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xp5tv\" (UniqueName: \"kubernetes.io/projected/8570740d-24f7-486c-9c15-69b726a8f673-kube-api-access-xp5tv\") pod \"8570740d-24f7-486c-9c15-69b726a8f673\" (UID: \"8570740d-24f7-486c-9c15-69b726a8f673\") "
Jul 20 12:49:11.329002 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:11.328932    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8570740d-24f7-486c-9c15-69b726a8f673-bundle\") pod \"8570740d-24f7-486c-9c15-69b726a8f673\" (UID: \"8570740d-24f7-486c-9c15-69b726a8f673\") "
Jul 20 12:49:11.329931 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:11.329882    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8570740d-24f7-486c-9c15-69b726a8f673-bundle" (OuterVolumeSpecName: "bundle") pod "8570740d-24f7-486c-9c15-69b726a8f673" (UID: "8570740d-24f7-486c-9c15-69b726a8f673"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 12:49:11.331139 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:11.331105    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8570740d-24f7-486c-9c15-69b726a8f673-kube-api-access-xp5tv" (OuterVolumeSpecName: "kube-api-access-xp5tv") pod "8570740d-24f7-486c-9c15-69b726a8f673" (UID: "8570740d-24f7-486c-9c15-69b726a8f673"). InnerVolumeSpecName "kube-api-access-xp5tv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 12:49:11.334751 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:11.334729    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8570740d-24f7-486c-9c15-69b726a8f673-util" (OuterVolumeSpecName: "util") pod "8570740d-24f7-486c-9c15-69b726a8f673" (UID: "8570740d-24f7-486c-9c15-69b726a8f673"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 12:49:11.430252 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:11.430161    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8570740d-24f7-486c-9c15-69b726a8f673-bundle\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:49:11.430252 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:11.430191    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8570740d-24f7-486c-9c15-69b726a8f673-util\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:49:11.430252 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:11.430203    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xp5tv\" (UniqueName: \"kubernetes.io/projected/8570740d-24f7-486c-9c15-69b726a8f673-kube-api-access-xp5tv\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:49:12.184558 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:12.184517    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7k44f" event={"ID":"8570740d-24f7-486c-9c15-69b726a8f673","Type":"ContainerDied","Data":"5f19aba5dd46d3d3effd9b845d8f729d31e484eab66ddb99e0ca7e2923367877"}
Jul 20 12:49:12.184558 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:12.184549    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7k44f"
Jul 20 12:49:12.184768 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:12.184571    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5f19aba5dd46d3d3effd9b845d8f729d31e484eab66ddb99e0ca7e2923367877"
Jul 20 12:49:21.789658 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:21.789618    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-586f8df4c4-jd467"]
Jul 20 12:49:21.790080 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:21.789987    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8570740d-24f7-486c-9c15-69b726a8f673" containerName="pull"
Jul 20 12:49:21.790080 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:21.789998    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="8570740d-24f7-486c-9c15-69b726a8f673" containerName="pull"
Jul 20 12:49:21.790080 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:21.790009    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8570740d-24f7-486c-9c15-69b726a8f673" containerName="extract"
Jul 20 12:49:21.790080 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:21.790015    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="8570740d-24f7-486c-9c15-69b726a8f673" containerName="extract"
Jul 20 12:49:21.790080 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:21.790028    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8570740d-24f7-486c-9c15-69b726a8f673" containerName="util"
Jul 20 12:49:21.790080 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:21.790034    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="8570740d-24f7-486c-9c15-69b726a8f673" containerName="util"
Jul 20 12:49:21.790328 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:21.790110    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="8570740d-24f7-486c-9c15-69b726a8f673" containerName="extract"
Jul 20 12:49:21.796389 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:21.796371    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-586f8df4c4-jd467"
Jul 20 12:49:21.801274 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:21.801253    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 20 12:49:21.802519 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:21.802496    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 20 12:49:21.802638 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:21.802508    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 20 12:49:21.803349 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:21.803320    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 20 12:49:21.803476 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:21.803370    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-k7fgz\""
Jul 20 12:49:21.803590 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:21.803394    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 20 12:49:21.821999 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:21.821967    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-586f8df4c4-jd467"]
Jul 20 12:49:21.927071 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:21.927029    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/80c0c028-76ed-4205-9ed2-461e38af3501-metrics-cert\") pod \"lws-controller-manager-586f8df4c4-jd467\" (UID: \"80c0c028-76ed-4205-9ed2-461e38af3501\") " pod="openshift-lws-operator/lws-controller-manager-586f8df4c4-jd467"
Jul 20 12:49:21.927261 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:21.927126    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/80c0c028-76ed-4205-9ed2-461e38af3501-manager-config\") pod \"lws-controller-manager-586f8df4c4-jd467\" (UID: \"80c0c028-76ed-4205-9ed2-461e38af3501\") " pod="openshift-lws-operator/lws-controller-manager-586f8df4c4-jd467"
Jul 20 12:49:21.927261 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:21.927167    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/80c0c028-76ed-4205-9ed2-461e38af3501-cert\") pod \"lws-controller-manager-586f8df4c4-jd467\" (UID: \"80c0c028-76ed-4205-9ed2-461e38af3501\") " pod="openshift-lws-operator/lws-controller-manager-586f8df4c4-jd467"
Jul 20 12:49:21.927353 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:21.927266    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gg2k\" (UniqueName: \"kubernetes.io/projected/80c0c028-76ed-4205-9ed2-461e38af3501-kube-api-access-9gg2k\") pod \"lws-controller-manager-586f8df4c4-jd467\" (UID: \"80c0c028-76ed-4205-9ed2-461e38af3501\") " pod="openshift-lws-operator/lws-controller-manager-586f8df4c4-jd467"
Jul 20 12:49:22.028267 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:22.028212    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/80c0c028-76ed-4205-9ed2-461e38af3501-cert\") pod \"lws-controller-manager-586f8df4c4-jd467\" (UID: \"80c0c028-76ed-4205-9ed2-461e38af3501\") " pod="openshift-lws-operator/lws-controller-manager-586f8df4c4-jd467"
Jul 20 12:49:22.028483 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:22.028283    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gg2k\" (UniqueName: \"kubernetes.io/projected/80c0c028-76ed-4205-9ed2-461e38af3501-kube-api-access-9gg2k\") pod \"lws-controller-manager-586f8df4c4-jd467\" (UID: \"80c0c028-76ed-4205-9ed2-461e38af3501\") " pod="openshift-lws-operator/lws-controller-manager-586f8df4c4-jd467"
Jul 20 12:49:22.028483 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:22.028314    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/80c0c028-76ed-4205-9ed2-461e38af3501-metrics-cert\") pod \"lws-controller-manager-586f8df4c4-jd467\" (UID: \"80c0c028-76ed-4205-9ed2-461e38af3501\") " pod="openshift-lws-operator/lws-controller-manager-586f8df4c4-jd467"
Jul 20 12:49:22.028483 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:22.028355    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/80c0c028-76ed-4205-9ed2-461e38af3501-manager-config\") pod \"lws-controller-manager-586f8df4c4-jd467\" (UID: \"80c0c028-76ed-4205-9ed2-461e38af3501\") " pod="openshift-lws-operator/lws-controller-manager-586f8df4c4-jd467"
Jul 20 12:49:22.028957 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:22.028937    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/80c0c028-76ed-4205-9ed2-461e38af3501-manager-config\") pod \"lws-controller-manager-586f8df4c4-jd467\" (UID: \"80c0c028-76ed-4205-9ed2-461e38af3501\") " pod="openshift-lws-operator/lws-controller-manager-586f8df4c4-jd467"
Jul 20 12:49:22.030734 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:22.030712    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/80c0c028-76ed-4205-9ed2-461e38af3501-metrics-cert\") pod \"lws-controller-manager-586f8df4c4-jd467\" (UID: \"80c0c028-76ed-4205-9ed2-461e38af3501\") " pod="openshift-lws-operator/lws-controller-manager-586f8df4c4-jd467"
Jul 20 12:49:22.030829 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:22.030756    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/80c0c028-76ed-4205-9ed2-461e38af3501-cert\") pod \"lws-controller-manager-586f8df4c4-jd467\" (UID: \"80c0c028-76ed-4205-9ed2-461e38af3501\") " pod="openshift-lws-operator/lws-controller-manager-586f8df4c4-jd467"
Jul 20 12:49:22.041852 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:22.041783    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gg2k\" (UniqueName: \"kubernetes.io/projected/80c0c028-76ed-4205-9ed2-461e38af3501-kube-api-access-9gg2k\") pod \"lws-controller-manager-586f8df4c4-jd467\" (UID: \"80c0c028-76ed-4205-9ed2-461e38af3501\") " pod="openshift-lws-operator/lws-controller-manager-586f8df4c4-jd467"
Jul 20 12:49:22.106556 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:22.106517    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-586f8df4c4-jd467"
Jul 20 12:49:22.254018 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:22.249978    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-586f8df4c4-jd467"]
Jul 20 12:49:22.257420 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:49:22.257376    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80c0c028_76ed_4205_9ed2_461e38af3501.slice/crio-6454cae9cb0c7de8e56a5b319d756986aa085acb186d6ccf9163733c058862c5 WatchSource:0}: Error finding container 6454cae9cb0c7de8e56a5b319d756986aa085acb186d6ccf9163733c058862c5: Status 404 returned error can't find the container with id 6454cae9cb0c7de8e56a5b319d756986aa085acb186d6ccf9163733c058862c5
Jul 20 12:49:23.239053 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:23.239015    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-586f8df4c4-jd467" event={"ID":"80c0c028-76ed-4205-9ed2-461e38af3501","Type":"ContainerStarted","Data":"6454cae9cb0c7de8e56a5b319d756986aa085acb186d6ccf9163733c058862c5"}
Jul 20 12:49:24.114439 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:24.114405    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-749978ccd7-6pbjc"]
Jul 20 12:49:24.118466 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:24.118442    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-749978ccd7-6pbjc"
Jul 20 12:49:24.121874 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:24.121852    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 20 12:49:24.122415 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:24.122395    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-5cnmf\""
Jul 20 12:49:24.123053 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:24.122746    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 20 12:49:24.123317 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:24.122814    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 20 12:49:24.123536 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:24.122890    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 20 12:49:24.136212 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:24.136184    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-749978ccd7-6pbjc"]
Jul 20 12:49:24.245205 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:24.245170    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-586f8df4c4-jd467" event={"ID":"80c0c028-76ed-4205-9ed2-461e38af3501","Type":"ContainerStarted","Data":"f40098e04545db263155399941447731bf423de48a2c0d5ed4acc61da0bc854a"}
Jul 20 12:49:24.245597 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:24.245292    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-586f8df4c4-jd467"
Jul 20 12:49:24.249937 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:24.249913    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8d136b15-3a4c-4cd5-a6e4-4eaade21228f-webhook-cert\") pod \"opendatahub-operator-controller-manager-749978ccd7-6pbjc\" (UID: \"8d136b15-3a4c-4cd5-a6e4-4eaade21228f\") " pod="opendatahub/opendatahub-operator-controller-manager-749978ccd7-6pbjc"
Jul 20 12:49:24.250070 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:24.249958    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xp47g\" (UniqueName: \"kubernetes.io/projected/8d136b15-3a4c-4cd5-a6e4-4eaade21228f-kube-api-access-xp47g\") pod \"opendatahub-operator-controller-manager-749978ccd7-6pbjc\" (UID: \"8d136b15-3a4c-4cd5-a6e4-4eaade21228f\") " pod="opendatahub/opendatahub-operator-controller-manager-749978ccd7-6pbjc"
Jul 20 12:49:24.250070 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:24.250019    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8d136b15-3a4c-4cd5-a6e4-4eaade21228f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-749978ccd7-6pbjc\" (UID: \"8d136b15-3a4c-4cd5-a6e4-4eaade21228f\") " pod="opendatahub/opendatahub-operator-controller-manager-749978ccd7-6pbjc"
Jul 20 12:49:24.250070 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:24.250054    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8d136b15-3a4c-4cd5-a6e4-4eaade21228f-tmp\") pod \"opendatahub-operator-controller-manager-749978ccd7-6pbjc\" (UID: \"8d136b15-3a4c-4cd5-a6e4-4eaade21228f\") " pod="opendatahub/opendatahub-operator-controller-manager-749978ccd7-6pbjc"
Jul 20 12:49:24.250196 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:24.250125    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8d136b15-3a4c-4cd5-a6e4-4eaade21228f-manifests\") pod \"opendatahub-operator-controller-manager-749978ccd7-6pbjc\" (UID: \"8d136b15-3a4c-4cd5-a6e4-4eaade21228f\") " pod="opendatahub/opendatahub-operator-controller-manager-749978ccd7-6pbjc"
Jul 20 12:49:24.266576 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:24.266512    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-586f8df4c4-jd467" podStartSLOduration=1.77444499 podStartE2EDuration="3.266480818s" totalImagesPullingTime="1.492035828s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:49:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:49:24.26451284 +0000 UTC m=+277.019562235" watchObservedRunningTime="2026-07-20 12:49:24.266480818 +0000 UTC m=+277.021530196"
Jul 20 12:49:24.351363 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:24.351323    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8d136b15-3a4c-4cd5-a6e4-4eaade21228f-manifests\") pod \"opendatahub-operator-controller-manager-749978ccd7-6pbjc\" (UID: \"8d136b15-3a4c-4cd5-a6e4-4eaade21228f\") " pod="opendatahub/opendatahub-operator-controller-manager-749978ccd7-6pbjc"
Jul 20 12:49:24.351573 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:24.351429    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8d136b15-3a4c-4cd5-a6e4-4eaade21228f-webhook-cert\") pod \"opendatahub-operator-controller-manager-749978ccd7-6pbjc\" (UID: \"8d136b15-3a4c-4cd5-a6e4-4eaade21228f\") " pod="opendatahub/opendatahub-operator-controller-manager-749978ccd7-6pbjc"
Jul 20 12:49:24.351573 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:24.351504    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xp47g\" (UniqueName: \"kubernetes.io/projected/8d136b15-3a4c-4cd5-a6e4-4eaade21228f-kube-api-access-xp47g\") pod \"opendatahub-operator-controller-manager-749978ccd7-6pbjc\" (UID: \"8d136b15-3a4c-4cd5-a6e4-4eaade21228f\") " pod="opendatahub/opendatahub-operator-controller-manager-749978ccd7-6pbjc"
Jul 20 12:49:24.351681 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:24.351577    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8d136b15-3a4c-4cd5-a6e4-4eaade21228f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-749978ccd7-6pbjc\" (UID: \"8d136b15-3a4c-4cd5-a6e4-4eaade21228f\") " pod="opendatahub/opendatahub-operator-controller-manager-749978ccd7-6pbjc"
Jul 20 12:49:24.351681 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:24.351642    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8d136b15-3a4c-4cd5-a6e4-4eaade21228f-tmp\") pod \"opendatahub-operator-controller-manager-749978ccd7-6pbjc\" (UID: \"8d136b15-3a4c-4cd5-a6e4-4eaade21228f\") " pod="opendatahub/opendatahub-operator-controller-manager-749978ccd7-6pbjc"
Jul 20 12:49:24.351784 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:24.351766    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8d136b15-3a4c-4cd5-a6e4-4eaade21228f-manifests\") pod \"opendatahub-operator-controller-manager-749978ccd7-6pbjc\" (UID: \"8d136b15-3a4c-4cd5-a6e4-4eaade21228f\") " pod="opendatahub/opendatahub-operator-controller-manager-749978ccd7-6pbjc"
Jul 20 12:49:24.354255 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:24.354229    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8d136b15-3a4c-4cd5-a6e4-4eaade21228f-tmp\") pod \"opendatahub-operator-controller-manager-749978ccd7-6pbjc\" (UID: \"8d136b15-3a4c-4cd5-a6e4-4eaade21228f\") " pod="opendatahub/opendatahub-operator-controller-manager-749978ccd7-6pbjc"
Jul 20 12:49:24.354255 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:24.354235    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8d136b15-3a4c-4cd5-a6e4-4eaade21228f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-749978ccd7-6pbjc\" (UID: \"8d136b15-3a4c-4cd5-a6e4-4eaade21228f\") " pod="opendatahub/opendatahub-operator-controller-manager-749978ccd7-6pbjc"
Jul 20 12:49:24.354452 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:24.354434    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8d136b15-3a4c-4cd5-a6e4-4eaade21228f-webhook-cert\") pod \"opendatahub-operator-controller-manager-749978ccd7-6pbjc\" (UID: \"8d136b15-3a4c-4cd5-a6e4-4eaade21228f\") " pod="opendatahub/opendatahub-operator-controller-manager-749978ccd7-6pbjc"
Jul 20 12:49:24.360561 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:24.360543    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xp47g\" (UniqueName: \"kubernetes.io/projected/8d136b15-3a4c-4cd5-a6e4-4eaade21228f-kube-api-access-xp47g\") pod \"opendatahub-operator-controller-manager-749978ccd7-6pbjc\" (UID: \"8d136b15-3a4c-4cd5-a6e4-4eaade21228f\") " pod="opendatahub/opendatahub-operator-controller-manager-749978ccd7-6pbjc"
Jul 20 12:49:24.434216 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:24.434132    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-749978ccd7-6pbjc"
Jul 20 12:49:24.583482 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:24.583456    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-749978ccd7-6pbjc"]
Jul 20 12:49:24.585004 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:49:24.584971    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d136b15_3a4c_4cd5_a6e4_4eaade21228f.slice/crio-7909ddae2cffa041ae9a37dec80d1ee89ed56561f4981501d3a4623dd87c776b WatchSource:0}: Error finding container 7909ddae2cffa041ae9a37dec80d1ee89ed56561f4981501d3a4623dd87c776b: Status 404 returned error can't find the container with id 7909ddae2cffa041ae9a37dec80d1ee89ed56561f4981501d3a4623dd87c776b
Jul 20 12:49:25.254137 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:25.254023    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-749978ccd7-6pbjc" event={"ID":"8d136b15-3a4c-4cd5-a6e4-4eaade21228f","Type":"ContainerStarted","Data":"7909ddae2cffa041ae9a37dec80d1ee89ed56561f4981501d3a4623dd87c776b"}
Jul 20 12:49:28.271851 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:28.271808    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-749978ccd7-6pbjc" event={"ID":"8d136b15-3a4c-4cd5-a6e4-4eaade21228f","Type":"ContainerStarted","Data":"5a292670034c9e52042baa0262077306e9a5202d45f3e7046fe077a29e5369eb"}
Jul 20 12:49:29.278297 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:29.278259    2570 generic.go:356] "Generic (PLEG): container finished" podID="8d136b15-3a4c-4cd5-a6e4-4eaade21228f" containerID="5a292670034c9e52042baa0262077306e9a5202d45f3e7046fe077a29e5369eb" exitCode=0
Jul 20 12:49:29.278784 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:29.278326    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-749978ccd7-6pbjc" event={"ID":"8d136b15-3a4c-4cd5-a6e4-4eaade21228f","Type":"ContainerDied","Data":"5a292670034c9e52042baa0262077306e9a5202d45f3e7046fe077a29e5369eb"}
Jul 20 12:49:30.285328 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:30.285289    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-749978ccd7-6pbjc" event={"ID":"8d136b15-3a4c-4cd5-a6e4-4eaade21228f","Type":"ContainerStarted","Data":"c3605f7ffee991e860b51f4d7f102fdf3511e12c5f1c31c7d6a0ef9ba662ab26"}
Jul 20 12:49:30.285773 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:30.285428    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-749978ccd7-6pbjc"
Jul 20 12:49:30.313171 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:30.313117    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-749978ccd7-6pbjc" podStartSLOduration=1.960430542 podStartE2EDuration="6.313081095s" totalImagesPullingTime="3.342342845s" totalInitContainerRuntime="1.010307708s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:49:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:49:30.309965335 +0000 UTC m=+283.065014721" watchObservedRunningTime="2026-07-20 12:49:30.313081095 +0000 UTC m=+283.068130470"
Jul 20 12:49:35.256528 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:35.256495    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-586f8df4c4-jd467"
Jul 20 12:49:41.293388 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:41.293357    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-749978ccd7-6pbjc"
Jul 20 12:49:47.711637 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:47.711605    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rhdn8_5efe9094-763c-4689-85b7-83e0ccb19811/ovn-acl-logging/0.log"
Jul 20 12:49:47.712197 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:47.711852    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rhdn8_5efe9094-763c-4689-85b7-83e0ccb19811/ovn-acl-logging/0.log"
Jul 20 12:49:53.992337 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:53.992297    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7f7c7fb896-pvwl4"]
Jul 20 12:49:53.995726 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:53.995702    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7f7c7fb896-pvwl4"
Jul 20 12:49:53.999695 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:53.999603    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 20 12:49:53.999695 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:53.999615    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-b2k7c\""
Jul 20 12:49:54.000327 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:53.999943    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 20 12:49:54.000327 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:53.999982    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 20 12:49:54.000327 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:54.000173    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 20 12:49:54.013800 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:54.013766    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7f7c7fb896-pvwl4"]
Jul 20 12:49:54.131332 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:54.131293    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8rkj\" (UniqueName: \"kubernetes.io/projected/488d8e8c-3ca2-4219-a5c0-49979811aca3-kube-api-access-f8rkj\") pod \"kube-auth-proxy-7f7c7fb896-pvwl4\" (UID: \"488d8e8c-3ca2-4219-a5c0-49979811aca3\") " pod="openshift-ingress/kube-auth-proxy-7f7c7fb896-pvwl4"
Jul 20 12:49:54.132800 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:54.132019    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/488d8e8c-3ca2-4219-a5c0-49979811aca3-tmp\") pod \"kube-auth-proxy-7f7c7fb896-pvwl4\" (UID: \"488d8e8c-3ca2-4219-a5c0-49979811aca3\") " pod="openshift-ingress/kube-auth-proxy-7f7c7fb896-pvwl4"
Jul 20 12:49:54.132800 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:54.132146    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/488d8e8c-3ca2-4219-a5c0-49979811aca3-tls-certs\") pod \"kube-auth-proxy-7f7c7fb896-pvwl4\" (UID: \"488d8e8c-3ca2-4219-a5c0-49979811aca3\") " pod="openshift-ingress/kube-auth-proxy-7f7c7fb896-pvwl4"
Jul 20 12:49:54.233452 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:54.233407    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8rkj\" (UniqueName: \"kubernetes.io/projected/488d8e8c-3ca2-4219-a5c0-49979811aca3-kube-api-access-f8rkj\") pod \"kube-auth-proxy-7f7c7fb896-pvwl4\" (UID: \"488d8e8c-3ca2-4219-a5c0-49979811aca3\") " pod="openshift-ingress/kube-auth-proxy-7f7c7fb896-pvwl4"
Jul 20 12:49:54.233661 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:54.233465    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/488d8e8c-3ca2-4219-a5c0-49979811aca3-tmp\") pod \"kube-auth-proxy-7f7c7fb896-pvwl4\" (UID: \"488d8e8c-3ca2-4219-a5c0-49979811aca3\") " pod="openshift-ingress/kube-auth-proxy-7f7c7fb896-pvwl4"
Jul 20 12:49:54.233661 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:54.233516    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/488d8e8c-3ca2-4219-a5c0-49979811aca3-tls-certs\") pod \"kube-auth-proxy-7f7c7fb896-pvwl4\" (UID: \"488d8e8c-3ca2-4219-a5c0-49979811aca3\") " pod="openshift-ingress/kube-auth-proxy-7f7c7fb896-pvwl4"
Jul 20 12:49:54.235920 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:54.235892    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/488d8e8c-3ca2-4219-a5c0-49979811aca3-tmp\") pod \"kube-auth-proxy-7f7c7fb896-pvwl4\" (UID: \"488d8e8c-3ca2-4219-a5c0-49979811aca3\") " pod="openshift-ingress/kube-auth-proxy-7f7c7fb896-pvwl4"
Jul 20 12:49:54.236263 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:54.236240    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/488d8e8c-3ca2-4219-a5c0-49979811aca3-tls-certs\") pod \"kube-auth-proxy-7f7c7fb896-pvwl4\" (UID: \"488d8e8c-3ca2-4219-a5c0-49979811aca3\") " pod="openshift-ingress/kube-auth-proxy-7f7c7fb896-pvwl4"
Jul 20 12:49:54.247704 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:54.247622    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8rkj\" (UniqueName: \"kubernetes.io/projected/488d8e8c-3ca2-4219-a5c0-49979811aca3-kube-api-access-f8rkj\") pod \"kube-auth-proxy-7f7c7fb896-pvwl4\" (UID: \"488d8e8c-3ca2-4219-a5c0-49979811aca3\") " pod="openshift-ingress/kube-auth-proxy-7f7c7fb896-pvwl4"
Jul 20 12:49:54.307043 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:54.307002    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7f7c7fb896-pvwl4"
Jul 20 12:49:54.457191 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:54.457163    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7f7c7fb896-pvwl4"]
Jul 20 12:49:54.458673 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:49:54.458647    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod488d8e8c_3ca2_4219_a5c0_49979811aca3.slice/crio-c535fd3e378f60569c963c2a5c061bbc732631b461829bb020d51f5014feb31a WatchSource:0}: Error finding container c535fd3e378f60569c963c2a5c061bbc732631b461829bb020d51f5014feb31a: Status 404 returned error can't find the container with id c535fd3e378f60569c963c2a5c061bbc732631b461829bb020d51f5014feb31a
Jul 20 12:49:54.460929 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:54.460915    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 12:49:55.405217 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:55.405137    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7f7c7fb896-pvwl4" event={"ID":"488d8e8c-3ca2-4219-a5c0-49979811aca3","Type":"ContainerStarted","Data":"c535fd3e378f60569c963c2a5c061bbc732631b461829bb020d51f5014feb31a"}
Jul 20 12:49:57.416125 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:57.416078    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7f7c7fb896-pvwl4" event={"ID":"488d8e8c-3ca2-4219-a5c0-49979811aca3","Type":"ContainerStarted","Data":"ec0cc8e6754fe1c2751b4510a285cd746fb7d1ae8b373e4fab678968f95ea090"}
Jul 20 12:49:57.447411 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:49:57.447354    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7f7c7fb896-pvwl4" podStartSLOduration=2.007380832 podStartE2EDuration="4.447339311s" totalImagesPullingTime="2.439958479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:49:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:49:57.446522281 +0000 UTC m=+310.201571657" watchObservedRunningTime="2026-07-20 12:49:57.447339311 +0000 UTC m=+310.202388685"
Jul 20 12:51:00.045910 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:00.045874    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2fdg"]
Jul 20 12:51:00.049635 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:00.049617    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2fdg"
Jul 20 12:51:00.056469 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:00.056280    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 20 12:51:00.057498 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:00.057476    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-5htl2\""
Jul 20 12:51:00.057605 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:00.057476    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 20 12:51:00.059833 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:00.059811    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2fdg"]
Jul 20 12:51:00.212392 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:00.212349    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c1d6720-3bdc-4419-bb82-90117eceb44a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2fdg\" (UID: \"5c1d6720-3bdc-4419-bb82-90117eceb44a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2fdg"
Jul 20 12:51:00.212593 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:00.212425    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c1d6720-3bdc-4419-bb82-90117eceb44a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2fdg\" (UID: \"5c1d6720-3bdc-4419-bb82-90117eceb44a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2fdg"
Jul 20 12:51:00.212593 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:00.212507    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kft68\" (UniqueName: \"kubernetes.io/projected/5c1d6720-3bdc-4419-bb82-90117eceb44a-kube-api-access-kft68\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2fdg\" (UID: \"5c1d6720-3bdc-4419-bb82-90117eceb44a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2fdg"
Jul 20 12:51:00.313024 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:00.312936    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c1d6720-3bdc-4419-bb82-90117eceb44a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2fdg\" (UID: \"5c1d6720-3bdc-4419-bb82-90117eceb44a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2fdg"
Jul 20 12:51:00.313203 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:00.313024    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kft68\" (UniqueName: \"kubernetes.io/projected/5c1d6720-3bdc-4419-bb82-90117eceb44a-kube-api-access-kft68\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2fdg\" (UID: \"5c1d6720-3bdc-4419-bb82-90117eceb44a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2fdg"
Jul 20 12:51:00.313203 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:00.313075    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c1d6720-3bdc-4419-bb82-90117eceb44a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2fdg\" (UID: \"5c1d6720-3bdc-4419-bb82-90117eceb44a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2fdg"
Jul 20 12:51:00.313440 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:00.313412    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c1d6720-3bdc-4419-bb82-90117eceb44a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2fdg\" (UID: \"5c1d6720-3bdc-4419-bb82-90117eceb44a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2fdg"
Jul 20 12:51:00.313499 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:00.313439    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c1d6720-3bdc-4419-bb82-90117eceb44a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2fdg\" (UID: \"5c1d6720-3bdc-4419-bb82-90117eceb44a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2fdg"
Jul 20 12:51:00.324479 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:00.324448    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kft68\" (UniqueName: \"kubernetes.io/projected/5c1d6720-3bdc-4419-bb82-90117eceb44a-kube-api-access-kft68\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2fdg\" (UID: \"5c1d6720-3bdc-4419-bb82-90117eceb44a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2fdg"
Jul 20 12:51:00.359495 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:00.359457    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2fdg"
Jul 20 12:51:00.503502 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:00.503476    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2fdg"]
Jul 20 12:51:00.505530 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:51:00.505501    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c1d6720_3bdc_4419_bb82_90117eceb44a.slice/crio-3ad76146a6aadd657b4bba03da64fc1dc47414209dc0a7a143c46f5d5e3a6b18 WatchSource:0}: Error finding container 3ad76146a6aadd657b4bba03da64fc1dc47414209dc0a7a143c46f5d5e3a6b18: Status 404 returned error can't find the container with id 3ad76146a6aadd657b4bba03da64fc1dc47414209dc0a7a143c46f5d5e3a6b18
Jul 20 12:51:00.644800 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:00.644767    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759chl99"]
Jul 20 12:51:00.648338 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:00.648316    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759chl99"
Jul 20 12:51:00.659318 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:00.659285    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759chl99"]
Jul 20 12:51:00.722941 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:00.722905    2570 generic.go:356] "Generic (PLEG): container finished" podID="5c1d6720-3bdc-4419-bb82-90117eceb44a" containerID="3b5fc92c89f74bc7fc1e4bd439e4958f5840e98ea2e7ac38d9bf2e6f4126fe02" exitCode=0
Jul 20 12:51:00.723159 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:00.722996    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2fdg" event={"ID":"5c1d6720-3bdc-4419-bb82-90117eceb44a","Type":"ContainerDied","Data":"3b5fc92c89f74bc7fc1e4bd439e4958f5840e98ea2e7ac38d9bf2e6f4126fe02"}
Jul 20 12:51:00.723159 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:00.723043    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2fdg" event={"ID":"5c1d6720-3bdc-4419-bb82-90117eceb44a","Type":"ContainerStarted","Data":"3ad76146a6aadd657b4bba03da64fc1dc47414209dc0a7a143c46f5d5e3a6b18"}
Jul 20 12:51:00.818114 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:00.818045    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fee12997-021f-4fd9-96a4-4632a0f07969-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759chl99\" (UID: \"fee12997-021f-4fd9-96a4-4632a0f07969\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759chl99"
Jul 20 12:51:00.818114 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:00.818121    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fee12997-021f-4fd9-96a4-4632a0f07969-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759chl99\" (UID: \"fee12997-021f-4fd9-96a4-4632a0f07969\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759chl99"
Jul 20 12:51:00.818388 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:00.818268    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dl8k\" (UniqueName: \"kubernetes.io/projected/fee12997-021f-4fd9-96a4-4632a0f07969-kube-api-access-5dl8k\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759chl99\" (UID: \"fee12997-021f-4fd9-96a4-4632a0f07969\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759chl99"
Jul 20 12:51:00.919327 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:00.919231    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dl8k\" (UniqueName: \"kubernetes.io/projected/fee12997-021f-4fd9-96a4-4632a0f07969-kube-api-access-5dl8k\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759chl99\" (UID: \"fee12997-021f-4fd9-96a4-4632a0f07969\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759chl99"
Jul 20 12:51:00.919327 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:00.919293    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fee12997-021f-4fd9-96a4-4632a0f07969-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759chl99\" (UID: \"fee12997-021f-4fd9-96a4-4632a0f07969\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759chl99"
Jul 20 12:51:00.919327 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:00.919322    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fee12997-021f-4fd9-96a4-4632a0f07969-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759chl99\" (UID: \"fee12997-021f-4fd9-96a4-4632a0f07969\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759chl99"
Jul 20 12:51:00.919676 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:00.919649    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fee12997-021f-4fd9-96a4-4632a0f07969-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759chl99\" (UID: \"fee12997-021f-4fd9-96a4-4632a0f07969\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759chl99"
Jul 20 12:51:00.919722 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:00.919658    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fee12997-021f-4fd9-96a4-4632a0f07969-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759chl99\" (UID: \"fee12997-021f-4fd9-96a4-4632a0f07969\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759chl99"
Jul 20 12:51:00.929615 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:00.929587    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dl8k\" (UniqueName: \"kubernetes.io/projected/fee12997-021f-4fd9-96a4-4632a0f07969-kube-api-access-5dl8k\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759chl99\" (UID: \"fee12997-021f-4fd9-96a4-4632a0f07969\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759chl99"
Jul 20 12:51:00.984840 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:00.984797    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759chl99"
Jul 20 12:51:01.130136 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:01.130107    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759chl99"]
Jul 20 12:51:01.132252 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:51:01.132213    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfee12997_021f_4fd9_96a4_4632a0f07969.slice/crio-98fc4d530825791136c6348813b0811392580d2eb177f7a678d17815790c17cf WatchSource:0}: Error finding container 98fc4d530825791136c6348813b0811392580d2eb177f7a678d17815790c17cf: Status 404 returned error can't find the container with id 98fc4d530825791136c6348813b0811392580d2eb177f7a678d17815790c17cf
Jul 20 12:51:01.229401 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:01.229364    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dtpgc"]
Jul 20 12:51:01.233260 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:01.233238    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dtpgc"
Jul 20 12:51:01.243031 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:01.242999    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dtpgc"]
Jul 20 12:51:01.324221 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:01.324179    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ef2af62-3e2b-4e88-ba17-8affdc9d2226-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dtpgc\" (UID: \"9ef2af62-3e2b-4e88-ba17-8affdc9d2226\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dtpgc"
Jul 20 12:51:01.324404 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:01.324241    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ef2af62-3e2b-4e88-ba17-8affdc9d2226-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dtpgc\" (UID: \"9ef2af62-3e2b-4e88-ba17-8affdc9d2226\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dtpgc"
Jul 20 12:51:01.324404 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:01.324297    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6knk5\" (UniqueName: \"kubernetes.io/projected/9ef2af62-3e2b-4e88-ba17-8affdc9d2226-kube-api-access-6knk5\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dtpgc\" (UID: \"9ef2af62-3e2b-4e88-ba17-8affdc9d2226\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dtpgc"
Jul 20 12:51:01.425523 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:01.425459    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ef2af62-3e2b-4e88-ba17-8affdc9d2226-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dtpgc\" (UID: \"9ef2af62-3e2b-4e88-ba17-8affdc9d2226\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dtpgc"
Jul 20 12:51:01.425623 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:01.425525    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ef2af62-3e2b-4e88-ba17-8affdc9d2226-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dtpgc\" (UID: \"9ef2af62-3e2b-4e88-ba17-8affdc9d2226\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dtpgc"
Jul 20 12:51:01.425623 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:01.425552    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6knk5\" (UniqueName: \"kubernetes.io/projected/9ef2af62-3e2b-4e88-ba17-8affdc9d2226-kube-api-access-6knk5\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dtpgc\" (UID: \"9ef2af62-3e2b-4e88-ba17-8affdc9d2226\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dtpgc"
Jul 20 12:51:01.425840 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:01.425804    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ef2af62-3e2b-4e88-ba17-8affdc9d2226-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dtpgc\" (UID: \"9ef2af62-3e2b-4e88-ba17-8affdc9d2226\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dtpgc"
Jul 20 12:51:01.425879 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:01.425862    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ef2af62-3e2b-4e88-ba17-8affdc9d2226-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dtpgc\" (UID: \"9ef2af62-3e2b-4e88-ba17-8affdc9d2226\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dtpgc"
Jul 20 12:51:01.436256 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:01.436223    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6knk5\" (UniqueName: \"kubernetes.io/projected/9ef2af62-3e2b-4e88-ba17-8affdc9d2226-kube-api-access-6knk5\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dtpgc\" (UID: \"9ef2af62-3e2b-4e88-ba17-8affdc9d2226\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dtpgc"
Jul 20 12:51:01.585223 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:01.585177    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dtpgc"
Jul 20 12:51:01.635138 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:01.635101    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkf72"]
Jul 20 12:51:01.649181 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:01.649144    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkf72"
Jul 20 12:51:01.656166 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:01.656136    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkf72"]
Jul 20 12:51:01.730785 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:01.730746    2570 generic.go:356] "Generic (PLEG): container finished" podID="5c1d6720-3bdc-4419-bb82-90117eceb44a" containerID="490b9e7dade94d25c36f8cffad33f0c96f10b4cfb33bbd85e2f60583b38385bd" exitCode=0
Jul 20 12:51:01.730992 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:01.730831    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2fdg" event={"ID":"5c1d6720-3bdc-4419-bb82-90117eceb44a","Type":"ContainerDied","Data":"490b9e7dade94d25c36f8cffad33f0c96f10b4cfb33bbd85e2f60583b38385bd"}
Jul 20 12:51:01.732492 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:01.732445    2570 generic.go:356] "Generic (PLEG): container finished" podID="fee12997-021f-4fd9-96a4-4632a0f07969" containerID="d2322eb4dd499ac61c2ffe223321fb8f9f386bc2cfe25638488ee8cd5271c1b0" exitCode=0
Jul 20 12:51:01.732551 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:01.732496    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759chl99" event={"ID":"fee12997-021f-4fd9-96a4-4632a0f07969","Type":"ContainerDied","Data":"d2322eb4dd499ac61c2ffe223321fb8f9f386bc2cfe25638488ee8cd5271c1b0"}
Jul 20 12:51:01.732551 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:01.732540    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759chl99" event={"ID":"fee12997-021f-4fd9-96a4-4632a0f07969","Type":"ContainerStarted","Data":"98fc4d530825791136c6348813b0811392580d2eb177f7a678d17815790c17cf"}
Jul 20 12:51:01.740801 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:01.740774    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dtpgc"]
Jul 20 12:51:01.743294 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:51:01.743269    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ef2af62_3e2b_4e88_ba17_8affdc9d2226.slice/crio-c5e142c4250602916b03c43b028130a0d553a8dccc0c6235b444a84f2e468b71 WatchSource:0}: Error finding container c5e142c4250602916b03c43b028130a0d553a8dccc0c6235b444a84f2e468b71: Status 404 returned error can't find the container with id c5e142c4250602916b03c43b028130a0d553a8dccc0c6235b444a84f2e468b71
Jul 20 12:51:01.829954 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:01.829912    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b227a2c-e778-44ee-9edd-f2a9d8ca501e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkf72\" (UID: \"0b227a2c-e778-44ee-9edd-f2a9d8ca501e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkf72"
Jul 20 12:51:01.830156 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:01.829966    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b227a2c-e778-44ee-9edd-f2a9d8ca501e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkf72\" (UID: \"0b227a2c-e778-44ee-9edd-f2a9d8ca501e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkf72"
Jul 20 12:51:01.830212 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:01.830142    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kmgt\" (UniqueName: \"kubernetes.io/projected/0b227a2c-e778-44ee-9edd-f2a9d8ca501e-kube-api-access-8kmgt\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkf72\" (UID: \"0b227a2c-e778-44ee-9edd-f2a9d8ca501e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkf72"
Jul 20 12:51:01.931447 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:01.931335    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b227a2c-e778-44ee-9edd-f2a9d8ca501e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkf72\" (UID: \"0b227a2c-e778-44ee-9edd-f2a9d8ca501e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkf72"
Jul 20 12:51:01.931447 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:01.931394    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b227a2c-e778-44ee-9edd-f2a9d8ca501e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkf72\" (UID: \"0b227a2c-e778-44ee-9edd-f2a9d8ca501e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkf72"
Jul 20 12:51:01.931447 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:01.931447    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kmgt\" (UniqueName: \"kubernetes.io/projected/0b227a2c-e778-44ee-9edd-f2a9d8ca501e-kube-api-access-8kmgt\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkf72\" (UID: \"0b227a2c-e778-44ee-9edd-f2a9d8ca501e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkf72"
Jul 20 12:51:01.931786 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:01.931763    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b227a2c-e778-44ee-9edd-f2a9d8ca501e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkf72\" (UID: \"0b227a2c-e778-44ee-9edd-f2a9d8ca501e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkf72"
Jul 20 12:51:01.931827 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:01.931772    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b227a2c-e778-44ee-9edd-f2a9d8ca501e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkf72\" (UID: \"0b227a2c-e778-44ee-9edd-f2a9d8ca501e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkf72"
Jul 20 12:51:01.943726 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:01.943698    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kmgt\" (UniqueName: \"kubernetes.io/projected/0b227a2c-e778-44ee-9edd-f2a9d8ca501e-kube-api-access-8kmgt\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkf72\" (UID: \"0b227a2c-e778-44ee-9edd-f2a9d8ca501e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkf72"
Jul 20 12:51:01.963665 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:01.963622    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkf72"
Jul 20 12:51:02.104201 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:02.104167    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkf72"]
Jul 20 12:51:02.105658 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:51:02.105625    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b227a2c_e778_44ee_9edd_f2a9d8ca501e.slice/crio-44f14d016c214b2e131d3268dd52c2a7a12f057ab39602f332d1fd3b56016fee WatchSource:0}: Error finding container 44f14d016c214b2e131d3268dd52c2a7a12f057ab39602f332d1fd3b56016fee: Status 404 returned error can't find the container with id 44f14d016c214b2e131d3268dd52c2a7a12f057ab39602f332d1fd3b56016fee
Jul 20 12:51:02.739243 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:02.739207    2570 generic.go:356] "Generic (PLEG): container finished" podID="fee12997-021f-4fd9-96a4-4632a0f07969" containerID="581f78a811ef73d20d36a37dd8f9c936ccc67a0c101f8541b74c394e11fd8875" exitCode=0
Jul 20 12:51:02.739705 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:02.739301    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759chl99" event={"ID":"fee12997-021f-4fd9-96a4-4632a0f07969","Type":"ContainerDied","Data":"581f78a811ef73d20d36a37dd8f9c936ccc67a0c101f8541b74c394e11fd8875"}
Jul 20 12:51:02.741677 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:02.741647    2570 generic.go:356] "Generic (PLEG): container finished" podID="5c1d6720-3bdc-4419-bb82-90117eceb44a" containerID="d3e0db371ec9f9158cb9d447b95dafca3878f7d71f0dc30a2999106227ac2c32" exitCode=0
Jul 20 12:51:02.741791 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:02.741738    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2fdg" event={"ID":"5c1d6720-3bdc-4419-bb82-90117eceb44a","Type":"ContainerDied","Data":"d3e0db371ec9f9158cb9d447b95dafca3878f7d71f0dc30a2999106227ac2c32"}
Jul 20 12:51:02.743195 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:02.743173    2570 generic.go:356] "Generic (PLEG): container finished" podID="0b227a2c-e778-44ee-9edd-f2a9d8ca501e" containerID="0545105fdceaa85ea7ad1a4ac20cecf8bc47b03ff9c5f435674d73102983cf67" exitCode=0
Jul 20 12:51:02.743279 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:02.743237    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkf72" event={"ID":"0b227a2c-e778-44ee-9edd-f2a9d8ca501e","Type":"ContainerDied","Data":"0545105fdceaa85ea7ad1a4ac20cecf8bc47b03ff9c5f435674d73102983cf67"}
Jul 20 12:51:02.743279 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:02.743273    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkf72" event={"ID":"0b227a2c-e778-44ee-9edd-f2a9d8ca501e","Type":"ContainerStarted","Data":"44f14d016c214b2e131d3268dd52c2a7a12f057ab39602f332d1fd3b56016fee"}
Jul 20 12:51:02.744918 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:02.744891    2570 generic.go:356] "Generic (PLEG): container finished" podID="9ef2af62-3e2b-4e88-ba17-8affdc9d2226" containerID="19bc74fff65896b29ac7e39f2ade0b4fb32e347a9989b9416c9768359f641e6f" exitCode=0
Jul 20 12:51:02.744980 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:02.744934    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dtpgc" event={"ID":"9ef2af62-3e2b-4e88-ba17-8affdc9d2226","Type":"ContainerDied","Data":"19bc74fff65896b29ac7e39f2ade0b4fb32e347a9989b9416c9768359f641e6f"}
Jul 20 12:51:02.745018 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:02.744983    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dtpgc" event={"ID":"9ef2af62-3e2b-4e88-ba17-8affdc9d2226","Type":"ContainerStarted","Data":"c5e142c4250602916b03c43b028130a0d553a8dccc0c6235b444a84f2e468b71"}
Jul 20 12:51:03.751663 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:03.751562    2570 generic.go:356] "Generic (PLEG): container finished" podID="9ef2af62-3e2b-4e88-ba17-8affdc9d2226" containerID="2900448db71f02dee53451c209605cb73801d51f1b94894e44ae4ada2f4f5731" exitCode=0
Jul 20 12:51:03.751663 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:03.751650    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dtpgc" event={"ID":"9ef2af62-3e2b-4e88-ba17-8affdc9d2226","Type":"ContainerDied","Data":"2900448db71f02dee53451c209605cb73801d51f1b94894e44ae4ada2f4f5731"}
Jul 20 12:51:03.753807 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:03.753780    2570 generic.go:356] "Generic (PLEG): container finished" podID="fee12997-021f-4fd9-96a4-4632a0f07969" containerID="2d3d9c3415e1736cfdf7060d28beff8fb0554c6f04216a9f55921493b1eb53c7" exitCode=0
Jul 20 12:51:03.753905 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:03.753879    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759chl99" event={"ID":"fee12997-021f-4fd9-96a4-4632a0f07969","Type":"ContainerDied","Data":"2d3d9c3415e1736cfdf7060d28beff8fb0554c6f04216a9f55921493b1eb53c7"}
Jul 20 12:51:03.942708 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:03.942678    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2fdg"
Jul 20 12:51:04.054184 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:04.054097    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c1d6720-3bdc-4419-bb82-90117eceb44a-bundle\") pod \"5c1d6720-3bdc-4419-bb82-90117eceb44a\" (UID: \"5c1d6720-3bdc-4419-bb82-90117eceb44a\") "
Jul 20 12:51:04.054184 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:04.054150    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kft68\" (UniqueName: \"kubernetes.io/projected/5c1d6720-3bdc-4419-bb82-90117eceb44a-kube-api-access-kft68\") pod \"5c1d6720-3bdc-4419-bb82-90117eceb44a\" (UID: \"5c1d6720-3bdc-4419-bb82-90117eceb44a\") "
Jul 20 12:51:04.054381 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:04.054198    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c1d6720-3bdc-4419-bb82-90117eceb44a-util\") pod \"5c1d6720-3bdc-4419-bb82-90117eceb44a\" (UID: \"5c1d6720-3bdc-4419-bb82-90117eceb44a\") "
Jul 20 12:51:04.056803 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:04.055480    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c1d6720-3bdc-4419-bb82-90117eceb44a-bundle" (OuterVolumeSpecName: "bundle") pod "5c1d6720-3bdc-4419-bb82-90117eceb44a" (UID: "5c1d6720-3bdc-4419-bb82-90117eceb44a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 12:51:04.059308 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:04.057161    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c1d6720-3bdc-4419-bb82-90117eceb44a-kube-api-access-kft68" (OuterVolumeSpecName: "kube-api-access-kft68") pod "5c1d6720-3bdc-4419-bb82-90117eceb44a" (UID: "5c1d6720-3bdc-4419-bb82-90117eceb44a"). InnerVolumeSpecName "kube-api-access-kft68". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 12:51:04.065652 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:04.065616    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c1d6720-3bdc-4419-bb82-90117eceb44a-util" (OuterVolumeSpecName: "util") pod "5c1d6720-3bdc-4419-bb82-90117eceb44a" (UID: "5c1d6720-3bdc-4419-bb82-90117eceb44a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 12:51:04.156019 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:04.155986    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kft68\" (UniqueName: \"kubernetes.io/projected/5c1d6720-3bdc-4419-bb82-90117eceb44a-kube-api-access-kft68\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:51:04.156019 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:04.156018    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c1d6720-3bdc-4419-bb82-90117eceb44a-util\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:51:04.156185 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:04.156028    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c1d6720-3bdc-4419-bb82-90117eceb44a-bundle\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:51:04.761159 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:04.761050    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2fdg"
Jul 20 12:51:04.761159 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:04.761050    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2fdg" event={"ID":"5c1d6720-3bdc-4419-bb82-90117eceb44a","Type":"ContainerDied","Data":"3ad76146a6aadd657b4bba03da64fc1dc47414209dc0a7a143c46f5d5e3a6b18"}
Jul 20 12:51:04.761634 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:04.761219    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3ad76146a6aadd657b4bba03da64fc1dc47414209dc0a7a143c46f5d5e3a6b18"
Jul 20 12:51:04.763014 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:04.762988    2570 generic.go:356] "Generic (PLEG): container finished" podID="0b227a2c-e778-44ee-9edd-f2a9d8ca501e" containerID="7fe38f23db11eeaeb3dc9f03a8f16f811826b71aa9c23488d569fd9c1db09e71" exitCode=0
Jul 20 12:51:04.763163 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:04.763055    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkf72" event={"ID":"0b227a2c-e778-44ee-9edd-f2a9d8ca501e","Type":"ContainerDied","Data":"7fe38f23db11eeaeb3dc9f03a8f16f811826b71aa9c23488d569fd9c1db09e71"}
Jul 20 12:51:04.765502 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:04.765478    2570 generic.go:356] "Generic (PLEG): container finished" podID="9ef2af62-3e2b-4e88-ba17-8affdc9d2226" containerID="8d8c9cb162bf3b0740513ef802b49ea71bfda61cf229043f3b456523255748ec" exitCode=0
Jul 20 12:51:04.765612 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:04.765542    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dtpgc" event={"ID":"9ef2af62-3e2b-4e88-ba17-8affdc9d2226","Type":"ContainerDied","Data":"8d8c9cb162bf3b0740513ef802b49ea71bfda61cf229043f3b456523255748ec"}
Jul 20 12:51:04.906101 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:04.906059    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759chl99"
Jul 20 12:51:05.062543 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:05.062428    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fee12997-021f-4fd9-96a4-4632a0f07969-bundle\") pod \"fee12997-021f-4fd9-96a4-4632a0f07969\" (UID: \"fee12997-021f-4fd9-96a4-4632a0f07969\") "
Jul 20 12:51:05.062543 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:05.062505    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fee12997-021f-4fd9-96a4-4632a0f07969-util\") pod \"fee12997-021f-4fd9-96a4-4632a0f07969\" (UID: \"fee12997-021f-4fd9-96a4-4632a0f07969\") "
Jul 20 12:51:05.062739 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:05.062589    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5dl8k\" (UniqueName: \"kubernetes.io/projected/fee12997-021f-4fd9-96a4-4632a0f07969-kube-api-access-5dl8k\") pod \"fee12997-021f-4fd9-96a4-4632a0f07969\" (UID: \"fee12997-021f-4fd9-96a4-4632a0f07969\") "
Jul 20 12:51:05.062993 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:05.062958    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fee12997-021f-4fd9-96a4-4632a0f07969-bundle" (OuterVolumeSpecName: "bundle") pod "fee12997-021f-4fd9-96a4-4632a0f07969" (UID: "fee12997-021f-4fd9-96a4-4632a0f07969"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 12:51:05.064637 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:05.064616    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fee12997-021f-4fd9-96a4-4632a0f07969-kube-api-access-5dl8k" (OuterVolumeSpecName: "kube-api-access-5dl8k") pod "fee12997-021f-4fd9-96a4-4632a0f07969" (UID: "fee12997-021f-4fd9-96a4-4632a0f07969"). InnerVolumeSpecName "kube-api-access-5dl8k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 12:51:05.067570 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:05.067532    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fee12997-021f-4fd9-96a4-4632a0f07969-util" (OuterVolumeSpecName: "util") pod "fee12997-021f-4fd9-96a4-4632a0f07969" (UID: "fee12997-021f-4fd9-96a4-4632a0f07969"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 12:51:05.163938 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:05.163895    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5dl8k\" (UniqueName: \"kubernetes.io/projected/fee12997-021f-4fd9-96a4-4632a0f07969-kube-api-access-5dl8k\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:51:05.163938 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:05.163941    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fee12997-021f-4fd9-96a4-4632a0f07969-bundle\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:51:05.164178 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:05.163952    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fee12997-021f-4fd9-96a4-4632a0f07969-util\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:51:05.772756 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:05.772667    2570 generic.go:356] "Generic (PLEG): container finished" podID="0b227a2c-e778-44ee-9edd-f2a9d8ca501e" containerID="fbb1f55d34c8db58dfcbd89016bfa44e3bc8861fac862a99ed2cc02fc6ff18b7" exitCode=0
Jul 20 12:51:05.773255 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:05.772750    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkf72" event={"ID":"0b227a2c-e778-44ee-9edd-f2a9d8ca501e","Type":"ContainerDied","Data":"fbb1f55d34c8db58dfcbd89016bfa44e3bc8861fac862a99ed2cc02fc6ff18b7"}
Jul 20 12:51:05.774537 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:05.774508    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759chl99" event={"ID":"fee12997-021f-4fd9-96a4-4632a0f07969","Type":"ContainerDied","Data":"98fc4d530825791136c6348813b0811392580d2eb177f7a678d17815790c17cf"}
Jul 20 12:51:05.774537 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:05.774529    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759chl99"
Jul 20 12:51:05.774719 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:05.774552    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="98fc4d530825791136c6348813b0811392580d2eb177f7a678d17815790c17cf"
Jul 20 12:51:05.914745 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:05.914716    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dtpgc"
Jul 20 12:51:06.071556 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:06.071528    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ef2af62-3e2b-4e88-ba17-8affdc9d2226-bundle\") pod \"9ef2af62-3e2b-4e88-ba17-8affdc9d2226\" (UID: \"9ef2af62-3e2b-4e88-ba17-8affdc9d2226\") "
Jul 20 12:51:06.071729 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:06.071608    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ef2af62-3e2b-4e88-ba17-8affdc9d2226-util\") pod \"9ef2af62-3e2b-4e88-ba17-8affdc9d2226\" (UID: \"9ef2af62-3e2b-4e88-ba17-8affdc9d2226\") "
Jul 20 12:51:06.071729 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:06.071661    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6knk5\" (UniqueName: \"kubernetes.io/projected/9ef2af62-3e2b-4e88-ba17-8affdc9d2226-kube-api-access-6knk5\") pod \"9ef2af62-3e2b-4e88-ba17-8affdc9d2226\" (UID: \"9ef2af62-3e2b-4e88-ba17-8affdc9d2226\") "
Jul 20 12:51:06.072138 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:06.072106    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ef2af62-3e2b-4e88-ba17-8affdc9d2226-bundle" (OuterVolumeSpecName: "bundle") pod "9ef2af62-3e2b-4e88-ba17-8affdc9d2226" (UID: "9ef2af62-3e2b-4e88-ba17-8affdc9d2226"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 12:51:06.073960 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:06.073927    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ef2af62-3e2b-4e88-ba17-8affdc9d2226-kube-api-access-6knk5" (OuterVolumeSpecName: "kube-api-access-6knk5") pod "9ef2af62-3e2b-4e88-ba17-8affdc9d2226" (UID: "9ef2af62-3e2b-4e88-ba17-8affdc9d2226"). InnerVolumeSpecName "kube-api-access-6knk5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 12:51:06.077046 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:06.077021    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ef2af62-3e2b-4e88-ba17-8affdc9d2226-util" (OuterVolumeSpecName: "util") pod "9ef2af62-3e2b-4e88-ba17-8affdc9d2226" (UID: "9ef2af62-3e2b-4e88-ba17-8affdc9d2226"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 12:51:06.173036 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:06.172998    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ef2af62-3e2b-4e88-ba17-8affdc9d2226-util\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:51:06.173036 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:06.173028    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6knk5\" (UniqueName: \"kubernetes.io/projected/9ef2af62-3e2b-4e88-ba17-8affdc9d2226-kube-api-access-6knk5\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:51:06.173036 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:06.173039    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ef2af62-3e2b-4e88-ba17-8affdc9d2226-bundle\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:51:06.781789 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:06.781748    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dtpgc" event={"ID":"9ef2af62-3e2b-4e88-ba17-8affdc9d2226","Type":"ContainerDied","Data":"c5e142c4250602916b03c43b028130a0d553a8dccc0c6235b444a84f2e468b71"}
Jul 20 12:51:06.781789 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:06.781773    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dtpgc"
Jul 20 12:51:06.782247 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:06.781801    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c5e142c4250602916b03c43b028130a0d553a8dccc0c6235b444a84f2e468b71"
Jul 20 12:51:06.914434 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:06.914404    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkf72"
Jul 20 12:51:06.980968 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:06.980923    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8kmgt\" (UniqueName: \"kubernetes.io/projected/0b227a2c-e778-44ee-9edd-f2a9d8ca501e-kube-api-access-8kmgt\") pod \"0b227a2c-e778-44ee-9edd-f2a9d8ca501e\" (UID: \"0b227a2c-e778-44ee-9edd-f2a9d8ca501e\") "
Jul 20 12:51:06.981201 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:06.980990    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b227a2c-e778-44ee-9edd-f2a9d8ca501e-util\") pod \"0b227a2c-e778-44ee-9edd-f2a9d8ca501e\" (UID: \"0b227a2c-e778-44ee-9edd-f2a9d8ca501e\") "
Jul 20 12:51:06.981201 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:06.981070    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b227a2c-e778-44ee-9edd-f2a9d8ca501e-bundle\") pod \"0b227a2c-e778-44ee-9edd-f2a9d8ca501e\" (UID: \"0b227a2c-e778-44ee-9edd-f2a9d8ca501e\") "
Jul 20 12:51:06.981592 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:06.981566    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b227a2c-e778-44ee-9edd-f2a9d8ca501e-bundle" (OuterVolumeSpecName: "bundle") pod "0b227a2c-e778-44ee-9edd-f2a9d8ca501e" (UID: "0b227a2c-e778-44ee-9edd-f2a9d8ca501e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 12:51:06.983141 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:06.983112    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b227a2c-e778-44ee-9edd-f2a9d8ca501e-kube-api-access-8kmgt" (OuterVolumeSpecName: "kube-api-access-8kmgt") pod "0b227a2c-e778-44ee-9edd-f2a9d8ca501e" (UID: "0b227a2c-e778-44ee-9edd-f2a9d8ca501e"). InnerVolumeSpecName "kube-api-access-8kmgt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 12:51:06.988541 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:06.988490    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b227a2c-e778-44ee-9edd-f2a9d8ca501e-util" (OuterVolumeSpecName: "util") pod "0b227a2c-e778-44ee-9edd-f2a9d8ca501e" (UID: "0b227a2c-e778-44ee-9edd-f2a9d8ca501e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 12:51:07.081710 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:07.081676    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b227a2c-e778-44ee-9edd-f2a9d8ca501e-bundle\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:51:07.081710 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:07.081710    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8kmgt\" (UniqueName: \"kubernetes.io/projected/0b227a2c-e778-44ee-9edd-f2a9d8ca501e-kube-api-access-8kmgt\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:51:07.081907 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:07.081720    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b227a2c-e778-44ee-9edd-f2a9d8ca501e-util\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:51:07.788823 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:07.788788    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkf72"
Jul 20 12:51:07.788823 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:07.788810    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkf72" event={"ID":"0b227a2c-e778-44ee-9edd-f2a9d8ca501e","Type":"ContainerDied","Data":"44f14d016c214b2e131d3268dd52c2a7a12f057ab39602f332d1fd3b56016fee"}
Jul 20 12:51:07.789283 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:07.788894    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="44f14d016c214b2e131d3268dd52c2a7a12f057ab39602f332d1fd3b56016fee"
Jul 20 12:51:18.741436 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:18.741394    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cbf78c6c8-f6fg7"]
Jul 20 12:51:18.741838 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:18.741737    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b227a2c-e778-44ee-9edd-f2a9d8ca501e" containerName="pull"
Jul 20 12:51:18.741838 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:18.741748    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b227a2c-e778-44ee-9edd-f2a9d8ca501e" containerName="pull"
Jul 20 12:51:18.741838 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:18.741762    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fee12997-021f-4fd9-96a4-4632a0f07969" containerName="pull"
Jul 20 12:51:18.741838 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:18.741767    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="fee12997-021f-4fd9-96a4-4632a0f07969" containerName="pull"
Jul 20 12:51:18.741838 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:18.741774    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ef2af62-3e2b-4e88-ba17-8affdc9d2226" containerName="util"
Jul 20 12:51:18.741838 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:18.741779    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ef2af62-3e2b-4e88-ba17-8affdc9d2226" containerName="util"
Jul 20 12:51:18.741838 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:18.741786    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ef2af62-3e2b-4e88-ba17-8affdc9d2226" containerName="extract"
Jul 20 12:51:18.741838 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:18.741791    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ef2af62-3e2b-4e88-ba17-8affdc9d2226" containerName="extract"
Jul 20 12:51:18.741838 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:18.741799    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b227a2c-e778-44ee-9edd-f2a9d8ca501e" containerName="util"
Jul 20 12:51:18.741838 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:18.741803    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b227a2c-e778-44ee-9edd-f2a9d8ca501e" containerName="util"
Jul 20 12:51:18.741838 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:18.741811    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fee12997-021f-4fd9-96a4-4632a0f07969" containerName="util"
Jul 20 12:51:18.741838 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:18.741816    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="fee12997-021f-4fd9-96a4-4632a0f07969" containerName="util"
Jul 20 12:51:18.741838 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:18.741822    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c1d6720-3bdc-4419-bb82-90117eceb44a" containerName="extract"
Jul 20 12:51:18.741838 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:18.741827    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c1d6720-3bdc-4419-bb82-90117eceb44a" containerName="extract"
Jul 20 12:51:18.741838 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:18.741838    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ef2af62-3e2b-4e88-ba17-8affdc9d2226" containerName="pull"
Jul 20 12:51:18.741838 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:18.741843    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ef2af62-3e2b-4e88-ba17-8affdc9d2226" containerName="pull"
Jul 20 12:51:18.742354 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:18.741851    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c1d6720-3bdc-4419-bb82-90117eceb44a" containerName="pull"
Jul 20 12:51:18.742354 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:18.741856    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c1d6720-3bdc-4419-bb82-90117eceb44a" containerName="pull"
Jul 20 12:51:18.742354 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:18.741871    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c1d6720-3bdc-4419-bb82-90117eceb44a" containerName="util"
Jul 20 12:51:18.742354 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:18.741878    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c1d6720-3bdc-4419-bb82-90117eceb44a" containerName="util"
Jul 20 12:51:18.742354 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:18.741887    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fee12997-021f-4fd9-96a4-4632a0f07969" containerName="extract"
Jul 20 12:51:18.742354 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:18.741892    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="fee12997-021f-4fd9-96a4-4632a0f07969" containerName="extract"
Jul 20 12:51:18.742354 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:18.741897    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b227a2c-e778-44ee-9edd-f2a9d8ca501e" containerName="extract"
Jul 20 12:51:18.742354 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:18.741902    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b227a2c-e778-44ee-9edd-f2a9d8ca501e" containerName="extract"
Jul 20 12:51:18.742354 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:18.741965    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c1d6720-3bdc-4419-bb82-90117eceb44a" containerName="extract"
Jul 20 12:51:18.742354 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:18.741974    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="fee12997-021f-4fd9-96a4-4632a0f07969" containerName="extract"
Jul 20 12:51:18.742354 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:18.741979    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ef2af62-3e2b-4e88-ba17-8affdc9d2226" containerName="extract"
Jul 20 12:51:18.742354 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:18.741986    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b227a2c-e778-44ee-9edd-f2a9d8ca501e" containerName="extract"
Jul 20 12:51:18.745011 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:18.744994    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cbf78c6c8-f6fg7"
Jul 20 12:51:18.760314 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:18.760282    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cbf78c6c8-f6fg7"]
Jul 20 12:51:18.781652 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:18.781618    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8982f6d-fe40-4b9f-acb2-e0479edd1be2-console-serving-cert\") pod \"console-5cbf78c6c8-f6fg7\" (UID: \"c8982f6d-fe40-4b9f-acb2-e0479edd1be2\") " pod="openshift-console/console-5cbf78c6c8-f6fg7"
Jul 20 12:51:18.781826 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:18.781667    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c8982f6d-fe40-4b9f-acb2-e0479edd1be2-oauth-serving-cert\") pod \"console-5cbf78c6c8-f6fg7\" (UID: \"c8982f6d-fe40-4b9f-acb2-e0479edd1be2\") " pod="openshift-console/console-5cbf78c6c8-f6fg7"
Jul 20 12:51:18.781826 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:18.781720    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c8982f6d-fe40-4b9f-acb2-e0479edd1be2-console-oauth-config\") pod \"console-5cbf78c6c8-f6fg7\" (UID: \"c8982f6d-fe40-4b9f-acb2-e0479edd1be2\") " pod="openshift-console/console-5cbf78c6c8-f6fg7"
Jul 20 12:51:18.781826 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:18.781755    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8982f6d-fe40-4b9f-acb2-e0479edd1be2-trusted-ca-bundle\") pod \"console-5cbf78c6c8-f6fg7\" (UID: \"c8982f6d-fe40-4b9f-acb2-e0479edd1be2\") " pod="openshift-console/console-5cbf78c6c8-f6fg7"
Jul 20 12:51:18.781826 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:18.781773    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c8982f6d-fe40-4b9f-acb2-e0479edd1be2-console-config\") pod \"console-5cbf78c6c8-f6fg7\" (UID: \"c8982f6d-fe40-4b9f-acb2-e0479edd1be2\") " pod="openshift-console/console-5cbf78c6c8-f6fg7"
Jul 20 12:51:18.781826 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:18.781788    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c8982f6d-fe40-4b9f-acb2-e0479edd1be2-service-ca\") pod \"console-5cbf78c6c8-f6fg7\" (UID: \"c8982f6d-fe40-4b9f-acb2-e0479edd1be2\") " pod="openshift-console/console-5cbf78c6c8-f6fg7"
Jul 20 12:51:18.781826 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:18.781807    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7h7g\" (UniqueName: \"kubernetes.io/projected/c8982f6d-fe40-4b9f-acb2-e0479edd1be2-kube-api-access-x7h7g\") pod \"console-5cbf78c6c8-f6fg7\" (UID: \"c8982f6d-fe40-4b9f-acb2-e0479edd1be2\") " pod="openshift-console/console-5cbf78c6c8-f6fg7"
Jul 20 12:51:18.882918 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:18.882879    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c8982f6d-fe40-4b9f-acb2-e0479edd1be2-oauth-serving-cert\") pod \"console-5cbf78c6c8-f6fg7\" (UID: \"c8982f6d-fe40-4b9f-acb2-e0479edd1be2\") " pod="openshift-console/console-5cbf78c6c8-f6fg7"
Jul 20 12:51:18.883175 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:18.882939    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c8982f6d-fe40-4b9f-acb2-e0479edd1be2-console-oauth-config\") pod \"console-5cbf78c6c8-f6fg7\" (UID: \"c8982f6d-fe40-4b9f-acb2-e0479edd1be2\") " pod="openshift-console/console-5cbf78c6c8-f6fg7"
Jul 20 12:51:18.883175 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:18.883122    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8982f6d-fe40-4b9f-acb2-e0479edd1be2-trusted-ca-bundle\") pod \"console-5cbf78c6c8-f6fg7\" (UID: \"c8982f6d-fe40-4b9f-acb2-e0479edd1be2\") " pod="openshift-console/console-5cbf78c6c8-f6fg7"
Jul 20 12:51:18.883326 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:18.883212    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c8982f6d-fe40-4b9f-acb2-e0479edd1be2-console-config\") pod \"console-5cbf78c6c8-f6fg7\" (UID: \"c8982f6d-fe40-4b9f-acb2-e0479edd1be2\") " pod="openshift-console/console-5cbf78c6c8-f6fg7"
Jul 20 12:51:18.883326 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:18.883245    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c8982f6d-fe40-4b9f-acb2-e0479edd1be2-service-ca\") pod \"console-5cbf78c6c8-f6fg7\" (UID: \"c8982f6d-fe40-4b9f-acb2-e0479edd1be2\") " pod="openshift-console/console-5cbf78c6c8-f6fg7"
Jul 20 12:51:18.883326 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:18.883279    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7h7g\" (UniqueName: \"kubernetes.io/projected/c8982f6d-fe40-4b9f-acb2-e0479edd1be2-kube-api-access-x7h7g\") pod \"console-5cbf78c6c8-f6fg7\" (UID: \"c8982f6d-fe40-4b9f-acb2-e0479edd1be2\") " pod="openshift-console/console-5cbf78c6c8-f6fg7"
Jul 20 12:51:18.883493 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:18.883462    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8982f6d-fe40-4b9f-acb2-e0479edd1be2-console-serving-cert\") pod \"console-5cbf78c6c8-f6fg7\" (UID: \"c8982f6d-fe40-4b9f-acb2-e0479edd1be2\") " pod="openshift-console/console-5cbf78c6c8-f6fg7"
Jul 20 12:51:18.883720 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:18.883692    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c8982f6d-fe40-4b9f-acb2-e0479edd1be2-oauth-serving-cert\") pod \"console-5cbf78c6c8-f6fg7\" (UID: \"c8982f6d-fe40-4b9f-acb2-e0479edd1be2\") " pod="openshift-console/console-5cbf78c6c8-f6fg7"
Jul 20 12:51:18.883995 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:18.883973    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8982f6d-fe40-4b9f-acb2-e0479edd1be2-trusted-ca-bundle\") pod \"console-5cbf78c6c8-f6fg7\" (UID: \"c8982f6d-fe40-4b9f-acb2-e0479edd1be2\") " pod="openshift-console/console-5cbf78c6c8-f6fg7"
Jul 20 12:51:18.884215 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:18.884192    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c8982f6d-fe40-4b9f-acb2-e0479edd1be2-console-config\") pod \"console-5cbf78c6c8-f6fg7\" (UID: \"c8982f6d-fe40-4b9f-acb2-e0479edd1be2\") " pod="openshift-console/console-5cbf78c6c8-f6fg7"
Jul 20 12:51:18.884338 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:18.884293    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c8982f6d-fe40-4b9f-acb2-e0479edd1be2-service-ca\") pod \"console-5cbf78c6c8-f6fg7\" (UID: \"c8982f6d-fe40-4b9f-acb2-e0479edd1be2\") " pod="openshift-console/console-5cbf78c6c8-f6fg7"
Jul 20 12:51:18.885703 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:18.885677    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c8982f6d-fe40-4b9f-acb2-e0479edd1be2-console-oauth-config\") pod \"console-5cbf78c6c8-f6fg7\" (UID: \"c8982f6d-fe40-4b9f-acb2-e0479edd1be2\") " pod="openshift-console/console-5cbf78c6c8-f6fg7"
Jul 20 12:51:18.886036 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:18.886018    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8982f6d-fe40-4b9f-acb2-e0479edd1be2-console-serving-cert\") pod \"console-5cbf78c6c8-f6fg7\" (UID: \"c8982f6d-fe40-4b9f-acb2-e0479edd1be2\") " pod="openshift-console/console-5cbf78c6c8-f6fg7"
Jul 20 12:51:18.894652 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:18.894623    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7h7g\" (UniqueName: \"kubernetes.io/projected/c8982f6d-fe40-4b9f-acb2-e0479edd1be2-kube-api-access-x7h7g\") pod \"console-5cbf78c6c8-f6fg7\" (UID: \"c8982f6d-fe40-4b9f-acb2-e0479edd1be2\") " pod="openshift-console/console-5cbf78c6c8-f6fg7"
Jul 20 12:51:19.054234 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:19.054138    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cbf78c6c8-f6fg7"
Jul 20 12:51:19.209032 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:19.208994    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cbf78c6c8-f6fg7"]
Jul 20 12:51:19.212056 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:51:19.212024    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8982f6d_fe40_4b9f_acb2_e0479edd1be2.slice/crio-502a7b2b45d9e1059e3944fb47b67ce88b2498de9e89e2fabed88e88f9ad61b8 WatchSource:0}: Error finding container 502a7b2b45d9e1059e3944fb47b67ce88b2498de9e89e2fabed88e88f9ad61b8: Status 404 returned error can't find the container with id 502a7b2b45d9e1059e3944fb47b67ce88b2498de9e89e2fabed88e88f9ad61b8
Jul 20 12:51:19.851112 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:19.851040    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cbf78c6c8-f6fg7" event={"ID":"c8982f6d-fe40-4b9f-acb2-e0479edd1be2","Type":"ContainerStarted","Data":"1c6e43bba21041e338514a7f8ebe77cc45e6aa91bb4c015cf55dc4a7060db0c6"}
Jul 20 12:51:19.851112 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:19.851120    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cbf78c6c8-f6fg7" event={"ID":"c8982f6d-fe40-4b9f-acb2-e0479edd1be2","Type":"ContainerStarted","Data":"502a7b2b45d9e1059e3944fb47b67ce88b2498de9e89e2fabed88e88f9ad61b8"}
Jul 20 12:51:19.885283 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:19.885216    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5cbf78c6c8-f6fg7" podStartSLOduration=1.885199201 podStartE2EDuration="1.885199201s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:51:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:51:19.882997127 +0000 UTC m=+392.638046502" watchObservedRunningTime="2026-07-20 12:51:19.885199201 +0000 UTC m=+392.640248577"
Jul 20 12:51:29.055217 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:29.055175    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cbf78c6c8-f6fg7"
Jul 20 12:51:29.055704 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:29.055244    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5cbf78c6c8-f6fg7"
Jul 20 12:51:29.060413 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:29.060388    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5cbf78c6c8-f6fg7"
Jul 20 12:51:29.910340 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:29.910305    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5cbf78c6c8-f6fg7"
Jul 20 12:51:30.022654 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:30.022617    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-544cff9648-cl7tb"]
Jul 20 12:51:31.151684 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:31.151645    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rc8qm"]
Jul 20 12:51:31.155321 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:31.155299    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rc8qm"
Jul 20 12:51:31.159867 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:31.159846    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 20 12:51:31.160015 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:31.159846    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 20 12:51:31.160323 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:31.160307    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-krktl\""
Jul 20 12:51:31.167274 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:31.167245    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rc8qm"]
Jul 20 12:51:31.300890 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:31.300845    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a8f9a19-4e46-4a78-8957-f3baa1461c70-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rc8qm\" (UID: \"6a8f9a19-4e46-4a78-8957-f3baa1461c70\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rc8qm"
Jul 20 12:51:31.301123 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:31.300902    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rmw4\" (UniqueName: \"kubernetes.io/projected/6a8f9a19-4e46-4a78-8957-f3baa1461c70-kube-api-access-6rmw4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rc8qm\" (UID: \"6a8f9a19-4e46-4a78-8957-f3baa1461c70\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rc8qm"
Jul 20 12:51:31.402286 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:31.402182    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a8f9a19-4e46-4a78-8957-f3baa1461c70-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rc8qm\" (UID: \"6a8f9a19-4e46-4a78-8957-f3baa1461c70\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rc8qm"
Jul 20 12:51:31.402286 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:31.402250    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rmw4\" (UniqueName: \"kubernetes.io/projected/6a8f9a19-4e46-4a78-8957-f3baa1461c70-kube-api-access-6rmw4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rc8qm\" (UID: \"6a8f9a19-4e46-4a78-8957-f3baa1461c70\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rc8qm"
Jul 20 12:51:31.402675 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:31.402650    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a8f9a19-4e46-4a78-8957-f3baa1461c70-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rc8qm\" (UID: \"6a8f9a19-4e46-4a78-8957-f3baa1461c70\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rc8qm"
Jul 20 12:51:31.416569 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:31.416539    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rmw4\" (UniqueName: \"kubernetes.io/projected/6a8f9a19-4e46-4a78-8957-f3baa1461c70-kube-api-access-6rmw4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rc8qm\" (UID: \"6a8f9a19-4e46-4a78-8957-f3baa1461c70\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rc8qm"
Jul 20 12:51:31.466651 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:31.466613    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rc8qm"
Jul 20 12:51:31.622025 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:31.621986    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rc8qm"]
Jul 20 12:51:31.623514 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:51:31.623488    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a8f9a19_4e46_4a78_8957_f3baa1461c70.slice/crio-442c8f7839201e4c68f9715bb298a7f78dc316bb674b8e683b31e5844d6270c7 WatchSource:0}: Error finding container 442c8f7839201e4c68f9715bb298a7f78dc316bb674b8e683b31e5844d6270c7: Status 404 returned error can't find the container with id 442c8f7839201e4c68f9715bb298a7f78dc316bb674b8e683b31e5844d6270c7
Jul 20 12:51:31.917168 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:31.917125    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rc8qm" event={"ID":"6a8f9a19-4e46-4a78-8957-f3baa1461c70","Type":"ContainerStarted","Data":"442c8f7839201e4c68f9715bb298a7f78dc316bb674b8e683b31e5844d6270c7"}
Jul 20 12:51:37.957363 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:37.957323    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rc8qm" event={"ID":"6a8f9a19-4e46-4a78-8957-f3baa1461c70","Type":"ContainerStarted","Data":"3160d07024a17a1a7a25e722645395f6fcec7f0502ff28c8f400d3059c5f2b9b"}
Jul 20 12:51:37.957843 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:37.957386    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rc8qm"
Jul 20 12:51:48.964569 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:48.964532    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rc8qm"
Jul 20 12:51:48.992434 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:48.992381    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rc8qm" podStartSLOduration=12.470040206 podStartE2EDuration="17.992364886s" totalImagesPullingTime="5.52232468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:51:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:51:37.983827897 +0000 UTC m=+410.738877271" watchObservedRunningTime="2026-07-20 12:51:48.992364886 +0000 UTC m=+421.747414261"
Jul 20 12:51:50.995362 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:50.995327    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rc8qm"]
Jul 20 12:51:50.995803 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:50.995576    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rc8qm" podUID="6a8f9a19-4e46-4a78-8957-f3baa1461c70" containerName="manager" containerID="cri-o://3160d07024a17a1a7a25e722645395f6fcec7f0502ff28c8f400d3059c5f2b9b" gracePeriod=2
Jul 20 12:51:50.997912 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:50.997886    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rc8qm"]
Jul 20 12:51:50.998696 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:51:50.998663    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rc8qm\" is forbidden: User \"system:node:ip-10-0-139-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-1.ec2.internal' and this object" podUID="6a8f9a19-4e46-4a78-8957-f3baa1461c70" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rc8qm"
Jul 20 12:51:51.057849 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:51.057813    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hhqng"]
Jul 20 12:51:51.058246 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:51.058231    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a8f9a19-4e46-4a78-8957-f3baa1461c70" containerName="manager"
Jul 20 12:51:51.058246 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:51.058248    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a8f9a19-4e46-4a78-8957-f3baa1461c70" containerName="manager"
Jul 20 12:51:51.058338 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:51.058307    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a8f9a19-4e46-4a78-8957-f3baa1461c70" containerName="manager"
Jul 20 12:51:51.061456 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:51.061438    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hhqng"
Jul 20 12:51:51.067460 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:51.067431    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-8wmk9\""
Jul 20 12:51:51.079788 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:51.079760    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hhqng"]
Jul 20 12:51:51.103967 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:51:51.103927    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rc8qm\" is forbidden: User \"system:node:ip-10-0-139-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-1.ec2.internal' and this object" podUID="6a8f9a19-4e46-4a78-8957-f3baa1461c70" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rc8qm"
Jul 20 12:51:51.188794 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:51.188751    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtb68\" (UniqueName: \"kubernetes.io/projected/53b7e07c-125f-4528-9d5e-0dbe45216d74-kube-api-access-dtb68\") pod \"limitador-operator-controller-manager-859d7b78bd-hhqng\" (UID: \"53b7e07c-125f-4528-9d5e-0dbe45216d74\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hhqng"
Jul 20 12:51:51.256937 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:51.256869    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rc8qm"
Jul 20 12:51:51.260072 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:51:51.260042    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rc8qm\" is forbidden: User \"system:node:ip-10-0-139-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-1.ec2.internal' and this object" podUID="6a8f9a19-4e46-4a78-8957-f3baa1461c70" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rc8qm"
Jul 20 12:51:51.289570 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:51.289526    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtb68\" (UniqueName: \"kubernetes.io/projected/53b7e07c-125f-4528-9d5e-0dbe45216d74-kube-api-access-dtb68\") pod \"limitador-operator-controller-manager-859d7b78bd-hhqng\" (UID: \"53b7e07c-125f-4528-9d5e-0dbe45216d74\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hhqng"
Jul 20 12:51:51.304448 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:51.304413    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtb68\" (UniqueName: \"kubernetes.io/projected/53b7e07c-125f-4528-9d5e-0dbe45216d74-kube-api-access-dtb68\") pod \"limitador-operator-controller-manager-859d7b78bd-hhqng\" (UID: \"53b7e07c-125f-4528-9d5e-0dbe45216d74\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hhqng"
Jul 20 12:51:51.372042 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:51.371997    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hhqng"
Jul 20 12:51:51.390905 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:51.390874    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a8f9a19-4e46-4a78-8957-f3baa1461c70-extensions-socket-volume\") pod \"6a8f9a19-4e46-4a78-8957-f3baa1461c70\" (UID: \"6a8f9a19-4e46-4a78-8957-f3baa1461c70\") "
Jul 20 12:51:51.391063 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:51.390923    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6rmw4\" (UniqueName: \"kubernetes.io/projected/6a8f9a19-4e46-4a78-8957-f3baa1461c70-kube-api-access-6rmw4\") pod \"6a8f9a19-4e46-4a78-8957-f3baa1461c70\" (UID: \"6a8f9a19-4e46-4a78-8957-f3baa1461c70\") "
Jul 20 12:51:51.391350 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:51.391325    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a8f9a19-4e46-4a78-8957-f3baa1461c70-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6a8f9a19-4e46-4a78-8957-f3baa1461c70" (UID: "6a8f9a19-4e46-4a78-8957-f3baa1461c70"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 12:51:51.393057 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:51.393035    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a8f9a19-4e46-4a78-8957-f3baa1461c70-kube-api-access-6rmw4" (OuterVolumeSpecName: "kube-api-access-6rmw4") pod "6a8f9a19-4e46-4a78-8957-f3baa1461c70" (UID: "6a8f9a19-4e46-4a78-8957-f3baa1461c70"). InnerVolumeSpecName "kube-api-access-6rmw4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 12:51:51.492261 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:51.492225    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rmw4\" (UniqueName: \"kubernetes.io/projected/6a8f9a19-4e46-4a78-8957-f3baa1461c70-kube-api-access-6rmw4\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:51:51.492261 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:51.492257    2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a8f9a19-4e46-4a78-8957-f3baa1461c70-extensions-socket-volume\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:51:51.539021 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:51.538992    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hhqng"]
Jul 20 12:51:51.540054 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:51:51.540011    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53b7e07c_125f_4528_9d5e_0dbe45216d74.slice/crio-bb32e23202eca38a9b232df88ebac93f6322a22c2e48359a4ae0cb22a9a959fc WatchSource:0}: Error finding container bb32e23202eca38a9b232df88ebac93f6322a22c2e48359a4ae0cb22a9a959fc: Status 404 returned error can't find the container with id bb32e23202eca38a9b232df88ebac93f6322a22c2e48359a4ae0cb22a9a959fc
Jul 20 12:51:51.808669 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:51.808570    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a8f9a19-4e46-4a78-8957-f3baa1461c70" path="/var/lib/kubelet/pods/6a8f9a19-4e46-4a78-8957-f3baa1461c70/volumes"
Jul 20 12:51:52.041727 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:52.041689    2570 generic.go:356] "Generic (PLEG): container finished" podID="6a8f9a19-4e46-4a78-8957-f3baa1461c70" containerID="3160d07024a17a1a7a25e722645395f6fcec7f0502ff28c8f400d3059c5f2b9b" exitCode=0
Jul 20 12:51:52.042197 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:52.041767    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rc8qm"
Jul 20 12:51:52.042197 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:52.041812    2570 scope.go:117] "RemoveContainer" containerID="3160d07024a17a1a7a25e722645395f6fcec7f0502ff28c8f400d3059c5f2b9b"
Jul 20 12:51:52.044256 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:52.044148    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hhqng" event={"ID":"53b7e07c-125f-4528-9d5e-0dbe45216d74","Type":"ContainerStarted","Data":"bb32e23202eca38a9b232df88ebac93f6322a22c2e48359a4ae0cb22a9a959fc"}
Jul 20 12:51:52.057625 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:52.057595    2570 scope.go:117] "RemoveContainer" containerID="3160d07024a17a1a7a25e722645395f6fcec7f0502ff28c8f400d3059c5f2b9b"
Jul 20 12:51:52.058041 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:51:52.058013    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3160d07024a17a1a7a25e722645395f6fcec7f0502ff28c8f400d3059c5f2b9b\": container with ID starting with 3160d07024a17a1a7a25e722645395f6fcec7f0502ff28c8f400d3059c5f2b9b not found: ID does not exist" containerID="3160d07024a17a1a7a25e722645395f6fcec7f0502ff28c8f400d3059c5f2b9b"
Jul 20 12:51:52.058155 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:52.058056    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3160d07024a17a1a7a25e722645395f6fcec7f0502ff28c8f400d3059c5f2b9b"} err="failed to get container status \"3160d07024a17a1a7a25e722645395f6fcec7f0502ff28c8f400d3059c5f2b9b\": rpc error: code = NotFound desc = could not find container \"3160d07024a17a1a7a25e722645395f6fcec7f0502ff28c8f400d3059c5f2b9b\": container with ID starting with 3160d07024a17a1a7a25e722645395f6fcec7f0502ff28c8f400d3059c5f2b9b not found: ID does not exist"
Jul 20 12:51:53.050913 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:53.050812    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hhqng" event={"ID":"53b7e07c-125f-4528-9d5e-0dbe45216d74","Type":"ContainerStarted","Data":"88575e6cbe2883ba2d977aeb523bd39eb51f6ac76823ac8dbaac925a40fef585"}
Jul 20 12:51:53.050913 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:53.050893    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hhqng"
Jul 20 12:51:53.086867 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:53.086808    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hhqng" podStartSLOduration=0.86951325 podStartE2EDuration="2.086790684s" totalImagesPullingTime="1.217277434s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:51:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:51:53.086195485 +0000 UTC m=+425.841244861" watchObservedRunningTime="2026-07-20 12:51:53.086790684 +0000 UTC m=+425.841840058"
Jul 20 12:51:55.043617 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:55.043570    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-544cff9648-cl7tb" podUID="29ff3c94-5680-4e80-bac9-3677175508c4" containerName="console" containerID="cri-o://6d692d2d6d77ef1dd62dc2255a1ded2960d8a495077427fd5910fa9248e71cb5" gracePeriod=15
Jul 20 12:51:55.297121 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:55.297033    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-544cff9648-cl7tb"
Jul 20 12:51:55.327429 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:55.327397    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/29ff3c94-5680-4e80-bac9-3677175508c4-console-oauth-config\") pod \"29ff3c94-5680-4e80-bac9-3677175508c4\" (UID: \"29ff3c94-5680-4e80-bac9-3677175508c4\") "
Jul 20 12:51:55.327617 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:55.327468    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/29ff3c94-5680-4e80-bac9-3677175508c4-console-serving-cert\") pod \"29ff3c94-5680-4e80-bac9-3677175508c4\" (UID: \"29ff3c94-5680-4e80-bac9-3677175508c4\") "
Jul 20 12:51:55.327617 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:55.327486    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/29ff3c94-5680-4e80-bac9-3677175508c4-service-ca\") pod \"29ff3c94-5680-4e80-bac9-3677175508c4\" (UID: \"29ff3c94-5680-4e80-bac9-3677175508c4\") "
Jul 20 12:51:55.327617 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:55.327580    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w5tdr\" (UniqueName: \"kubernetes.io/projected/29ff3c94-5680-4e80-bac9-3677175508c4-kube-api-access-w5tdr\") pod \"29ff3c94-5680-4e80-bac9-3677175508c4\" (UID: \"29ff3c94-5680-4e80-bac9-3677175508c4\") "
Jul 20 12:51:55.327791 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:55.327617    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29ff3c94-5680-4e80-bac9-3677175508c4-trusted-ca-bundle\") pod \"29ff3c94-5680-4e80-bac9-3677175508c4\" (UID: \"29ff3c94-5680-4e80-bac9-3677175508c4\") "
Jul 20 12:51:55.327791 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:55.327709    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/29ff3c94-5680-4e80-bac9-3677175508c4-console-config\") pod \"29ff3c94-5680-4e80-bac9-3677175508c4\" (UID: \"29ff3c94-5680-4e80-bac9-3677175508c4\") "
Jul 20 12:51:55.327791 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:55.327742    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/29ff3c94-5680-4e80-bac9-3677175508c4-oauth-serving-cert\") pod \"29ff3c94-5680-4e80-bac9-3677175508c4\" (UID: \"29ff3c94-5680-4e80-bac9-3677175508c4\") "
Jul 20 12:51:55.327954 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:55.327871    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29ff3c94-5680-4e80-bac9-3677175508c4-service-ca" (OuterVolumeSpecName: "service-ca") pod "29ff3c94-5680-4e80-bac9-3677175508c4" (UID: "29ff3c94-5680-4e80-bac9-3677175508c4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 12:51:55.328180 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:55.328159    2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/29ff3c94-5680-4e80-bac9-3677175508c4-service-ca\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:51:55.328274 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:55.328201    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29ff3c94-5680-4e80-bac9-3677175508c4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "29ff3c94-5680-4e80-bac9-3677175508c4" (UID: "29ff3c94-5680-4e80-bac9-3677175508c4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 12:51:55.328274 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:55.328118    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29ff3c94-5680-4e80-bac9-3677175508c4-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "29ff3c94-5680-4e80-bac9-3677175508c4" (UID: "29ff3c94-5680-4e80-bac9-3677175508c4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 12:51:55.328398 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:55.328297    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29ff3c94-5680-4e80-bac9-3677175508c4-console-config" (OuterVolumeSpecName: "console-config") pod "29ff3c94-5680-4e80-bac9-3677175508c4" (UID: "29ff3c94-5680-4e80-bac9-3677175508c4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 12:51:55.329787 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:55.329762    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29ff3c94-5680-4e80-bac9-3677175508c4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "29ff3c94-5680-4e80-bac9-3677175508c4" (UID: "29ff3c94-5680-4e80-bac9-3677175508c4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 12:51:55.329876 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:55.329832    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29ff3c94-5680-4e80-bac9-3677175508c4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "29ff3c94-5680-4e80-bac9-3677175508c4" (UID: "29ff3c94-5680-4e80-bac9-3677175508c4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 12:51:55.330301 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:55.330277    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29ff3c94-5680-4e80-bac9-3677175508c4-kube-api-access-w5tdr" (OuterVolumeSpecName: "kube-api-access-w5tdr") pod "29ff3c94-5680-4e80-bac9-3677175508c4" (UID: "29ff3c94-5680-4e80-bac9-3677175508c4"). InnerVolumeSpecName "kube-api-access-w5tdr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 12:51:55.429456 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:55.429404    2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/29ff3c94-5680-4e80-bac9-3677175508c4-oauth-serving-cert\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:51:55.429456 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:55.429438    2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/29ff3c94-5680-4e80-bac9-3677175508c4-console-oauth-config\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:51:55.429456 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:55.429448    2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/29ff3c94-5680-4e80-bac9-3677175508c4-console-serving-cert\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:51:55.429456 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:55.429457    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5tdr\" (UniqueName: \"kubernetes.io/projected/29ff3c94-5680-4e80-bac9-3677175508c4-kube-api-access-w5tdr\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:51:55.429456 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:55.429466    2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29ff3c94-5680-4e80-bac9-3677175508c4-trusted-ca-bundle\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:51:55.429758 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:55.429476    2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/29ff3c94-5680-4e80-bac9-3677175508c4-console-config\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:51:56.068965 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:56.068869    2570 generic.go:356] "Generic (PLEG): container finished" podID="29ff3c94-5680-4e80-bac9-3677175508c4" containerID="6d692d2d6d77ef1dd62dc2255a1ded2960d8a495077427fd5910fa9248e71cb5" exitCode=0
Jul 20 12:51:56.068965 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:56.068920    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-544cff9648-cl7tb"
Jul 20 12:51:56.069441 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:56.068956    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-544cff9648-cl7tb" event={"ID":"29ff3c94-5680-4e80-bac9-3677175508c4","Type":"ContainerDied","Data":"6d692d2d6d77ef1dd62dc2255a1ded2960d8a495077427fd5910fa9248e71cb5"}
Jul 20 12:51:56.069441 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:56.069016    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-544cff9648-cl7tb" event={"ID":"29ff3c94-5680-4e80-bac9-3677175508c4","Type":"ContainerDied","Data":"8ec6488a0df40e545baedb08b16792ecf35b348a0b15628d061429a35e1bf1e4"}
Jul 20 12:51:56.069441 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:56.069036    2570 scope.go:117] "RemoveContainer" containerID="6d692d2d6d77ef1dd62dc2255a1ded2960d8a495077427fd5910fa9248e71cb5"
Jul 20 12:51:56.077996 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:56.077954    2570 scope.go:117] "RemoveContainer" containerID="6d692d2d6d77ef1dd62dc2255a1ded2960d8a495077427fd5910fa9248e71cb5"
Jul 20 12:51:56.078313 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:51:56.078279    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d692d2d6d77ef1dd62dc2255a1ded2960d8a495077427fd5910fa9248e71cb5\": container with ID starting with 6d692d2d6d77ef1dd62dc2255a1ded2960d8a495077427fd5910fa9248e71cb5 not found: ID does not exist" containerID="6d692d2d6d77ef1dd62dc2255a1ded2960d8a495077427fd5910fa9248e71cb5"
Jul 20 12:51:56.078423 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:56.078322    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d692d2d6d77ef1dd62dc2255a1ded2960d8a495077427fd5910fa9248e71cb5"} err="failed to get container status \"6d692d2d6d77ef1dd62dc2255a1ded2960d8a495077427fd5910fa9248e71cb5\": rpc error: code = NotFound desc = could not find container \"6d692d2d6d77ef1dd62dc2255a1ded2960d8a495077427fd5910fa9248e71cb5\": container with ID starting with 6d692d2d6d77ef1dd62dc2255a1ded2960d8a495077427fd5910fa9248e71cb5 not found: ID does not exist"
Jul 20 12:51:56.116724 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:56.116675    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-544cff9648-cl7tb"]
Jul 20 12:51:56.123222 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:56.123187    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-544cff9648-cl7tb"]
Jul 20 12:51:57.807973 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:51:57.807939    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29ff3c94-5680-4e80-bac9-3677175508c4" path="/var/lib/kubelet/pods/29ff3c94-5680-4e80-bac9-3677175508c4/volumes"
Jul 20 12:52:04.060414 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:52:04.060377    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hhqng"
Jul 20 12:52:39.285879 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:52:39.285794    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-gbtw8"]
Jul 20 12:52:39.286362 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:52:39.286172    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29ff3c94-5680-4e80-bac9-3677175508c4" containerName="console"
Jul 20 12:52:39.286362 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:52:39.286183    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="29ff3c94-5680-4e80-bac9-3677175508c4" containerName="console"
Jul 20 12:52:39.286362 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:52:39.286249    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="29ff3c94-5680-4e80-bac9-3677175508c4" containerName="console"
Jul 20 12:52:39.291706 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:52:39.291679    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-gbtw8"
Jul 20 12:52:39.295521 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:52:39.295496    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-4w4r7\""
Jul 20 12:52:39.304817 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:52:39.304789    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-gbtw8"]
Jul 20 12:52:39.417168 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:52:39.417133    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84qsf\" (UniqueName: \"kubernetes.io/projected/457df563-243c-4c94-9c35-d41e620320ad-kube-api-access-84qsf\") pod \"authorino-58cd955675-gbtw8\" (UID: \"457df563-243c-4c94-9c35-d41e620320ad\") " pod="kuadrant-system/authorino-58cd955675-gbtw8"
Jul 20 12:52:39.518438 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:52:39.518393    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84qsf\" (UniqueName: \"kubernetes.io/projected/457df563-243c-4c94-9c35-d41e620320ad-kube-api-access-84qsf\") pod \"authorino-58cd955675-gbtw8\" (UID: \"457df563-243c-4c94-9c35-d41e620320ad\") " pod="kuadrant-system/authorino-58cd955675-gbtw8"
Jul 20 12:52:39.527526 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:52:39.527499    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84qsf\" (UniqueName: \"kubernetes.io/projected/457df563-243c-4c94-9c35-d41e620320ad-kube-api-access-84qsf\") pod \"authorino-58cd955675-gbtw8\" (UID: \"457df563-243c-4c94-9c35-d41e620320ad\") " pod="kuadrant-system/authorino-58cd955675-gbtw8"
Jul 20 12:52:39.555556 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:52:39.555473    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-hwh22"]
Jul 20 12:52:39.559684 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:52:39.559664    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hwh22"
Jul 20 12:52:39.566263 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:52:39.566231    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hwh22"]
Jul 20 12:52:39.601789 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:52:39.601746    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-gbtw8"
Jul 20 12:52:39.720674 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:52:39.720641    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4shr\" (UniqueName: \"kubernetes.io/projected/74853279-0e1b-48b0-a3e0-928e0a771ddc-kube-api-access-j4shr\") pod \"authorino-75d556bd77-hwh22\" (UID: \"74853279-0e1b-48b0-a3e0-928e0a771ddc\") " pod="kuadrant-system/authorino-75d556bd77-hwh22"
Jul 20 12:52:39.742233 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:52:39.742207    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-gbtw8"]
Jul 20 12:52:39.743891 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:52:39.743866    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod457df563_243c_4c94_9c35_d41e620320ad.slice/crio-803717c2149a836fc3590a4087c07c3fc2e494be5830ab132b7aef3853537c8d WatchSource:0}: Error finding container 803717c2149a836fc3590a4087c07c3fc2e494be5830ab132b7aef3853537c8d: Status 404 returned error can't find the container with id 803717c2149a836fc3590a4087c07c3fc2e494be5830ab132b7aef3853537c8d
Jul 20 12:52:39.821319 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:52:39.821290    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4shr\" (UniqueName: \"kubernetes.io/projected/74853279-0e1b-48b0-a3e0-928e0a771ddc-kube-api-access-j4shr\") pod \"authorino-75d556bd77-hwh22\" (UID: \"74853279-0e1b-48b0-a3e0-928e0a771ddc\") " pod="kuadrant-system/authorino-75d556bd77-hwh22"
Jul 20 12:52:39.831829 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:52:39.831796    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4shr\" (UniqueName: \"kubernetes.io/projected/74853279-0e1b-48b0-a3e0-928e0a771ddc-kube-api-access-j4shr\") pod \"authorino-75d556bd77-hwh22\" (UID: \"74853279-0e1b-48b0-a3e0-928e0a771ddc\") " pod="kuadrant-system/authorino-75d556bd77-hwh22"
Jul 20 12:52:39.871255 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:52:39.871217    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hwh22"
Jul 20 12:52:40.012693 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:52:40.012669    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hwh22"]
Jul 20 12:52:40.014052 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:52:40.014019    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod74853279_0e1b_48b0_a3e0_928e0a771ddc.slice/crio-00aacd3d424a0d7529bda7105bda71db0e79e4008222775e68d6a8db99aab3ca WatchSource:0}: Error finding container 00aacd3d424a0d7529bda7105bda71db0e79e4008222775e68d6a8db99aab3ca: Status 404 returned error can't find the container with id 00aacd3d424a0d7529bda7105bda71db0e79e4008222775e68d6a8db99aab3ca
Jul 20 12:52:40.308264 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:52:40.308225    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hwh22" event={"ID":"74853279-0e1b-48b0-a3e0-928e0a771ddc","Type":"ContainerStarted","Data":"00aacd3d424a0d7529bda7105bda71db0e79e4008222775e68d6a8db99aab3ca"}
Jul 20 12:52:40.309468 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:52:40.309442    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-gbtw8" event={"ID":"457df563-243c-4c94-9c35-d41e620320ad","Type":"ContainerStarted","Data":"803717c2149a836fc3590a4087c07c3fc2e494be5830ab132b7aef3853537c8d"}
Jul 20 12:52:43.329807 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:52:43.329771    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hwh22" event={"ID":"74853279-0e1b-48b0-a3e0-928e0a771ddc","Type":"ContainerStarted","Data":"481df2e53ee58a32c7777f46e0cf30fc5b23cd9ad6b6c299a7f2c133c88b52ef"}
Jul 20 12:52:43.331549 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:52:43.331521    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-gbtw8" event={"ID":"457df563-243c-4c94-9c35-d41e620320ad","Type":"ContainerStarted","Data":"94b94a9aab41717be263ef86a09dc14c4ad815c9bd38aadbe15efe7f532cbc20"}
Jul 20 12:52:43.349966 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:52:43.349908    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-hwh22" podStartSLOduration=1.109288499 podStartE2EDuration="4.349887566s" totalImagesPullingTime="3.240599067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:52:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:52:43.34754021 +0000 UTC m=+476.102589664" watchObservedRunningTime="2026-07-20 12:52:43.349887566 +0000 UTC m=+476.104936941"
Jul 20 12:52:43.367535 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:52:43.367477    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-gbtw8" podStartSLOduration=0.844758886 podStartE2EDuration="4.367459253s" totalImagesPullingTime="3.522700367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:52:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:52:43.366823772 +0000 UTC m=+476.121873148" watchObservedRunningTime="2026-07-20 12:52:43.367459253 +0000 UTC m=+476.122508628"
Jul 20 12:52:43.377968 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:52:43.377919    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-gbtw8"]
Jul 20 12:52:45.341882 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:52:45.341838    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-gbtw8" podUID="457df563-243c-4c94-9c35-d41e620320ad" containerName="authorino" containerID="cri-o://94b94a9aab41717be263ef86a09dc14c4ad815c9bd38aadbe15efe7f532cbc20" gracePeriod=30
Jul 20 12:52:45.583609 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:52:45.583580    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-gbtw8"
Jul 20 12:52:45.676231 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:52:45.676134    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84qsf\" (UniqueName: \"kubernetes.io/projected/457df563-243c-4c94-9c35-d41e620320ad-kube-api-access-84qsf\") pod \"457df563-243c-4c94-9c35-d41e620320ad\" (UID: \"457df563-243c-4c94-9c35-d41e620320ad\") "
Jul 20 12:52:45.678153 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:52:45.678124    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/457df563-243c-4c94-9c35-d41e620320ad-kube-api-access-84qsf" (OuterVolumeSpecName: "kube-api-access-84qsf") pod "457df563-243c-4c94-9c35-d41e620320ad" (UID: "457df563-243c-4c94-9c35-d41e620320ad"). InnerVolumeSpecName "kube-api-access-84qsf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 12:52:45.777724 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:52:45.777679    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84qsf\" (UniqueName: \"kubernetes.io/projected/457df563-243c-4c94-9c35-d41e620320ad-kube-api-access-84qsf\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:52:46.349066 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:52:46.349026    2570 generic.go:356] "Generic (PLEG): container finished" podID="457df563-243c-4c94-9c35-d41e620320ad" containerID="94b94a9aab41717be263ef86a09dc14c4ad815c9bd38aadbe15efe7f532cbc20" exitCode=0
Jul 20 12:52:46.349577 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:52:46.349114    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-gbtw8" event={"ID":"457df563-243c-4c94-9c35-d41e620320ad","Type":"ContainerDied","Data":"94b94a9aab41717be263ef86a09dc14c4ad815c9bd38aadbe15efe7f532cbc20"}
Jul 20 12:52:46.349577 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:52:46.349120    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-gbtw8"
Jul 20 12:52:46.349577 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:52:46.349147    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-gbtw8" event={"ID":"457df563-243c-4c94-9c35-d41e620320ad","Type":"ContainerDied","Data":"803717c2149a836fc3590a4087c07c3fc2e494be5830ab132b7aef3853537c8d"}
Jul 20 12:52:46.349577 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:52:46.349166    2570 scope.go:117] "RemoveContainer" containerID="94b94a9aab41717be263ef86a09dc14c4ad815c9bd38aadbe15efe7f532cbc20"
Jul 20 12:52:46.358856 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:52:46.358838    2570 scope.go:117] "RemoveContainer" containerID="94b94a9aab41717be263ef86a09dc14c4ad815c9bd38aadbe15efe7f532cbc20"
Jul 20 12:52:46.359176 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:52:46.359155    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94b94a9aab41717be263ef86a09dc14c4ad815c9bd38aadbe15efe7f532cbc20\": container with ID starting with 94b94a9aab41717be263ef86a09dc14c4ad815c9bd38aadbe15efe7f532cbc20 not found: ID does not exist" containerID="94b94a9aab41717be263ef86a09dc14c4ad815c9bd38aadbe15efe7f532cbc20"
Jul 20 12:52:46.359254 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:52:46.359189    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94b94a9aab41717be263ef86a09dc14c4ad815c9bd38aadbe15efe7f532cbc20"} err="failed to get container status \"94b94a9aab41717be263ef86a09dc14c4ad815c9bd38aadbe15efe7f532cbc20\": rpc error: code = NotFound desc = could not find container \"94b94a9aab41717be263ef86a09dc14c4ad815c9bd38aadbe15efe7f532cbc20\": container with ID starting with 94b94a9aab41717be263ef86a09dc14c4ad815c9bd38aadbe15efe7f532cbc20 not found: ID does not exist"
Jul 20 12:52:46.372709 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:52:46.372672    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-gbtw8"]
Jul 20 12:52:46.376920 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:52:46.376888    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-gbtw8"]
Jul 20 12:52:47.808032 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:52:47.807993    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="457df563-243c-4c94-9c35-d41e620320ad" path="/var/lib/kubelet/pods/457df563-243c-4c94-9c35-d41e620320ad/volumes"
Jul 20 12:53:13.154395 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:13.154357    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dfwvn"]
Jul 20 12:53:13.154911 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:13.154737    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="457df563-243c-4c94-9c35-d41e620320ad" containerName="authorino"
Jul 20 12:53:13.154911 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:13.154750    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="457df563-243c-4c94-9c35-d41e620320ad" containerName="authorino"
Jul 20 12:53:13.154911 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:13.154815    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="457df563-243c-4c94-9c35-d41e620320ad" containerName="authorino"
Jul 20 12:53:13.157825 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:13.157805    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-dfwvn"
Jul 20 12:53:13.168803 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:13.168776    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dfwvn"]
Jul 20 12:53:13.219258 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:13.219219    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hlkp\" (UniqueName: \"kubernetes.io/projected/68bce3ad-697d-4a79-a2db-5d5918720928-kube-api-access-5hlkp\") pod \"authorino-5d4b67c446-dfwvn\" (UID: \"68bce3ad-697d-4a79-a2db-5d5918720928\") " pod="kuadrant-system/authorino-5d4b67c446-dfwvn"
Jul 20 12:53:13.320158 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:13.320112    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hlkp\" (UniqueName: \"kubernetes.io/projected/68bce3ad-697d-4a79-a2db-5d5918720928-kube-api-access-5hlkp\") pod \"authorino-5d4b67c446-dfwvn\" (UID: \"68bce3ad-697d-4a79-a2db-5d5918720928\") " pod="kuadrant-system/authorino-5d4b67c446-dfwvn"
Jul 20 12:53:13.329347 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:13.329320    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hlkp\" (UniqueName: \"kubernetes.io/projected/68bce3ad-697d-4a79-a2db-5d5918720928-kube-api-access-5hlkp\") pod \"authorino-5d4b67c446-dfwvn\" (UID: \"68bce3ad-697d-4a79-a2db-5d5918720928\") " pod="kuadrant-system/authorino-5d4b67c446-dfwvn"
Jul 20 12:53:13.412956 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:13.412861    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dfwvn"]
Jul 20 12:53:13.413213 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:13.413194    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-dfwvn"
Jul 20 12:53:13.443666 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:13.443629    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-69bdb67bd9-bq9bp"]
Jul 20 12:53:13.447646 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:13.447624    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69bdb67bd9-bq9bp"
Jul 20 12:53:13.456225 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:13.455972    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-69bdb67bd9-bq9bp"]
Jul 20 12:53:13.521497 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:13.521453    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64b7h\" (UniqueName: \"kubernetes.io/projected/183b3702-6363-4629-bebf-488fe70cf079-kube-api-access-64b7h\") pod \"authorino-69bdb67bd9-bq9bp\" (UID: \"183b3702-6363-4629-bebf-488fe70cf079\") " pod="kuadrant-system/authorino-69bdb67bd9-bq9bp"
Jul 20 12:53:13.550524 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:13.550489    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-69bdb67bd9-bq9bp"]
Jul 20 12:53:13.550801 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:53:13.550779    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-64b7h], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-69bdb67bd9-bq9bp" podUID="183b3702-6363-4629-bebf-488fe70cf079"
Jul 20 12:53:13.561291 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:13.561259    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dfwvn"]
Jul 20 12:53:13.562999 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:53:13.562966    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod68bce3ad_697d_4a79_a2db_5d5918720928.slice/crio-21e8973f5569b7d3ff204386651e141171937d0aa7a0dc59926f396dd4e97583 WatchSource:0}: Error finding container 21e8973f5569b7d3ff204386651e141171937d0aa7a0dc59926f396dd4e97583: Status 404 returned error can't find the container with id 21e8973f5569b7d3ff204386651e141171937d0aa7a0dc59926f396dd4e97583
Jul 20 12:53:13.587100 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:13.587062    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-575c76944f-rx92s"]
Jul 20 12:53:13.590652 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:13.590632    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-575c76944f-rx92s"
Jul 20 12:53:13.593701 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:13.593676    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 20 12:53:13.598764 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:13.598605    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-575c76944f-rx92s"]
Jul 20 12:53:13.622430 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:13.622371    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64b7h\" (UniqueName: \"kubernetes.io/projected/183b3702-6363-4629-bebf-488fe70cf079-kube-api-access-64b7h\") pod \"authorino-69bdb67bd9-bq9bp\" (UID: \"183b3702-6363-4629-bebf-488fe70cf079\") " pod="kuadrant-system/authorino-69bdb67bd9-bq9bp"
Jul 20 12:53:13.632268 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:13.632233    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64b7h\" (UniqueName: \"kubernetes.io/projected/183b3702-6363-4629-bebf-488fe70cf079-kube-api-access-64b7h\") pod \"authorino-69bdb67bd9-bq9bp\" (UID: \"183b3702-6363-4629-bebf-488fe70cf079\") " pod="kuadrant-system/authorino-69bdb67bd9-bq9bp"
Jul 20 12:53:13.723556 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:13.723453    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/29e61265-7d72-47e2-99ca-747c52c0c783-tls-cert\") pod \"authorino-575c76944f-rx92s\" (UID: \"29e61265-7d72-47e2-99ca-747c52c0c783\") " pod="kuadrant-system/authorino-575c76944f-rx92s"
Jul 20 12:53:13.723556 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:13.723537    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9phc\" (UniqueName: \"kubernetes.io/projected/29e61265-7d72-47e2-99ca-747c52c0c783-kube-api-access-s9phc\") pod \"authorino-575c76944f-rx92s\" (UID: \"29e61265-7d72-47e2-99ca-747c52c0c783\") " pod="kuadrant-system/authorino-575c76944f-rx92s"
Jul 20 12:53:13.825034 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:13.824985    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/29e61265-7d72-47e2-99ca-747c52c0c783-tls-cert\") pod \"authorino-575c76944f-rx92s\" (UID: \"29e61265-7d72-47e2-99ca-747c52c0c783\") " pod="kuadrant-system/authorino-575c76944f-rx92s"
Jul 20 12:53:13.825269 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:13.825066    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9phc\" (UniqueName: \"kubernetes.io/projected/29e61265-7d72-47e2-99ca-747c52c0c783-kube-api-access-s9phc\") pod \"authorino-575c76944f-rx92s\" (UID: \"29e61265-7d72-47e2-99ca-747c52c0c783\") " pod="kuadrant-system/authorino-575c76944f-rx92s"
Jul 20 12:53:13.827517 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:13.827493    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/29e61265-7d72-47e2-99ca-747c52c0c783-tls-cert\") pod \"authorino-575c76944f-rx92s\" (UID: \"29e61265-7d72-47e2-99ca-747c52c0c783\") " pod="kuadrant-system/authorino-575c76944f-rx92s"
Jul 20 12:53:13.833905 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:13.833879    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9phc\" (UniqueName: \"kubernetes.io/projected/29e61265-7d72-47e2-99ca-747c52c0c783-kube-api-access-s9phc\") pod \"authorino-575c76944f-rx92s\" (UID: \"29e61265-7d72-47e2-99ca-747c52c0c783\") " pod="kuadrant-system/authorino-575c76944f-rx92s"
Jul 20 12:53:13.901588 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:13.901544    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-575c76944f-rx92s"
Jul 20 12:53:14.046915 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:14.046887    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-575c76944f-rx92s"]
Jul 20 12:53:14.048733 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:53:14.048703    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod29e61265_7d72_47e2_99ca_747c52c0c783.slice/crio-4e5b5e33b094a098ee988bd2117aac2afb91572b477acd4675d18c1ab1718527 WatchSource:0}: Error finding container 4e5b5e33b094a098ee988bd2117aac2afb91572b477acd4675d18c1ab1718527: Status 404 returned error can't find the container with id 4e5b5e33b094a098ee988bd2117aac2afb91572b477acd4675d18c1ab1718527
Jul 20 12:53:14.503223 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:14.503182    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-dfwvn" event={"ID":"68bce3ad-697d-4a79-a2db-5d5918720928","Type":"ContainerStarted","Data":"bdeb87d0d28c578b90f4f86fcf71d6033aeb41e6ab8331c7da46b47a320eb327"}
Jul 20 12:53:14.503691 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:14.503237    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-dfwvn" event={"ID":"68bce3ad-697d-4a79-a2db-5d5918720928","Type":"ContainerStarted","Data":"21e8973f5569b7d3ff204386651e141171937d0aa7a0dc59926f396dd4e97583"}
Jul 20 12:53:14.503691 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:14.503238    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-dfwvn" podUID="68bce3ad-697d-4a79-a2db-5d5918720928" containerName="authorino" containerID="cri-o://bdeb87d0d28c578b90f4f86fcf71d6033aeb41e6ab8331c7da46b47a320eb327" gracePeriod=30
Jul 20 12:53:14.504818 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:14.504776    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-575c76944f-rx92s" event={"ID":"29e61265-7d72-47e2-99ca-747c52c0c783","Type":"ContainerStarted","Data":"4e5b5e33b094a098ee988bd2117aac2afb91572b477acd4675d18c1ab1718527"}
Jul 20 12:53:14.504950 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:14.504865    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69bdb67bd9-bq9bp"
Jul 20 12:53:14.515494 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:14.515459    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69bdb67bd9-bq9bp"
Jul 20 12:53:14.522543 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:14.522494    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-dfwvn" podStartSLOduration=1.072241225 podStartE2EDuration="1.52246691s" totalImagesPullingTime="450.225685ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:53:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:53:14.520890409 +0000 UTC m=+507.275939786" watchObservedRunningTime="2026-07-20 12:53:14.52246691 +0000 UTC m=+507.277516285"
Jul 20 12:53:14.631174 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:14.631139    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-64b7h\" (UniqueName: \"kubernetes.io/projected/183b3702-6363-4629-bebf-488fe70cf079-kube-api-access-64b7h\") pod \"183b3702-6363-4629-bebf-488fe70cf079\" (UID: \"183b3702-6363-4629-bebf-488fe70cf079\") "
Jul 20 12:53:14.633380 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:14.633348    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/183b3702-6363-4629-bebf-488fe70cf079-kube-api-access-64b7h" (OuterVolumeSpecName: "kube-api-access-64b7h") pod "183b3702-6363-4629-bebf-488fe70cf079" (UID: "183b3702-6363-4629-bebf-488fe70cf079"). InnerVolumeSpecName "kube-api-access-64b7h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 12:53:14.732831 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:14.732743    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-64b7h\" (UniqueName: \"kubernetes.io/projected/183b3702-6363-4629-bebf-488fe70cf079-kube-api-access-64b7h\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:53:14.752276 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:14.752245    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-dfwvn"
Jul 20 12:53:14.833795 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:14.833754    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5hlkp\" (UniqueName: \"kubernetes.io/projected/68bce3ad-697d-4a79-a2db-5d5918720928-kube-api-access-5hlkp\") pod \"68bce3ad-697d-4a79-a2db-5d5918720928\" (UID: \"68bce3ad-697d-4a79-a2db-5d5918720928\") "
Jul 20 12:53:14.835886 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:14.835845    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68bce3ad-697d-4a79-a2db-5d5918720928-kube-api-access-5hlkp" (OuterVolumeSpecName: "kube-api-access-5hlkp") pod "68bce3ad-697d-4a79-a2db-5d5918720928" (UID: "68bce3ad-697d-4a79-a2db-5d5918720928"). InnerVolumeSpecName "kube-api-access-5hlkp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 12:53:14.935404 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:14.935363    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5hlkp\" (UniqueName: \"kubernetes.io/projected/68bce3ad-697d-4a79-a2db-5d5918720928-kube-api-access-5hlkp\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:53:15.511772 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:15.511731    2570 generic.go:356] "Generic (PLEG): container finished" podID="68bce3ad-697d-4a79-a2db-5d5918720928" containerID="bdeb87d0d28c578b90f4f86fcf71d6033aeb41e6ab8331c7da46b47a320eb327" exitCode=0
Jul 20 12:53:15.511772 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:15.511772    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-dfwvn"
Jul 20 12:53:15.512310 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:15.511822    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-dfwvn" event={"ID":"68bce3ad-697d-4a79-a2db-5d5918720928","Type":"ContainerDied","Data":"bdeb87d0d28c578b90f4f86fcf71d6033aeb41e6ab8331c7da46b47a320eb327"}
Jul 20 12:53:15.512310 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:15.511864    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-dfwvn" event={"ID":"68bce3ad-697d-4a79-a2db-5d5918720928","Type":"ContainerDied","Data":"21e8973f5569b7d3ff204386651e141171937d0aa7a0dc59926f396dd4e97583"}
Jul 20 12:53:15.512310 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:15.511881    2570 scope.go:117] "RemoveContainer" containerID="bdeb87d0d28c578b90f4f86fcf71d6033aeb41e6ab8331c7da46b47a320eb327"
Jul 20 12:53:15.513525 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:15.513507    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69bdb67bd9-bq9bp"
Jul 20 12:53:15.513618 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:15.513501    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-575c76944f-rx92s" event={"ID":"29e61265-7d72-47e2-99ca-747c52c0c783","Type":"ContainerStarted","Data":"2377d8df1eb3ae6f5f31b6ef0cc10c7dab633b0d9fabd5f032fc5455c344a751"}
Jul 20 12:53:15.523209 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:15.523164    2570 scope.go:117] "RemoveContainer" containerID="bdeb87d0d28c578b90f4f86fcf71d6033aeb41e6ab8331c7da46b47a320eb327"
Jul 20 12:53:15.523781 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:53:15.523752    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bdeb87d0d28c578b90f4f86fcf71d6033aeb41e6ab8331c7da46b47a320eb327\": container with ID starting with bdeb87d0d28c578b90f4f86fcf71d6033aeb41e6ab8331c7da46b47a320eb327 not found: ID does not exist" containerID="bdeb87d0d28c578b90f4f86fcf71d6033aeb41e6ab8331c7da46b47a320eb327"
Jul 20 12:53:15.523873 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:15.523789    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdeb87d0d28c578b90f4f86fcf71d6033aeb41e6ab8331c7da46b47a320eb327"} err="failed to get container status \"bdeb87d0d28c578b90f4f86fcf71d6033aeb41e6ab8331c7da46b47a320eb327\": rpc error: code = NotFound desc = could not find container \"bdeb87d0d28c578b90f4f86fcf71d6033aeb41e6ab8331c7da46b47a320eb327\": container with ID starting with bdeb87d0d28c578b90f4f86fcf71d6033aeb41e6ab8331c7da46b47a320eb327 not found: ID does not exist"
Jul 20 12:53:15.539322 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:15.539270    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-575c76944f-rx92s" podStartSLOduration=2.134232171 podStartE2EDuration="2.539252764s" totalImagesPullingTime="405.020593ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:53:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:53:15.536351862 +0000 UTC m=+508.291401238" watchObservedRunningTime="2026-07-20 12:53:15.539252764 +0000 UTC m=+508.294302139"
Jul 20 12:53:15.558482 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:15.558438    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dfwvn"]
Jul 20 12:53:15.565339 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:15.565306    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dfwvn"]
Jul 20 12:53:15.571175 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:15.571137    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hwh22"]
Jul 20 12:53:15.571346 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:15.571311    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-hwh22" podUID="74853279-0e1b-48b0-a3e0-928e0a771ddc" containerName="authorino" containerID="cri-o://481df2e53ee58a32c7777f46e0cf30fc5b23cd9ad6b6c299a7f2c133c88b52ef" gracePeriod=30
Jul 20 12:53:15.594517 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:15.594479    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-69bdb67bd9-bq9bp"]
Jul 20 12:53:15.599560 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:15.599526    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-69bdb67bd9-bq9bp"]
Jul 20 12:53:15.808289 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:15.808260    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="183b3702-6363-4629-bebf-488fe70cf079" path="/var/lib/kubelet/pods/183b3702-6363-4629-bebf-488fe70cf079/volumes"
Jul 20 12:53:15.808572 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:15.808558    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68bce3ad-697d-4a79-a2db-5d5918720928" path="/var/lib/kubelet/pods/68bce3ad-697d-4a79-a2db-5d5918720928/volumes"
Jul 20 12:53:15.825293 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:15.825264    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hwh22"
Jul 20 12:53:15.944743 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:15.944655    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j4shr\" (UniqueName: \"kubernetes.io/projected/74853279-0e1b-48b0-a3e0-928e0a771ddc-kube-api-access-j4shr\") pod \"74853279-0e1b-48b0-a3e0-928e0a771ddc\" (UID: \"74853279-0e1b-48b0-a3e0-928e0a771ddc\") "
Jul 20 12:53:15.946860 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:15.946829    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74853279-0e1b-48b0-a3e0-928e0a771ddc-kube-api-access-j4shr" (OuterVolumeSpecName: "kube-api-access-j4shr") pod "74853279-0e1b-48b0-a3e0-928e0a771ddc" (UID: "74853279-0e1b-48b0-a3e0-928e0a771ddc"). InnerVolumeSpecName "kube-api-access-j4shr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 12:53:16.045825 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:16.045778    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4shr\" (UniqueName: \"kubernetes.io/projected/74853279-0e1b-48b0-a3e0-928e0a771ddc-kube-api-access-j4shr\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:53:16.521774 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:16.521725    2570 generic.go:356] "Generic (PLEG): container finished" podID="74853279-0e1b-48b0-a3e0-928e0a771ddc" containerID="481df2e53ee58a32c7777f46e0cf30fc5b23cd9ad6b6c299a7f2c133c88b52ef" exitCode=0
Jul 20 12:53:16.521774 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:16.521764    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hwh22"
Jul 20 12:53:16.522336 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:16.521810    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hwh22" event={"ID":"74853279-0e1b-48b0-a3e0-928e0a771ddc","Type":"ContainerDied","Data":"481df2e53ee58a32c7777f46e0cf30fc5b23cd9ad6b6c299a7f2c133c88b52ef"}
Jul 20 12:53:16.522336 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:16.521860    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hwh22" event={"ID":"74853279-0e1b-48b0-a3e0-928e0a771ddc","Type":"ContainerDied","Data":"00aacd3d424a0d7529bda7105bda71db0e79e4008222775e68d6a8db99aab3ca"}
Jul 20 12:53:16.522336 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:16.521880    2570 scope.go:117] "RemoveContainer" containerID="481df2e53ee58a32c7777f46e0cf30fc5b23cd9ad6b6c299a7f2c133c88b52ef"
Jul 20 12:53:16.531266 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:16.531246    2570 scope.go:117] "RemoveContainer" containerID="481df2e53ee58a32c7777f46e0cf30fc5b23cd9ad6b6c299a7f2c133c88b52ef"
Jul 20 12:53:16.531585 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:53:16.531562    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"481df2e53ee58a32c7777f46e0cf30fc5b23cd9ad6b6c299a7f2c133c88b52ef\": container with ID starting with 481df2e53ee58a32c7777f46e0cf30fc5b23cd9ad6b6c299a7f2c133c88b52ef not found: ID does not exist" containerID="481df2e53ee58a32c7777f46e0cf30fc5b23cd9ad6b6c299a7f2c133c88b52ef"
Jul 20 12:53:16.531640 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:16.531600    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"481df2e53ee58a32c7777f46e0cf30fc5b23cd9ad6b6c299a7f2c133c88b52ef"} err="failed to get container status \"481df2e53ee58a32c7777f46e0cf30fc5b23cd9ad6b6c299a7f2c133c88b52ef\": rpc error: code = NotFound desc = could not find container \"481df2e53ee58a32c7777f46e0cf30fc5b23cd9ad6b6c299a7f2c133c88b52ef\": container with ID starting with 481df2e53ee58a32c7777f46e0cf30fc5b23cd9ad6b6c299a7f2c133c88b52ef not found: ID does not exist"
Jul 20 12:53:16.549109 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:16.546453    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hwh22"]
Jul 20 12:53:16.552935 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:16.552899    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hwh22"]
Jul 20 12:53:17.807823 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:53:17.807788    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74853279-0e1b-48b0-a3e0-928e0a771ddc" path="/var/lib/kubelet/pods/74853279-0e1b-48b0-a3e0-928e0a771ddc/volumes"
Jul 20 12:54:27.223764 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:27.223722    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-224cq"]
Jul 20 12:54:27.224272 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:27.224097    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68bce3ad-697d-4a79-a2db-5d5918720928" containerName="authorino"
Jul 20 12:54:27.224272 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:27.224109    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="68bce3ad-697d-4a79-a2db-5d5918720928" containerName="authorino"
Jul 20 12:54:27.224272 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:27.224124    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74853279-0e1b-48b0-a3e0-928e0a771ddc" containerName="authorino"
Jul 20 12:54:27.224272 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:27.224130    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="74853279-0e1b-48b0-a3e0-928e0a771ddc" containerName="authorino"
Jul 20 12:54:27.224272 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:27.224203    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="68bce3ad-697d-4a79-a2db-5d5918720928" containerName="authorino"
Jul 20 12:54:27.224272 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:27.224212    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="74853279-0e1b-48b0-a3e0-928e0a771ddc" containerName="authorino"
Jul 20 12:54:27.227315 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:27.227293    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-224cq"
Jul 20 12:54:27.231872 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:27.231849    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 20 12:54:27.233754 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:27.233731    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-7sf77\""
Jul 20 12:54:27.233905 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:27.233737    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 20 12:54:27.233905 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:27.233739    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 20 12:54:27.243602 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:27.243573    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-224cq"]
Jul 20 12:54:27.293893 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:27.293854    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8ccf5c0-3f34-4cd7-8d2b-82f3a8a63794-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-224cq\" (UID: \"c8ccf5c0-3f34-4cd7-8d2b-82f3a8a63794\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-224cq"
Jul 20 12:54:27.294121 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:27.293923    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8ccf5c0-3f34-4cd7-8d2b-82f3a8a63794-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-224cq\" (UID: \"c8ccf5c0-3f34-4cd7-8d2b-82f3a8a63794\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-224cq"
Jul 20 12:54:27.294121 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:27.293942    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6bmn\" (UniqueName: \"kubernetes.io/projected/c8ccf5c0-3f34-4cd7-8d2b-82f3a8a63794-kube-api-access-p6bmn\") pod \"e2e-distinct-simulated-kserve-59975d69f9-224cq\" (UID: \"c8ccf5c0-3f34-4cd7-8d2b-82f3a8a63794\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-224cq"
Jul 20 12:54:27.294265 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:27.294067    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8ccf5c0-3f34-4cd7-8d2b-82f3a8a63794-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-224cq\" (UID: \"c8ccf5c0-3f34-4cd7-8d2b-82f3a8a63794\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-224cq"
Jul 20 12:54:27.294265 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:27.294202    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8ccf5c0-3f34-4cd7-8d2b-82f3a8a63794-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-224cq\" (UID: \"c8ccf5c0-3f34-4cd7-8d2b-82f3a8a63794\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-224cq"
Jul 20 12:54:27.294265 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:27.294236    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8ccf5c0-3f34-4cd7-8d2b-82f3a8a63794-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-224cq\" (UID: \"c8ccf5c0-3f34-4cd7-8d2b-82f3a8a63794\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-224cq"
Jul 20 12:54:27.395288 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:27.395249    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8ccf5c0-3f34-4cd7-8d2b-82f3a8a63794-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-224cq\" (UID: \"c8ccf5c0-3f34-4cd7-8d2b-82f3a8a63794\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-224cq"
Jul 20 12:54:27.395478 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:27.395325    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8ccf5c0-3f34-4cd7-8d2b-82f3a8a63794-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-224cq\" (UID: \"c8ccf5c0-3f34-4cd7-8d2b-82f3a8a63794\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-224cq"
Jul 20 12:54:27.395478 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:27.395344    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6bmn\" (UniqueName: \"kubernetes.io/projected/c8ccf5c0-3f34-4cd7-8d2b-82f3a8a63794-kube-api-access-p6bmn\") pod \"e2e-distinct-simulated-kserve-59975d69f9-224cq\" (UID: \"c8ccf5c0-3f34-4cd7-8d2b-82f3a8a63794\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-224cq"
Jul 20 12:54:27.395478 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:27.395395    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8ccf5c0-3f34-4cd7-8d2b-82f3a8a63794-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-224cq\" (UID: \"c8ccf5c0-3f34-4cd7-8d2b-82f3a8a63794\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-224cq"
Jul 20 12:54:27.395478 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:27.395414    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8ccf5c0-3f34-4cd7-8d2b-82f3a8a63794-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-224cq\" (UID: \"c8ccf5c0-3f34-4cd7-8d2b-82f3a8a63794\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-224cq"
Jul 20 12:54:27.395478 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:27.395432    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8ccf5c0-3f34-4cd7-8d2b-82f3a8a63794-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-224cq\" (UID: \"c8ccf5c0-3f34-4cd7-8d2b-82f3a8a63794\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-224cq"
Jul 20 12:54:27.395840 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:27.395811    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8ccf5c0-3f34-4cd7-8d2b-82f3a8a63794-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-224cq\" (UID: \"c8ccf5c0-3f34-4cd7-8d2b-82f3a8a63794\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-224cq"
Jul 20 12:54:27.395902 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:27.395855    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8ccf5c0-3f34-4cd7-8d2b-82f3a8a63794-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-224cq\" (UID: \"c8ccf5c0-3f34-4cd7-8d2b-82f3a8a63794\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-224cq"
Jul 20 12:54:27.395902 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:27.395885    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8ccf5c0-3f34-4cd7-8d2b-82f3a8a63794-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-224cq\" (UID: \"c8ccf5c0-3f34-4cd7-8d2b-82f3a8a63794\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-224cq"
Jul 20 12:54:27.397649 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:27.397627    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8ccf5c0-3f34-4cd7-8d2b-82f3a8a63794-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-224cq\" (UID: \"c8ccf5c0-3f34-4cd7-8d2b-82f3a8a63794\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-224cq"
Jul 20 12:54:27.397822 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:27.397804    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8ccf5c0-3f34-4cd7-8d2b-82f3a8a63794-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-224cq\" (UID: \"c8ccf5c0-3f34-4cd7-8d2b-82f3a8a63794\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-224cq"
Jul 20 12:54:27.406371 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:27.406342    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6bmn\" (UniqueName: \"kubernetes.io/projected/c8ccf5c0-3f34-4cd7-8d2b-82f3a8a63794-kube-api-access-p6bmn\") pod \"e2e-distinct-simulated-kserve-59975d69f9-224cq\" (UID: \"c8ccf5c0-3f34-4cd7-8d2b-82f3a8a63794\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-224cq"
Jul 20 12:54:27.538299 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:27.538205    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-224cq"
Jul 20 12:54:27.682975 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:27.682938    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-224cq"]
Jul 20 12:54:27.686169 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:54:27.686141    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8ccf5c0_3f34_4cd7_8d2b_82f3a8a63794.slice/crio-c721d76f4e433c972b0ffcfd672c50deb541223025b145043b3e09fe976d17e0 WatchSource:0}: Error finding container c721d76f4e433c972b0ffcfd672c50deb541223025b145043b3e09fe976d17e0: Status 404 returned error can't find the container with id c721d76f4e433c972b0ffcfd672c50deb541223025b145043b3e09fe976d17e0
Jul 20 12:54:27.894609 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:27.894564    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-224cq" event={"ID":"c8ccf5c0-3f34-4cd7-8d2b-82f3a8a63794","Type":"ContainerStarted","Data":"c721d76f4e433c972b0ffcfd672c50deb541223025b145043b3e09fe976d17e0"}
Jul 20 12:54:28.901291 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:28.901254    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-224cq" event={"ID":"c8ccf5c0-3f34-4cd7-8d2b-82f3a8a63794","Type":"ContainerStarted","Data":"baad0a0ed7ed90cef1a55e580b35aa188d520b7ef1f5c879ea8a254ae4f68419"}
Jul 20 12:54:28.923286 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:28.923226    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-224cq" podStartSLOduration=0.801844589 podStartE2EDuration="1.923205371s" totalImagesPullingTime="1.121360782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:54:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:54:28.921488451 +0000 UTC m=+581.676537846" watchObservedRunningTime="2026-07-20 12:54:28.923205371 +0000 UTC m=+581.678254747"
Jul 20 12:54:37.538696 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:37.538645    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-224cq"
Jul 20 12:54:37.539134 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:37.538710    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-224cq"
Jul 20 12:54:37.551438 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:37.551404    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-224cq"
Jul 20 12:54:37.961313 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:37.961280    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-224cq"
Jul 20 12:54:47.748981 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:47.748953    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rhdn8_5efe9094-763c-4689-85b7-83e0ccb19811/ovn-acl-logging/0.log"
Jul 20 12:54:47.749461 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:47.749016    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rhdn8_5efe9094-763c-4689-85b7-83e0ccb19811/ovn-acl-logging/0.log"
Jul 20 12:54:51.078493 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:51.078453    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9ljhz"]
Jul 20 12:54:51.082955 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:51.082931    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9ljhz"
Jul 20 12:54:51.089532 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:51.089226    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 20 12:54:51.103933 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:51.103904    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9ljhz"]
Jul 20 12:54:51.130214 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:51.130170    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca588c8d-2c40-445b-a601-84e07f839031-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9ljhz\" (UID: \"ca588c8d-2c40-445b-a601-84e07f839031\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9ljhz"
Jul 20 12:54:51.130214 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:51.130209    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca588c8d-2c40-445b-a601-84e07f839031-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9ljhz\" (UID: \"ca588c8d-2c40-445b-a601-84e07f839031\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9ljhz"
Jul 20 12:54:51.130445 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:51.130238    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca588c8d-2c40-445b-a601-84e07f839031-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9ljhz\" (UID: \"ca588c8d-2c40-445b-a601-84e07f839031\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9ljhz"
Jul 20 12:54:51.130445 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:51.130296    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca588c8d-2c40-445b-a601-84e07f839031-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9ljhz\" (UID: \"ca588c8d-2c40-445b-a601-84e07f839031\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9ljhz"
Jul 20 12:54:51.130445 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:51.130354    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca588c8d-2c40-445b-a601-84e07f839031-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9ljhz\" (UID: \"ca588c8d-2c40-445b-a601-84e07f839031\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9ljhz"
Jul 20 12:54:51.130445 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:51.130381    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8x2j\" (UniqueName: \"kubernetes.io/projected/ca588c8d-2c40-445b-a601-84e07f839031-kube-api-access-r8x2j\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9ljhz\" (UID: \"ca588c8d-2c40-445b-a601-84e07f839031\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9ljhz"
Jul 20 12:54:51.231794 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:51.231754    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca588c8d-2c40-445b-a601-84e07f839031-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9ljhz\" (UID: \"ca588c8d-2c40-445b-a601-84e07f839031\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9ljhz"
Jul 20 12:54:51.231982 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:51.231804    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8x2j\" (UniqueName: \"kubernetes.io/projected/ca588c8d-2c40-445b-a601-84e07f839031-kube-api-access-r8x2j\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9ljhz\" (UID: \"ca588c8d-2c40-445b-a601-84e07f839031\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9ljhz"
Jul 20 12:54:51.231982 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:51.231836    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca588c8d-2c40-445b-a601-84e07f839031-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9ljhz\" (UID: \"ca588c8d-2c40-445b-a601-84e07f839031\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9ljhz"
Jul 20 12:54:51.231982 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:51.231856    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca588c8d-2c40-445b-a601-84e07f839031-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9ljhz\" (UID: \"ca588c8d-2c40-445b-a601-84e07f839031\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9ljhz"
Jul 20 12:54:51.231982 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:51.231882    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca588c8d-2c40-445b-a601-84e07f839031-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9ljhz\" (UID: \"ca588c8d-2c40-445b-a601-84e07f839031\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9ljhz"
Jul 20 12:54:51.231982 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:51.231907    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca588c8d-2c40-445b-a601-84e07f839031-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9ljhz\" (UID: \"ca588c8d-2c40-445b-a601-84e07f839031\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9ljhz"
Jul 20 12:54:51.232317 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:51.232285    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca588c8d-2c40-445b-a601-84e07f839031-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9ljhz\" (UID: \"ca588c8d-2c40-445b-a601-84e07f839031\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9ljhz"
Jul 20 12:54:51.232392 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:51.232337    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca588c8d-2c40-445b-a601-84e07f839031-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9ljhz\" (UID: \"ca588c8d-2c40-445b-a601-84e07f839031\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9ljhz"
Jul 20 12:54:51.232392 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:51.232367    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca588c8d-2c40-445b-a601-84e07f839031-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9ljhz\" (UID: \"ca588c8d-2c40-445b-a601-84e07f839031\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9ljhz"
Jul 20 12:54:51.234210 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:51.234187    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca588c8d-2c40-445b-a601-84e07f839031-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9ljhz\" (UID: \"ca588c8d-2c40-445b-a601-84e07f839031\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9ljhz"
Jul 20 12:54:51.234386 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:51.234368    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca588c8d-2c40-445b-a601-84e07f839031-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9ljhz\" (UID: \"ca588c8d-2c40-445b-a601-84e07f839031\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9ljhz"
Jul 20 12:54:51.240686 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:51.240666    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8x2j\" (UniqueName: \"kubernetes.io/projected/ca588c8d-2c40-445b-a601-84e07f839031-kube-api-access-r8x2j\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9ljhz\" (UID: \"ca588c8d-2c40-445b-a601-84e07f839031\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9ljhz"
Jul 20 12:54:51.393055 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:51.392960    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9ljhz"
Jul 20 12:54:51.534193 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:51.534166    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9ljhz"]
Jul 20 12:54:51.535232 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:54:51.535205    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca588c8d_2c40_445b_a601_84e07f839031.slice/crio-10c1bb1b8a05b58159d133741008459ec898b4fdfa232979f05ed1d30c90dc20 WatchSource:0}: Error finding container 10c1bb1b8a05b58159d133741008459ec898b4fdfa232979f05ed1d30c90dc20: Status 404 returned error can't find the container with id 10c1bb1b8a05b58159d133741008459ec898b4fdfa232979f05ed1d30c90dc20
Jul 20 12:54:52.023689 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:52.023581    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9ljhz" event={"ID":"ca588c8d-2c40-445b-a601-84e07f839031","Type":"ContainerStarted","Data":"e75d81f3538239339aa787476edbc11105293bd2346a77a0bb8ac7c3037d3d85"}
Jul 20 12:54:52.023689 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:52.023648    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9ljhz" event={"ID":"ca588c8d-2c40-445b-a601-84e07f839031","Type":"ContainerStarted","Data":"10c1bb1b8a05b58159d133741008459ec898b4fdfa232979f05ed1d30c90dc20"}
Jul 20 12:54:52.052189 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:54:52.052133    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9ljhz" podStartSLOduration=0.877175989 podStartE2EDuration="1.052116568s" totalImagesPullingTime="174.940579ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:54:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:54:52.048926189 +0000 UTC m=+604.803975579" watchObservedRunningTime="2026-07-20 12:54:52.052116568 +0000 UTC m=+604.807165942"
Jul 20 12:55:01.393491 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:55:01.393452    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9ljhz"
Jul 20 12:55:01.396056 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:55:01.393548    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9ljhz"
Jul 20 12:55:01.406210 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:55:01.406181    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9ljhz"
Jul 20 12:55:02.088284 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:55:02.088253    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9ljhz"
Jul 20 12:55:38.921849 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:55:38.921763    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-57c99db69b-2nsd5"]
Jul 20 12:55:38.925443 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:55:38.925422    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57c99db69b-2nsd5"
Jul 20 12:55:38.937306 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:55:38.937275    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57c99db69b-2nsd5"]
Jul 20 12:55:38.964335 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:55:38.964307    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hq565\" (UniqueName: \"kubernetes.io/projected/0d1869d9-5ed5-4613-84cf-6e55baf96c75-kube-api-access-hq565\") pod \"authorino-57c99db69b-2nsd5\" (UID: \"0d1869d9-5ed5-4613-84cf-6e55baf96c75\") " pod="kuadrant-system/authorino-57c99db69b-2nsd5"
Jul 20 12:55:38.964487 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:55:38.964361    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0d1869d9-5ed5-4613-84cf-6e55baf96c75-tls-cert\") pod \"authorino-57c99db69b-2nsd5\" (UID: \"0d1869d9-5ed5-4613-84cf-6e55baf96c75\") " pod="kuadrant-system/authorino-57c99db69b-2nsd5"
Jul 20 12:55:39.065130 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:55:39.065080    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0d1869d9-5ed5-4613-84cf-6e55baf96c75-tls-cert\") pod \"authorino-57c99db69b-2nsd5\" (UID: \"0d1869d9-5ed5-4613-84cf-6e55baf96c75\") " pod="kuadrant-system/authorino-57c99db69b-2nsd5"
Jul 20 12:55:39.065294 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:55:39.065190    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hq565\" (UniqueName: \"kubernetes.io/projected/0d1869d9-5ed5-4613-84cf-6e55baf96c75-kube-api-access-hq565\") pod \"authorino-57c99db69b-2nsd5\" (UID: \"0d1869d9-5ed5-4613-84cf-6e55baf96c75\") " pod="kuadrant-system/authorino-57c99db69b-2nsd5"
Jul 20 12:55:39.067529 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:55:39.067496    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0d1869d9-5ed5-4613-84cf-6e55baf96c75-tls-cert\") pod \"authorino-57c99db69b-2nsd5\" (UID: \"0d1869d9-5ed5-4613-84cf-6e55baf96c75\") " pod="kuadrant-system/authorino-57c99db69b-2nsd5"
Jul 20 12:55:39.074054 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:55:39.074028    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hq565\" (UniqueName: \"kubernetes.io/projected/0d1869d9-5ed5-4613-84cf-6e55baf96c75-kube-api-access-hq565\") pod \"authorino-57c99db69b-2nsd5\" (UID: \"0d1869d9-5ed5-4613-84cf-6e55baf96c75\") " pod="kuadrant-system/authorino-57c99db69b-2nsd5"
Jul 20 12:55:39.235401 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:55:39.235322    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57c99db69b-2nsd5"
Jul 20 12:55:39.386357 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:55:39.386327    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57c99db69b-2nsd5"]
Jul 20 12:55:39.387261 ip-10-0-139-1 kubenswrapper[2570]: W0720 12:55:39.387230    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d1869d9_5ed5_4613_84cf_6e55baf96c75.slice/crio-39a4f70408970a17ae420cabefc92794654f789b24dc6e3f8f567c192aacd488 WatchSource:0}: Error finding container 39a4f70408970a17ae420cabefc92794654f789b24dc6e3f8f567c192aacd488: Status 404 returned error can't find the container with id 39a4f70408970a17ae420cabefc92794654f789b24dc6e3f8f567c192aacd488
Jul 20 12:55:39.388511 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:55:39.388492    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 12:55:40.283945 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:55:40.283888    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57c99db69b-2nsd5" event={"ID":"0d1869d9-5ed5-4613-84cf-6e55baf96c75","Type":"ContainerStarted","Data":"8a887b86d8478c0b03f27a03ee624eaf736ae4190be544474a67885b5163b40c"}
Jul 20 12:55:40.283945 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:55:40.283942    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57c99db69b-2nsd5" event={"ID":"0d1869d9-5ed5-4613-84cf-6e55baf96c75","Type":"ContainerStarted","Data":"39a4f70408970a17ae420cabefc92794654f789b24dc6e3f8f567c192aacd488"}
Jul 20 12:55:40.307158 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:55:40.307095    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-57c99db69b-2nsd5" podStartSLOduration=1.84502508 podStartE2EDuration="2.307060275s" totalImagesPullingTime="462.035195ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:55:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:55:40.305035021 +0000 UTC m=+653.060084397" watchObservedRunningTime="2026-07-20 12:55:40.307060275 +0000 UTC m=+653.062109651"
Jul 20 12:55:40.345333 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:55:40.345292    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-575c76944f-rx92s"]
Jul 20 12:55:40.345526 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:55:40.345476    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-575c76944f-rx92s" podUID="29e61265-7d72-47e2-99ca-747c52c0c783" containerName="authorino" containerID="cri-o://2377d8df1eb3ae6f5f31b6ef0cc10c7dab633b0d9fabd5f032fc5455c344a751" gracePeriod=30
Jul 20 12:55:40.605533 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:55:40.605506    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-575c76944f-rx92s"
Jul 20 12:55:40.681011 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:55:40.680971    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s9phc\" (UniqueName: \"kubernetes.io/projected/29e61265-7d72-47e2-99ca-747c52c0c783-kube-api-access-s9phc\") pod \"29e61265-7d72-47e2-99ca-747c52c0c783\" (UID: \"29e61265-7d72-47e2-99ca-747c52c0c783\") "
Jul 20 12:55:40.681267 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:55:40.681147    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/29e61265-7d72-47e2-99ca-747c52c0c783-tls-cert\") pod \"29e61265-7d72-47e2-99ca-747c52c0c783\" (UID: \"29e61265-7d72-47e2-99ca-747c52c0c783\") "
Jul 20 12:55:40.683077 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:55:40.683049    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29e61265-7d72-47e2-99ca-747c52c0c783-kube-api-access-s9phc" (OuterVolumeSpecName: "kube-api-access-s9phc") pod "29e61265-7d72-47e2-99ca-747c52c0c783" (UID: "29e61265-7d72-47e2-99ca-747c52c0c783"). InnerVolumeSpecName "kube-api-access-s9phc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 12:55:40.691324 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:55:40.691299    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29e61265-7d72-47e2-99ca-747c52c0c783-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "29e61265-7d72-47e2-99ca-747c52c0c783" (UID: "29e61265-7d72-47e2-99ca-747c52c0c783"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 12:55:40.782216 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:55:40.782182    2570 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/29e61265-7d72-47e2-99ca-747c52c0c783-tls-cert\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:55:40.782216 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:55:40.782211    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9phc\" (UniqueName: \"kubernetes.io/projected/29e61265-7d72-47e2-99ca-747c52c0c783-kube-api-access-s9phc\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 12:55:41.290899 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:55:41.290855    2570 generic.go:356] "Generic (PLEG): container finished" podID="29e61265-7d72-47e2-99ca-747c52c0c783" containerID="2377d8df1eb3ae6f5f31b6ef0cc10c7dab633b0d9fabd5f032fc5455c344a751" exitCode=0
Jul 20 12:55:41.291414 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:55:41.290901    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-575c76944f-rx92s"
Jul 20 12:55:41.291414 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:55:41.290936    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-575c76944f-rx92s" event={"ID":"29e61265-7d72-47e2-99ca-747c52c0c783","Type":"ContainerDied","Data":"2377d8df1eb3ae6f5f31b6ef0cc10c7dab633b0d9fabd5f032fc5455c344a751"}
Jul 20 12:55:41.291414 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:55:41.290981    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-575c76944f-rx92s" event={"ID":"29e61265-7d72-47e2-99ca-747c52c0c783","Type":"ContainerDied","Data":"4e5b5e33b094a098ee988bd2117aac2afb91572b477acd4675d18c1ab1718527"}
Jul 20 12:55:41.291414 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:55:41.291005    2570 scope.go:117] "RemoveContainer" containerID="2377d8df1eb3ae6f5f31b6ef0cc10c7dab633b0d9fabd5f032fc5455c344a751"
Jul 20 12:55:41.301885 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:55:41.301866    2570 scope.go:117] "RemoveContainer" containerID="2377d8df1eb3ae6f5f31b6ef0cc10c7dab633b0d9fabd5f032fc5455c344a751"
Jul 20 12:55:41.302178 ip-10-0-139-1 kubenswrapper[2570]: E0720 12:55:41.302158    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2377d8df1eb3ae6f5f31b6ef0cc10c7dab633b0d9fabd5f032fc5455c344a751\": container with ID starting with 2377d8df1eb3ae6f5f31b6ef0cc10c7dab633b0d9fabd5f032fc5455c344a751 not found: ID does not exist" containerID="2377d8df1eb3ae6f5f31b6ef0cc10c7dab633b0d9fabd5f032fc5455c344a751"
Jul 20 12:55:41.302251 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:55:41.302186    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2377d8df1eb3ae6f5f31b6ef0cc10c7dab633b0d9fabd5f032fc5455c344a751"} err="failed to get container status \"2377d8df1eb3ae6f5f31b6ef0cc10c7dab633b0d9fabd5f032fc5455c344a751\": rpc error: code = NotFound desc = could not find container \"2377d8df1eb3ae6f5f31b6ef0cc10c7dab633b0d9fabd5f032fc5455c344a751\": container with ID starting with 2377d8df1eb3ae6f5f31b6ef0cc10c7dab633b0d9fabd5f032fc5455c344a751 not found: ID does not exist"
Jul 20 12:55:41.317943 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:55:41.317916    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-575c76944f-rx92s"]
Jul 20 12:55:41.325970 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:55:41.325896    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-575c76944f-rx92s"]
Jul 20 12:55:41.808073 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:55:41.807982    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29e61265-7d72-47e2-99ca-747c52c0c783" path="/var/lib/kubelet/pods/29e61265-7d72-47e2-99ca-747c52c0c783/volumes"
Jul 20 12:59:47.788366 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:59:47.788298    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rhdn8_5efe9094-763c-4689-85b7-83e0ccb19811/ovn-acl-logging/0.log"
Jul 20 12:59:47.789713 ip-10-0-139-1 kubenswrapper[2570]: I0720 12:59:47.789688    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rhdn8_5efe9094-763c-4689-85b7-83e0ccb19811/ovn-acl-logging/0.log"
Jul 20 13:00:00.151315 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:00:00.151280    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742540-zllmk"]
Jul 20 13:00:00.151821 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:00:00.151801    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29e61265-7d72-47e2-99ca-747c52c0c783" containerName="authorino"
Jul 20 13:00:00.151821 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:00:00.151822    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="29e61265-7d72-47e2-99ca-747c52c0c783" containerName="authorino"
Jul 20 13:00:00.152003 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:00:00.151898    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="29e61265-7d72-47e2-99ca-747c52c0c783" containerName="authorino"
Jul 20 13:00:00.155100 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:00:00.155070    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742540-zllmk"
Jul 20 13:00:00.158587 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:00:00.158568    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v4s4l\""
Jul 20 13:00:00.164526 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:00:00.164502    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742540-zllmk"
Jul 20 13:00:00.170152 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:00:00.170129    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742540-zllmk"]
Jul 20 13:00:00.299884 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:00:00.299855    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742540-zllmk"]
Jul 20 13:00:00.303558 ip-10-0-139-1 kubenswrapper[2570]: W0720 13:00:00.303519    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a466450_abb8_4eea_b281_c93b294a0086.slice/crio-1eaf79b73bb498f76b380bda25bd461195bb2292b9f3df63761c5d2efda637c7 WatchSource:0}: Error finding container 1eaf79b73bb498f76b380bda25bd461195bb2292b9f3df63761c5d2efda637c7: Status 404 returned error can't find the container with id 1eaf79b73bb498f76b380bda25bd461195bb2292b9f3df63761c5d2efda637c7
Jul 20 13:00:00.687624 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:00:00.687587    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742540-zllmk" event={"ID":"5a466450-abb8-4eea-b281-c93b294a0086","Type":"ContainerStarted","Data":"1eaf79b73bb498f76b380bda25bd461195bb2292b9f3df63761c5d2efda637c7"}
Jul 20 13:00:03.706239 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:00:03.706199    2570 generic.go:356] "Generic (PLEG): container finished" podID="5a466450-abb8-4eea-b281-c93b294a0086" containerID="b2f42cff3c76f8f8a713c0a392d4fa9e1283d8244d38c30ee2e8728bf2765d2c" exitCode=0
Jul 20 13:00:03.706708 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:00:03.706258    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742540-zllmk" event={"ID":"5a466450-abb8-4eea-b281-c93b294a0086","Type":"ContainerDied","Data":"b2f42cff3c76f8f8a713c0a392d4fa9e1283d8244d38c30ee2e8728bf2765d2c"}
Jul 20 13:00:04.844183 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:00:04.844158    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742540-zllmk"
Jul 20 13:00:05.717477 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:00:05.717436    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742540-zllmk" event={"ID":"5a466450-abb8-4eea-b281-c93b294a0086","Type":"ContainerDied","Data":"1eaf79b73bb498f76b380bda25bd461195bb2292b9f3df63761c5d2efda637c7"}
Jul 20 13:00:05.717657 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:00:05.717494    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1eaf79b73bb498f76b380bda25bd461195bb2292b9f3df63761c5d2efda637c7"
Jul 20 13:00:05.717657 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:00:05.717455    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742540-zllmk"
Jul 20 13:04:47.825121 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:04:47.825075    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rhdn8_5efe9094-763c-4689-85b7-83e0ccb19811/ovn-acl-logging/0.log"
Jul 20 13:04:47.827925 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:04:47.827902    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rhdn8_5efe9094-763c-4689-85b7-83e0ccb19811/ovn-acl-logging/0.log"
Jul 20 13:09:47.865732 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:09:47.865704    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rhdn8_5efe9094-763c-4689-85b7-83e0ccb19811/ovn-acl-logging/0.log"
Jul 20 13:09:47.869688 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:09:47.869666    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rhdn8_5efe9094-763c-4689-85b7-83e0ccb19811/ovn-acl-logging/0.log"
Jul 20 13:10:40.385137 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:10:40.385078    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc7eef60-9s8x2"]
Jul 20 13:10:40.385694 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:10:40.385678    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a466450-abb8-4eea-b281-c93b294a0086" containerName="cleanup"
Jul 20 13:10:40.385771 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:10:40.385698    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a466450-abb8-4eea-b281-c93b294a0086" containerName="cleanup"
Jul 20 13:10:40.385827 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:10:40.385807    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a466450-abb8-4eea-b281-c93b294a0086" containerName="cleanup"
Jul 20 13:10:40.388933 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:10:40.388908    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc7eef60-9s8x2"
Jul 20 13:10:40.392388 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:10:40.392364    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 13:10:40.392520 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:10:40.392368    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v4s4l\""
Jul 20 13:10:40.397996 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:10:40.397963    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc7eef60-9s8x2"]
Jul 20 13:10:40.448307 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:10:40.448268    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b3d815a-8083-4745-99c2-6f8b7373cb05-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fc7eef60-9s8x2\" (UID: \"4b3d815a-8083-4745-99c2-6f8b7373cb05\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc7eef60-9s8x2"
Jul 20 13:10:40.549252 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:10:40.549211    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b3d815a-8083-4745-99c2-6f8b7373cb05-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fc7eef60-9s8x2\" (UID: \"4b3d815a-8083-4745-99c2-6f8b7373cb05\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc7eef60-9s8x2"
Jul 20 13:10:40.549843 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:10:40.549819    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b3d815a-8083-4745-99c2-6f8b7373cb05-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fc7eef60-9s8x2\" (UID: \"4b3d815a-8083-4745-99c2-6f8b7373cb05\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc7eef60-9s8x2"
Jul 20 13:10:40.701052 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:10:40.700966    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc7eef60-9s8x2"
Jul 20 13:10:40.856874 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:10:40.856843    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc7eef60-9s8x2"]
Jul 20 13:10:40.858837 ip-10-0-139-1 kubenswrapper[2570]: W0720 13:10:40.858786    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b3d815a_8083_4745_99c2_6f8b7373cb05.slice/crio-eafcf5053f3e15299337760c8f4d460564d9e3a4cf10d8f644012a299cbd7f8f WatchSource:0}: Error finding container eafcf5053f3e15299337760c8f4d460564d9e3a4cf10d8f644012a299cbd7f8f: Status 404 returned error can't find the container with id eafcf5053f3e15299337760c8f4d460564d9e3a4cf10d8f644012a299cbd7f8f
Jul 20 13:10:41.117575 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:10:41.117545    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc7eef60-9s8x2" event={"ID":"4b3d815a-8083-4745-99c2-6f8b7373cb05","Type":"ContainerStarted","Data":"eafcf5053f3e15299337760c8f4d460564d9e3a4cf10d8f644012a299cbd7f8f"}
Jul 20 13:10:42.124217 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:10:42.124180    2570 generic.go:356] "Generic (PLEG): container finished" podID="4b3d815a-8083-4745-99c2-6f8b7373cb05" containerID="99b5356244bbc185f04d6a387356a2cfd45b37c55aaa576590e8f8196d5b9348" exitCode=0
Jul 20 13:10:42.124664 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:10:42.124261    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc7eef60-9s8x2" event={"ID":"4b3d815a-8083-4745-99c2-6f8b7373cb05","Type":"ContainerDied","Data":"99b5356244bbc185f04d6a387356a2cfd45b37c55aaa576590e8f8196d5b9348"}
Jul 20 13:10:43.259688 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:10:43.259666    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc7eef60-9s8x2"
Jul 20 13:10:43.378782 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:10:43.378744    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b3d815a-8083-4745-99c2-6f8b7373cb05-maas-api-service-ca\") pod \"4b3d815a-8083-4745-99c2-6f8b7373cb05\" (UID: \"4b3d815a-8083-4745-99c2-6f8b7373cb05\") "
Jul 20 13:10:43.379134 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:10:43.379110    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b3d815a-8083-4745-99c2-6f8b7373cb05-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4b3d815a-8083-4745-99c2-6f8b7373cb05" (UID: "4b3d815a-8083-4745-99c2-6f8b7373cb05"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:10:43.479660 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:10:43.479568    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b3d815a-8083-4745-99c2-6f8b7373cb05-maas-api-service-ca\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:10:44.135747 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:10:44.135708    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc7eef60-9s8x2" event={"ID":"4b3d815a-8083-4745-99c2-6f8b7373cb05","Type":"ContainerDied","Data":"eafcf5053f3e15299337760c8f4d460564d9e3a4cf10d8f644012a299cbd7f8f"}
Jul 20 13:10:44.135920 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:10:44.135768    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eafcf5053f3e15299337760c8f4d460564d9e3a4cf10d8f644012a299cbd7f8f"
Jul 20 13:10:44.135920 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:10:44.135728    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc7eef60-9s8x2"
Jul 20 13:10:55.467852 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:10:55.467815    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc7eef60-9s8x2"]
Jul 20 13:10:55.470486 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:10:55.470462    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc7eef60-9s8x2"]
Jul 20 13:10:55.807195 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:10:55.807117    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b3d815a-8083-4745-99c2-6f8b7373cb05" path="/var/lib/kubelet/pods/4b3d815a-8083-4745-99c2-6f8b7373cb05/volumes"
Jul 20 13:10:59.278801 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:10:59.278768    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-7257abbc-76f798bd75-4jkss"]
Jul 20 13:10:59.279175 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:10:59.279151    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b3d815a-8083-4745-99c2-6f8b7373cb05" containerName="revoke-keys"
Jul 20 13:10:59.279175 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:10:59.279162    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b3d815a-8083-4745-99c2-6f8b7373cb05" containerName="revoke-keys"
Jul 20 13:10:59.279253 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:10:59.279240    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b3d815a-8083-4745-99c2-6f8b7373cb05" containerName="revoke-keys"
Jul 20 13:10:59.282278 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:10:59.282260    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7257abbc-76f798bd75-4jkss"
Jul 20 13:10:59.285685 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:10:59.285660    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-7257abbc-serving-cert\""
Jul 20 13:10:59.285824 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:10:59.285682    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 13:10:59.285824 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:10:59.285717    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 20 13:10:59.287296 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:10:59.287278    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-ts9xh\""
Jul 20 13:10:59.293557 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:10:59.293537    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-7257abbc-76f798bd75-4jkss"]
Jul 20 13:10:59.428224 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:10:59.428191    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb6113c7-482d-4ded-bc4b-002b496634c4-openshift-service-ca\") pod \"maas-api-e2e-migrate-7257abbc-76f798bd75-4jkss\" (UID: \"bb6113c7-482d-4ded-bc4b-002b496634c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7257abbc-76f798bd75-4jkss"
Jul 20 13:10:59.428393 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:10:59.428240    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lw7m\" (UniqueName: \"kubernetes.io/projected/bb6113c7-482d-4ded-bc4b-002b496634c4-kube-api-access-9lw7m\") pod \"maas-api-e2e-migrate-7257abbc-76f798bd75-4jkss\" (UID: \"bb6113c7-482d-4ded-bc4b-002b496634c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7257abbc-76f798bd75-4jkss"
Jul 20 13:10:59.428393 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:10:59.428298    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb6113c7-482d-4ded-bc4b-002b496634c4-maas-api-tls\") pod \"maas-api-e2e-migrate-7257abbc-76f798bd75-4jkss\" (UID: \"bb6113c7-482d-4ded-bc4b-002b496634c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7257abbc-76f798bd75-4jkss"
Jul 20 13:10:59.529401 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:10:59.529309    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb6113c7-482d-4ded-bc4b-002b496634c4-openshift-service-ca\") pod \"maas-api-e2e-migrate-7257abbc-76f798bd75-4jkss\" (UID: \"bb6113c7-482d-4ded-bc4b-002b496634c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7257abbc-76f798bd75-4jkss"
Jul 20 13:10:59.529401 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:10:59.529379    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lw7m\" (UniqueName: \"kubernetes.io/projected/bb6113c7-482d-4ded-bc4b-002b496634c4-kube-api-access-9lw7m\") pod \"maas-api-e2e-migrate-7257abbc-76f798bd75-4jkss\" (UID: \"bb6113c7-482d-4ded-bc4b-002b496634c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7257abbc-76f798bd75-4jkss"
Jul 20 13:10:59.529646 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:10:59.529445    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb6113c7-482d-4ded-bc4b-002b496634c4-maas-api-tls\") pod \"maas-api-e2e-migrate-7257abbc-76f798bd75-4jkss\" (UID: \"bb6113c7-482d-4ded-bc4b-002b496634c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7257abbc-76f798bd75-4jkss"
Jul 20 13:10:59.530074 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:10:59.530048    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb6113c7-482d-4ded-bc4b-002b496634c4-openshift-service-ca\") pod \"maas-api-e2e-migrate-7257abbc-76f798bd75-4jkss\" (UID: \"bb6113c7-482d-4ded-bc4b-002b496634c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7257abbc-76f798bd75-4jkss"
Jul 20 13:10:59.531863 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:10:59.531845    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb6113c7-482d-4ded-bc4b-002b496634c4-maas-api-tls\") pod \"maas-api-e2e-migrate-7257abbc-76f798bd75-4jkss\" (UID: \"bb6113c7-482d-4ded-bc4b-002b496634c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7257abbc-76f798bd75-4jkss"
Jul 20 13:10:59.538986 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:10:59.538962    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lw7m\" (UniqueName: \"kubernetes.io/projected/bb6113c7-482d-4ded-bc4b-002b496634c4-kube-api-access-9lw7m\") pod \"maas-api-e2e-migrate-7257abbc-76f798bd75-4jkss\" (UID: \"bb6113c7-482d-4ded-bc4b-002b496634c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7257abbc-76f798bd75-4jkss"
Jul 20 13:10:59.593268 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:10:59.593230    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7257abbc-76f798bd75-4jkss"
Jul 20 13:10:59.729942 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:10:59.729913    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-7257abbc-76f798bd75-4jkss"]
Jul 20 13:10:59.731645 ip-10-0-139-1 kubenswrapper[2570]: W0720 13:10:59.731616    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb6113c7_482d_4ded_bc4b_002b496634c4.slice/crio-a78e2c0232ff07f760385baa224a9ec5e808bd1d1281f3a5b2cc6f0a9ca1e723 WatchSource:0}: Error finding container a78e2c0232ff07f760385baa224a9ec5e808bd1d1281f3a5b2cc6f0a9ca1e723: Status 404 returned error can't find the container with id a78e2c0232ff07f760385baa224a9ec5e808bd1d1281f3a5b2cc6f0a9ca1e723
Jul 20 13:10:59.733199 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:10:59.733177    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 13:11:00.231330 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:11:00.231289    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7257abbc-76f798bd75-4jkss" event={"ID":"bb6113c7-482d-4ded-bc4b-002b496634c4","Type":"ContainerStarted","Data":"a78e2c0232ff07f760385baa224a9ec5e808bd1d1281f3a5b2cc6f0a9ca1e723"}
Jul 20 13:11:02.246262 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:11:02.246158    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7257abbc-76f798bd75-4jkss" event={"ID":"bb6113c7-482d-4ded-bc4b-002b496634c4","Type":"ContainerStarted","Data":"62016b3a88ac37cc3f7a7876a203f175fe916088cb42f09ee27d35127e4e9136"}
Jul 20 13:11:02.246262 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:11:02.246234    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7257abbc-76f798bd75-4jkss"
Jul 20 13:11:02.269304 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:11:02.269252    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7257abbc-76f798bd75-4jkss" podStartSLOduration=1.072165913 podStartE2EDuration="3.269235866s" totalImagesPullingTime="2.197069953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:10:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:11:02.265643358 +0000 UTC m=+1575.020692736" watchObservedRunningTime="2026-07-20 13:11:02.269235866 +0000 UTC m=+1575.024285241"
Jul 20 13:11:08.256869 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:11:08.256840    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7257abbc-76f798bd75-4jkss"
Jul 20 13:11:34.666117 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:11:34.666070    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-7257abbc-76f798bd75-4jkss"]
Jul 20 13:11:34.666705 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:11:34.666281    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7257abbc-76f798bd75-4jkss" podUID="bb6113c7-482d-4ded-bc4b-002b496634c4" containerName="maas-api" containerID="cri-o://62016b3a88ac37cc3f7a7876a203f175fe916088cb42f09ee27d35127e4e9136" gracePeriod=30
Jul 20 13:11:34.925199 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:11:34.925134    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7257abbc-76f798bd75-4jkss"
Jul 20 13:11:35.055274 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:11:35.055233    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9lw7m\" (UniqueName: \"kubernetes.io/projected/bb6113c7-482d-4ded-bc4b-002b496634c4-kube-api-access-9lw7m\") pod \"bb6113c7-482d-4ded-bc4b-002b496634c4\" (UID: \"bb6113c7-482d-4ded-bc4b-002b496634c4\") "
Jul 20 13:11:35.055274 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:11:35.055283    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb6113c7-482d-4ded-bc4b-002b496634c4-maas-api-tls\") pod \"bb6113c7-482d-4ded-bc4b-002b496634c4\" (UID: \"bb6113c7-482d-4ded-bc4b-002b496634c4\") "
Jul 20 13:11:35.055506 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:11:35.055346    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb6113c7-482d-4ded-bc4b-002b496634c4-openshift-service-ca\") pod \"bb6113c7-482d-4ded-bc4b-002b496634c4\" (UID: \"bb6113c7-482d-4ded-bc4b-002b496634c4\") "
Jul 20 13:11:35.055745 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:11:35.055721    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb6113c7-482d-4ded-bc4b-002b496634c4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bb6113c7-482d-4ded-bc4b-002b496634c4" (UID: "bb6113c7-482d-4ded-bc4b-002b496634c4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:11:35.057588 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:11:35.057559    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb6113c7-482d-4ded-bc4b-002b496634c4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bb6113c7-482d-4ded-bc4b-002b496634c4" (UID: "bb6113c7-482d-4ded-bc4b-002b496634c4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:11:35.057706 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:11:35.057636    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb6113c7-482d-4ded-bc4b-002b496634c4-kube-api-access-9lw7m" (OuterVolumeSpecName: "kube-api-access-9lw7m") pod "bb6113c7-482d-4ded-bc4b-002b496634c4" (UID: "bb6113c7-482d-4ded-bc4b-002b496634c4"). InnerVolumeSpecName "kube-api-access-9lw7m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:11:35.162119 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:11:35.157149    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9lw7m\" (UniqueName: \"kubernetes.io/projected/bb6113c7-482d-4ded-bc4b-002b496634c4-kube-api-access-9lw7m\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:11:35.162119 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:11:35.157193    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb6113c7-482d-4ded-bc4b-002b496634c4-maas-api-tls\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:11:35.162119 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:11:35.157211    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb6113c7-482d-4ded-bc4b-002b496634c4-openshift-service-ca\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:11:35.434001 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:11:35.433960    2570 generic.go:356] "Generic (PLEG): container finished" podID="bb6113c7-482d-4ded-bc4b-002b496634c4" containerID="62016b3a88ac37cc3f7a7876a203f175fe916088cb42f09ee27d35127e4e9136" exitCode=0
Jul 20 13:11:35.434216 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:11:35.434024    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7257abbc-76f798bd75-4jkss"
Jul 20 13:11:35.434216 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:11:35.434044    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7257abbc-76f798bd75-4jkss" event={"ID":"bb6113c7-482d-4ded-bc4b-002b496634c4","Type":"ContainerDied","Data":"62016b3a88ac37cc3f7a7876a203f175fe916088cb42f09ee27d35127e4e9136"}
Jul 20 13:11:35.434216 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:11:35.434146    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7257abbc-76f798bd75-4jkss" event={"ID":"bb6113c7-482d-4ded-bc4b-002b496634c4","Type":"ContainerDied","Data":"a78e2c0232ff07f760385baa224a9ec5e808bd1d1281f3a5b2cc6f0a9ca1e723"}
Jul 20 13:11:35.434216 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:11:35.434171    2570 scope.go:117] "RemoveContainer" containerID="62016b3a88ac37cc3f7a7876a203f175fe916088cb42f09ee27d35127e4e9136"
Jul 20 13:11:35.444028 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:11:35.444008    2570 scope.go:117] "RemoveContainer" containerID="62016b3a88ac37cc3f7a7876a203f175fe916088cb42f09ee27d35127e4e9136"
Jul 20 13:11:35.444364 ip-10-0-139-1 kubenswrapper[2570]: E0720 13:11:35.444340    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62016b3a88ac37cc3f7a7876a203f175fe916088cb42f09ee27d35127e4e9136\": container with ID starting with 62016b3a88ac37cc3f7a7876a203f175fe916088cb42f09ee27d35127e4e9136 not found: ID does not exist" containerID="62016b3a88ac37cc3f7a7876a203f175fe916088cb42f09ee27d35127e4e9136"
Jul 20 13:11:35.444433 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:11:35.444379    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62016b3a88ac37cc3f7a7876a203f175fe916088cb42f09ee27d35127e4e9136"} err="failed to get container status \"62016b3a88ac37cc3f7a7876a203f175fe916088cb42f09ee27d35127e4e9136\": rpc error: code = NotFound desc = could not find container \"62016b3a88ac37cc3f7a7876a203f175fe916088cb42f09ee27d35127e4e9136\": container with ID starting with 62016b3a88ac37cc3f7a7876a203f175fe916088cb42f09ee27d35127e4e9136 not found: ID does not exist"
Jul 20 13:11:35.458091 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:11:35.458046    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-7257abbc-76f798bd75-4jkss"]
Jul 20 13:11:35.461634 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:11:35.461601    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-7257abbc-76f798bd75-4jkss"]
Jul 20 13:11:35.807585 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:11:35.807497    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb6113c7-482d-4ded-bc4b-002b496634c4" path="/var/lib/kubelet/pods/bb6113c7-482d-4ded-bc4b-002b496634c4/volumes"
Jul 20 13:11:42.630710 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:11:42.630614    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-de7145c9-5958d65b47-vmrzt"]
Jul 20 13:11:42.631259 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:11:42.631238    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb6113c7-482d-4ded-bc4b-002b496634c4" containerName="maas-api"
Jul 20 13:11:42.631340 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:11:42.631262    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb6113c7-482d-4ded-bc4b-002b496634c4" containerName="maas-api"
Jul 20 13:11:42.631398 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:11:42.631351    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb6113c7-482d-4ded-bc4b-002b496634c4" containerName="maas-api"
Jul 20 13:11:42.636402 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:11:42.636375    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-de7145c9-5958d65b47-vmrzt"
Jul 20 13:11:42.639641 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:11:42.639613    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 20 13:11:42.641315 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:11:42.641283    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-de7145c9-serving-cert\""
Jul 20 13:11:42.641455 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:11:42.641317    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 13:11:42.641455 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:11:42.641383    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-ts9xh\""
Jul 20 13:11:42.645179 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:11:42.645151    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-de7145c9-5958d65b47-vmrzt"]
Jul 20 13:11:42.731239 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:11:42.731191    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d421efc-d386-4808-9171-62809a142cd0-openshift-service-ca\") pod \"maas-api-e2e-ait-de7145c9-5958d65b47-vmrzt\" (UID: \"0d421efc-d386-4808-9171-62809a142cd0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-de7145c9-5958d65b47-vmrzt"
Jul 20 13:11:42.731435 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:11:42.731339    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d421efc-d386-4808-9171-62809a142cd0-maas-api-tls\") pod \"maas-api-e2e-ait-de7145c9-5958d65b47-vmrzt\" (UID: \"0d421efc-d386-4808-9171-62809a142cd0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-de7145c9-5958d65b47-vmrzt"
Jul 20 13:11:42.731435 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:11:42.731369    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmvwb\" (UniqueName: \"kubernetes.io/projected/0d421efc-d386-4808-9171-62809a142cd0-kube-api-access-nmvwb\") pod \"maas-api-e2e-ait-de7145c9-5958d65b47-vmrzt\" (UID: \"0d421efc-d386-4808-9171-62809a142cd0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-de7145c9-5958d65b47-vmrzt"
Jul 20 13:11:42.832388 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:11:42.832340    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d421efc-d386-4808-9171-62809a142cd0-openshift-service-ca\") pod \"maas-api-e2e-ait-de7145c9-5958d65b47-vmrzt\" (UID: \"0d421efc-d386-4808-9171-62809a142cd0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-de7145c9-5958d65b47-vmrzt"
Jul 20 13:11:42.832573 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:11:42.832430    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d421efc-d386-4808-9171-62809a142cd0-maas-api-tls\") pod \"maas-api-e2e-ait-de7145c9-5958d65b47-vmrzt\" (UID: \"0d421efc-d386-4808-9171-62809a142cd0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-de7145c9-5958d65b47-vmrzt"
Jul 20 13:11:42.832573 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:11:42.832451    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmvwb\" (UniqueName: \"kubernetes.io/projected/0d421efc-d386-4808-9171-62809a142cd0-kube-api-access-nmvwb\") pod \"maas-api-e2e-ait-de7145c9-5958d65b47-vmrzt\" (UID: \"0d421efc-d386-4808-9171-62809a142cd0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-de7145c9-5958d65b47-vmrzt"
Jul 20 13:11:42.832648 ip-10-0-139-1 kubenswrapper[2570]: E0720 13:11:42.832580    2570 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-de7145c9-serving-cert: secret "maas-api-e2e-ait-de7145c9-serving-cert" not found
Jul 20 13:11:42.832682 ip-10-0-139-1 kubenswrapper[2570]: E0720 13:11:42.832658    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d421efc-d386-4808-9171-62809a142cd0-maas-api-tls podName:0d421efc-d386-4808-9171-62809a142cd0 nodeName:}" failed. No retries permitted until 2026-07-20 13:11:43.332638511 +0000 UTC m=+1616.087687877 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0d421efc-d386-4808-9171-62809a142cd0-maas-api-tls") pod "maas-api-e2e-ait-de7145c9-5958d65b47-vmrzt" (UID: "0d421efc-d386-4808-9171-62809a142cd0") : secret "maas-api-e2e-ait-de7145c9-serving-cert" not found
Jul 20 13:11:42.832982 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:11:42.832963    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d421efc-d386-4808-9171-62809a142cd0-openshift-service-ca\") pod \"maas-api-e2e-ait-de7145c9-5958d65b47-vmrzt\" (UID: \"0d421efc-d386-4808-9171-62809a142cd0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-de7145c9-5958d65b47-vmrzt"
Jul 20 13:11:42.850757 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:11:42.850717    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmvwb\" (UniqueName: \"kubernetes.io/projected/0d421efc-d386-4808-9171-62809a142cd0-kube-api-access-nmvwb\") pod \"maas-api-e2e-ait-de7145c9-5958d65b47-vmrzt\" (UID: \"0d421efc-d386-4808-9171-62809a142cd0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-de7145c9-5958d65b47-vmrzt"
Jul 20 13:11:43.337417 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:11:43.337369    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d421efc-d386-4808-9171-62809a142cd0-maas-api-tls\") pod \"maas-api-e2e-ait-de7145c9-5958d65b47-vmrzt\" (UID: \"0d421efc-d386-4808-9171-62809a142cd0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-de7145c9-5958d65b47-vmrzt"
Jul 20 13:11:43.339843 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:11:43.339823    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d421efc-d386-4808-9171-62809a142cd0-maas-api-tls\") pod \"maas-api-e2e-ait-de7145c9-5958d65b47-vmrzt\" (UID: \"0d421efc-d386-4808-9171-62809a142cd0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-de7145c9-5958d65b47-vmrzt"
Jul 20 13:11:43.547954 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:11:43.547912    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-de7145c9-5958d65b47-vmrzt"
Jul 20 13:11:43.690774 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:11:43.690737    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-de7145c9-5958d65b47-vmrzt"]
Jul 20 13:11:43.691550 ip-10-0-139-1 kubenswrapper[2570]: W0720 13:11:43.691514    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d421efc_d386_4808_9171_62809a142cd0.slice/crio-48fbd60153b2010f76709c1c4a1e707868dcbca2ebde7d8464460641b4d406fa WatchSource:0}: Error finding container 48fbd60153b2010f76709c1c4a1e707868dcbca2ebde7d8464460641b4d406fa: Status 404 returned error can't find the container with id 48fbd60153b2010f76709c1c4a1e707868dcbca2ebde7d8464460641b4d406fa
Jul 20 13:11:44.489510 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:11:44.489426    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-de7145c9-5958d65b47-vmrzt" event={"ID":"0d421efc-d386-4808-9171-62809a142cd0","Type":"ContainerStarted","Data":"746bfb6e0124c42768852857c37946d790a2bc4338d0ca2b9df012e585470bb8"}
Jul 20 13:11:44.489510 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:11:44.489476    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-de7145c9-5958d65b47-vmrzt" event={"ID":"0d421efc-d386-4808-9171-62809a142cd0","Type":"ContainerStarted","Data":"48fbd60153b2010f76709c1c4a1e707868dcbca2ebde7d8464460641b4d406fa"}
Jul 20 13:11:44.489707 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:11:44.489549    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-de7145c9-5958d65b47-vmrzt"
Jul 20 13:11:44.507261 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:11:44.507209    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-de7145c9-5958d65b47-vmrzt" podStartSLOduration=2.122484372 podStartE2EDuration="2.507188521s" totalImagesPullingTime="384.704149ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:11:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:11:44.50650469 +0000 UTC m=+1617.261554067" watchObservedRunningTime="2026-07-20 13:11:44.507188521 +0000 UTC m=+1617.262237897"
Jul 20 13:11:50.501294 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:11:50.501261    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-de7145c9-5958d65b47-vmrzt"
Jul 20 13:12:19.008110 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:12:19.008062    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-de7145c9-5958d65b47-vmrzt"]
Jul 20 13:12:19.008669 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:12:19.008299    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-de7145c9-5958d65b47-vmrzt" podUID="0d421efc-d386-4808-9171-62809a142cd0" containerName="maas-api" containerID="cri-o://746bfb6e0124c42768852857c37946d790a2bc4338d0ca2b9df012e585470bb8" gracePeriod=30
Jul 20 13:12:19.252910 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:12:19.252880    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-de7145c9-5958d65b47-vmrzt"
Jul 20 13:12:19.368406 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:12:19.368369    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmvwb\" (UniqueName: \"kubernetes.io/projected/0d421efc-d386-4808-9171-62809a142cd0-kube-api-access-nmvwb\") pod \"0d421efc-d386-4808-9171-62809a142cd0\" (UID: \"0d421efc-d386-4808-9171-62809a142cd0\") "
Jul 20 13:12:19.368406 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:12:19.368409    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d421efc-d386-4808-9171-62809a142cd0-maas-api-tls\") pod \"0d421efc-d386-4808-9171-62809a142cd0\" (UID: \"0d421efc-d386-4808-9171-62809a142cd0\") "
Jul 20 13:12:19.368674 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:12:19.368485    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d421efc-d386-4808-9171-62809a142cd0-openshift-service-ca\") pod \"0d421efc-d386-4808-9171-62809a142cd0\" (UID: \"0d421efc-d386-4808-9171-62809a142cd0\") "
Jul 20 13:12:19.368890 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:12:19.368862    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d421efc-d386-4808-9171-62809a142cd0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0d421efc-d386-4808-9171-62809a142cd0" (UID: "0d421efc-d386-4808-9171-62809a142cd0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:12:19.370617 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:12:19.370583    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d421efc-d386-4808-9171-62809a142cd0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0d421efc-d386-4808-9171-62809a142cd0" (UID: "0d421efc-d386-4808-9171-62809a142cd0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:12:19.370731 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:12:19.370682    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d421efc-d386-4808-9171-62809a142cd0-kube-api-access-nmvwb" (OuterVolumeSpecName: "kube-api-access-nmvwb") pod "0d421efc-d386-4808-9171-62809a142cd0" (UID: "0d421efc-d386-4808-9171-62809a142cd0"). InnerVolumeSpecName "kube-api-access-nmvwb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:12:19.469388 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:12:19.469345    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmvwb\" (UniqueName: \"kubernetes.io/projected/0d421efc-d386-4808-9171-62809a142cd0-kube-api-access-nmvwb\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:12:19.469388 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:12:19.469380    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d421efc-d386-4808-9171-62809a142cd0-maas-api-tls\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:12:19.469388 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:12:19.469390    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d421efc-d386-4808-9171-62809a142cd0-openshift-service-ca\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:12:19.691705 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:12:19.691610    2570 generic.go:356] "Generic (PLEG): container finished" podID="0d421efc-d386-4808-9171-62809a142cd0" containerID="746bfb6e0124c42768852857c37946d790a2bc4338d0ca2b9df012e585470bb8" exitCode=0
Jul 20 13:12:19.691705 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:12:19.691647    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-de7145c9-5958d65b47-vmrzt" event={"ID":"0d421efc-d386-4808-9171-62809a142cd0","Type":"ContainerDied","Data":"746bfb6e0124c42768852857c37946d790a2bc4338d0ca2b9df012e585470bb8"}
Jul 20 13:12:19.691705 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:12:19.691665    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-de7145c9-5958d65b47-vmrzt"
Jul 20 13:12:19.692002 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:12:19.691717    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-de7145c9-5958d65b47-vmrzt" event={"ID":"0d421efc-d386-4808-9171-62809a142cd0","Type":"ContainerDied","Data":"48fbd60153b2010f76709c1c4a1e707868dcbca2ebde7d8464460641b4d406fa"}
Jul 20 13:12:19.692002 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:12:19.691739    2570 scope.go:117] "RemoveContainer" containerID="746bfb6e0124c42768852857c37946d790a2bc4338d0ca2b9df012e585470bb8"
Jul 20 13:12:19.703763 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:12:19.703736    2570 scope.go:117] "RemoveContainer" containerID="746bfb6e0124c42768852857c37946d790a2bc4338d0ca2b9df012e585470bb8"
Jul 20 13:12:19.704028 ip-10-0-139-1 kubenswrapper[2570]: E0720 13:12:19.704010    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"746bfb6e0124c42768852857c37946d790a2bc4338d0ca2b9df012e585470bb8\": container with ID starting with 746bfb6e0124c42768852857c37946d790a2bc4338d0ca2b9df012e585470bb8 not found: ID does not exist" containerID="746bfb6e0124c42768852857c37946d790a2bc4338d0ca2b9df012e585470bb8"
Jul 20 13:12:19.704078 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:12:19.704036    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"746bfb6e0124c42768852857c37946d790a2bc4338d0ca2b9df012e585470bb8"} err="failed to get container status \"746bfb6e0124c42768852857c37946d790a2bc4338d0ca2b9df012e585470bb8\": rpc error: code = NotFound desc = could not find container \"746bfb6e0124c42768852857c37946d790a2bc4338d0ca2b9df012e585470bb8\": container with ID starting with 746bfb6e0124c42768852857c37946d790a2bc4338d0ca2b9df012e585470bb8 not found: ID does not exist"
Jul 20 13:12:19.719028 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:12:19.718993    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-de7145c9-5958d65b47-vmrzt"]
Jul 20 13:12:19.721245 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:12:19.721221    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-de7145c9-5958d65b47-vmrzt"]
Jul 20 13:12:19.807426 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:12:19.807390    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d421efc-d386-4808-9171-62809a142cd0" path="/var/lib/kubelet/pods/0d421efc-d386-4808-9171-62809a142cd0/volumes"
Jul 20 13:12:27.502548 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:12:27.502504    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5545572a-8678cc6f48-6zdx2"]
Jul 20 13:12:27.502994 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:12:27.502976    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d421efc-d386-4808-9171-62809a142cd0" containerName="maas-api"
Jul 20 13:12:27.503040 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:12:27.502995    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d421efc-d386-4808-9171-62809a142cd0" containerName="maas-api"
Jul 20 13:12:27.503097 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:12:27.503071    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d421efc-d386-4808-9171-62809a142cd0" containerName="maas-api"
Jul 20 13:12:27.507650 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:12:27.507631    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5545572a-8678cc6f48-6zdx2"
Jul 20 13:12:27.510804 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:12:27.510756    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 13:12:27.512250 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:12:27.512228    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-5545572a-serving-cert\""
Jul 20 13:12:27.512357 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:12:27.512233    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 20 13:12:27.512357 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:12:27.512239    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-ts9xh\""
Jul 20 13:12:27.518600 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:12:27.518573    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5545572a-8678cc6f48-6zdx2"]
Jul 20 13:12:27.648581 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:12:27.648546    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b825e7b4-6980-4756-90ca-836845854058-openshift-service-ca\") pod \"maas-api-e2e-derive-5545572a-8678cc6f48-6zdx2\" (UID: \"b825e7b4-6980-4756-90ca-836845854058\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5545572a-8678cc6f48-6zdx2"
Jul 20 13:12:27.648739 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:12:27.648607    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b825e7b4-6980-4756-90ca-836845854058-maas-api-tls\") pod \"maas-api-e2e-derive-5545572a-8678cc6f48-6zdx2\" (UID: \"b825e7b4-6980-4756-90ca-836845854058\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5545572a-8678cc6f48-6zdx2"
Jul 20 13:12:27.648739 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:12:27.648652    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbj2s\" (UniqueName: \"kubernetes.io/projected/b825e7b4-6980-4756-90ca-836845854058-kube-api-access-dbj2s\") pod \"maas-api-e2e-derive-5545572a-8678cc6f48-6zdx2\" (UID: \"b825e7b4-6980-4756-90ca-836845854058\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5545572a-8678cc6f48-6zdx2"
Jul 20 13:12:27.749605 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:12:27.749567    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b825e7b4-6980-4756-90ca-836845854058-maas-api-tls\") pod \"maas-api-e2e-derive-5545572a-8678cc6f48-6zdx2\" (UID: \"b825e7b4-6980-4756-90ca-836845854058\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5545572a-8678cc6f48-6zdx2"
Jul 20 13:12:27.749605 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:12:27.749610    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbj2s\" (UniqueName: \"kubernetes.io/projected/b825e7b4-6980-4756-90ca-836845854058-kube-api-access-dbj2s\") pod \"maas-api-e2e-derive-5545572a-8678cc6f48-6zdx2\" (UID: \"b825e7b4-6980-4756-90ca-836845854058\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5545572a-8678cc6f48-6zdx2"
Jul 20 13:12:27.749810 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:12:27.749709    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b825e7b4-6980-4756-90ca-836845854058-openshift-service-ca\") pod \"maas-api-e2e-derive-5545572a-8678cc6f48-6zdx2\" (UID: \"b825e7b4-6980-4756-90ca-836845854058\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5545572a-8678cc6f48-6zdx2"
Jul 20 13:12:27.749810 ip-10-0-139-1 kubenswrapper[2570]: E0720 13:12:27.749725    2570 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-5545572a-serving-cert: secret "maas-api-e2e-derive-5545572a-serving-cert" not found
Jul 20 13:12:27.749810 ip-10-0-139-1 kubenswrapper[2570]: E0720 13:12:27.749792    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b825e7b4-6980-4756-90ca-836845854058-maas-api-tls podName:b825e7b4-6980-4756-90ca-836845854058 nodeName:}" failed. No retries permitted until 2026-07-20 13:12:28.249768688 +0000 UTC m=+1661.004818059 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b825e7b4-6980-4756-90ca-836845854058-maas-api-tls") pod "maas-api-e2e-derive-5545572a-8678cc6f48-6zdx2" (UID: "b825e7b4-6980-4756-90ca-836845854058") : secret "maas-api-e2e-derive-5545572a-serving-cert" not found
Jul 20 13:12:27.750329 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:12:27.750310    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b825e7b4-6980-4756-90ca-836845854058-openshift-service-ca\") pod \"maas-api-e2e-derive-5545572a-8678cc6f48-6zdx2\" (UID: \"b825e7b4-6980-4756-90ca-836845854058\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5545572a-8678cc6f48-6zdx2"
Jul 20 13:12:27.759874 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:12:27.759814    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbj2s\" (UniqueName: \"kubernetes.io/projected/b825e7b4-6980-4756-90ca-836845854058-kube-api-access-dbj2s\") pod \"maas-api-e2e-derive-5545572a-8678cc6f48-6zdx2\" (UID: \"b825e7b4-6980-4756-90ca-836845854058\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5545572a-8678cc6f48-6zdx2"
Jul 20 13:12:28.253539 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:12:28.253507    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b825e7b4-6980-4756-90ca-836845854058-maas-api-tls\") pod \"maas-api-e2e-derive-5545572a-8678cc6f48-6zdx2\" (UID: \"b825e7b4-6980-4756-90ca-836845854058\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5545572a-8678cc6f48-6zdx2"
Jul 20 13:12:28.255903 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:12:28.255877    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b825e7b4-6980-4756-90ca-836845854058-maas-api-tls\") pod \"maas-api-e2e-derive-5545572a-8678cc6f48-6zdx2\" (UID: \"b825e7b4-6980-4756-90ca-836845854058\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5545572a-8678cc6f48-6zdx2"
Jul 20 13:12:28.419801 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:12:28.419766    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5545572a-8678cc6f48-6zdx2"
Jul 20 13:12:28.573808 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:12:28.573778    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5545572a-8678cc6f48-6zdx2"]
Jul 20 13:12:28.574830 ip-10-0-139-1 kubenswrapper[2570]: W0720 13:12:28.574799    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb825e7b4_6980_4756_90ca_836845854058.slice/crio-bf8094c3f7a1baf69251a7d424565cc22eb1d029e00f1e7a8edb5e23f3936061 WatchSource:0}: Error finding container bf8094c3f7a1baf69251a7d424565cc22eb1d029e00f1e7a8edb5e23f3936061: Status 404 returned error can't find the container with id bf8094c3f7a1baf69251a7d424565cc22eb1d029e00f1e7a8edb5e23f3936061
Jul 20 13:12:28.740432 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:12:28.740396    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5545572a-8678cc6f48-6zdx2" event={"ID":"b825e7b4-6980-4756-90ca-836845854058","Type":"ContainerStarted","Data":"bf8094c3f7a1baf69251a7d424565cc22eb1d029e00f1e7a8edb5e23f3936061"}
Jul 20 13:12:29.748301 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:12:29.748267    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5545572a-8678cc6f48-6zdx2" event={"ID":"b825e7b4-6980-4756-90ca-836845854058","Type":"ContainerStarted","Data":"2765b8cdbcf0872c37601c151ad34dd5e18ff85f57610e36cf98def4927ba8b5"}
Jul 20 13:12:29.748734 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:12:29.748394    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5545572a-8678cc6f48-6zdx2"
Jul 20 13:12:29.768349 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:12:29.768300    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5545572a-8678cc6f48-6zdx2" podStartSLOduration=2.325555994 podStartE2EDuration="2.768283749s" totalImagesPullingTime="442.727755ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:12:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:12:29.76578439 +0000 UTC m=+1662.520833765" watchObservedRunningTime="2026-07-20 13:12:29.768283749 +0000 UTC m=+1662.523333124"
Jul 20 13:12:35.759979 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:12:35.759942    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5545572a-8678cc6f48-6zdx2"
Jul 20 13:13:02.737758 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:13:02.737716    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5545572a-8678cc6f48-6zdx2"]
Jul 20 13:13:02.738334 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:13:02.737929    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5545572a-8678cc6f48-6zdx2" podUID="b825e7b4-6980-4756-90ca-836845854058" containerName="maas-api" containerID="cri-o://2765b8cdbcf0872c37601c151ad34dd5e18ff85f57610e36cf98def4927ba8b5" gracePeriod=30
Jul 20 13:13:02.936611 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:13:02.936569    2570 generic.go:356] "Generic (PLEG): container finished" podID="b825e7b4-6980-4756-90ca-836845854058" containerID="2765b8cdbcf0872c37601c151ad34dd5e18ff85f57610e36cf98def4927ba8b5" exitCode=0
Jul 20 13:13:02.936788 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:13:02.936641    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5545572a-8678cc6f48-6zdx2" event={"ID":"b825e7b4-6980-4756-90ca-836845854058","Type":"ContainerDied","Data":"2765b8cdbcf0872c37601c151ad34dd5e18ff85f57610e36cf98def4927ba8b5"}
Jul 20 13:13:03.009697 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:13:03.009669    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5545572a-8678cc6f48-6zdx2"
Jul 20 13:13:03.079442 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:13:03.079404    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b825e7b4-6980-4756-90ca-836845854058-openshift-service-ca\") pod \"b825e7b4-6980-4756-90ca-836845854058\" (UID: \"b825e7b4-6980-4756-90ca-836845854058\") "
Jul 20 13:13:03.079640 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:13:03.079501    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dbj2s\" (UniqueName: \"kubernetes.io/projected/b825e7b4-6980-4756-90ca-836845854058-kube-api-access-dbj2s\") pod \"b825e7b4-6980-4756-90ca-836845854058\" (UID: \"b825e7b4-6980-4756-90ca-836845854058\") "
Jul 20 13:13:03.079640 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:13:03.079556    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b825e7b4-6980-4756-90ca-836845854058-maas-api-tls\") pod \"b825e7b4-6980-4756-90ca-836845854058\" (UID: \"b825e7b4-6980-4756-90ca-836845854058\") "
Jul 20 13:13:03.079792 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:13:03.079765    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b825e7b4-6980-4756-90ca-836845854058-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b825e7b4-6980-4756-90ca-836845854058" (UID: "b825e7b4-6980-4756-90ca-836845854058"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:13:03.081834 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:13:03.081806    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b825e7b4-6980-4756-90ca-836845854058-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b825e7b4-6980-4756-90ca-836845854058" (UID: "b825e7b4-6980-4756-90ca-836845854058"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:13:03.081921 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:13:03.081875    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b825e7b4-6980-4756-90ca-836845854058-kube-api-access-dbj2s" (OuterVolumeSpecName: "kube-api-access-dbj2s") pod "b825e7b4-6980-4756-90ca-836845854058" (UID: "b825e7b4-6980-4756-90ca-836845854058"). InnerVolumeSpecName "kube-api-access-dbj2s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:13:03.180416 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:13:03.180355    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b825e7b4-6980-4756-90ca-836845854058-openshift-service-ca\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:13:03.180416 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:13:03.180407    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dbj2s\" (UniqueName: \"kubernetes.io/projected/b825e7b4-6980-4756-90ca-836845854058-kube-api-access-dbj2s\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:13:03.180416 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:13:03.180421    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b825e7b4-6980-4756-90ca-836845854058-maas-api-tls\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:13:03.943872 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:13:03.943839    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5545572a-8678cc6f48-6zdx2"
Jul 20 13:13:03.944310 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:13:03.943880    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5545572a-8678cc6f48-6zdx2" event={"ID":"b825e7b4-6980-4756-90ca-836845854058","Type":"ContainerDied","Data":"bf8094c3f7a1baf69251a7d424565cc22eb1d029e00f1e7a8edb5e23f3936061"}
Jul 20 13:13:03.944310 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:13:03.943950    2570 scope.go:117] "RemoveContainer" containerID="2765b8cdbcf0872c37601c151ad34dd5e18ff85f57610e36cf98def4927ba8b5"
Jul 20 13:13:03.968860 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:13:03.968817    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5545572a-8678cc6f48-6zdx2"]
Jul 20 13:13:03.971668 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:13:03.971638    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5545572a-8678cc6f48-6zdx2"]
Jul 20 13:13:05.810538 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:13:05.810500    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b825e7b4-6980-4756-90ca-836845854058" path="/var/lib/kubelet/pods/b825e7b4-6980-4756-90ca-836845854058/volumes"
Jul 20 13:14:47.911558 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:14:47.911522    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rhdn8_5efe9094-763c-4689-85b7-83e0ccb19811/ovn-acl-logging/0.log"
Jul 20 13:14:47.917875 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:14:47.917854    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rhdn8_5efe9094-763c-4689-85b7-83e0ccb19811/ovn-acl-logging/0.log"
Jul 20 13:14:53.969417 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:14:53.969378    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f4490cdf-9f4b6b4c6-l72rz"]
Jul 20 13:14:53.969874 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:14:53.969749    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b825e7b4-6980-4756-90ca-836845854058" containerName="maas-api"
Jul 20 13:14:53.969874 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:14:53.969760    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b825e7b4-6980-4756-90ca-836845854058" containerName="maas-api"
Jul 20 13:14:53.969874 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:14:53.969825    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="b825e7b4-6980-4756-90ca-836845854058" containerName="maas-api"
Jul 20 13:14:53.973109 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:14:53.973062    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4490cdf-9f4b6b4c6-l72rz"
Jul 20 13:14:53.976303 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:14:53.976280    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 20 13:14:53.976560 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:14:53.976279    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-f4490cdf-serving-cert\""
Jul 20 13:14:53.976681 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:14:53.976323    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 13:14:53.978211 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:14:53.978185    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-ts9xh\""
Jul 20 13:14:53.985994 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:14:53.985966    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f4490cdf-9f4b6b4c6-l72rz"]
Jul 20 13:14:54.115600 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:14:54.115560    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/226a405f-dc09-4ba4-9191-309c33713601-openshift-service-ca\") pod \"maas-api-e2e-mt-f4490cdf-9f4b6b4c6-l72rz\" (UID: \"226a405f-dc09-4ba4-9191-309c33713601\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4490cdf-9f4b6b4c6-l72rz"
Jul 20 13:14:54.115766 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:14:54.115613    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tntdg\" (UniqueName: \"kubernetes.io/projected/226a405f-dc09-4ba4-9191-309c33713601-kube-api-access-tntdg\") pod \"maas-api-e2e-mt-f4490cdf-9f4b6b4c6-l72rz\" (UID: \"226a405f-dc09-4ba4-9191-309c33713601\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4490cdf-9f4b6b4c6-l72rz"
Jul 20 13:14:54.115766 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:14:54.115677    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/226a405f-dc09-4ba4-9191-309c33713601-maas-api-tls\") pod \"maas-api-e2e-mt-f4490cdf-9f4b6b4c6-l72rz\" (UID: \"226a405f-dc09-4ba4-9191-309c33713601\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4490cdf-9f4b6b4c6-l72rz"
Jul 20 13:14:54.216613 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:14:54.216572    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/226a405f-dc09-4ba4-9191-309c33713601-openshift-service-ca\") pod \"maas-api-e2e-mt-f4490cdf-9f4b6b4c6-l72rz\" (UID: \"226a405f-dc09-4ba4-9191-309c33713601\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4490cdf-9f4b6b4c6-l72rz"
Jul 20 13:14:54.216787 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:14:54.216625    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tntdg\" (UniqueName: \"kubernetes.io/projected/226a405f-dc09-4ba4-9191-309c33713601-kube-api-access-tntdg\") pod \"maas-api-e2e-mt-f4490cdf-9f4b6b4c6-l72rz\" (UID: \"226a405f-dc09-4ba4-9191-309c33713601\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4490cdf-9f4b6b4c6-l72rz"
Jul 20 13:14:54.216787 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:14:54.216738    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/226a405f-dc09-4ba4-9191-309c33713601-maas-api-tls\") pod \"maas-api-e2e-mt-f4490cdf-9f4b6b4c6-l72rz\" (UID: \"226a405f-dc09-4ba4-9191-309c33713601\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4490cdf-9f4b6b4c6-l72rz"
Jul 20 13:14:54.216902 ip-10-0-139-1 kubenswrapper[2570]: E0720 13:14:54.216880    2570 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-f4490cdf-serving-cert: secret "maas-api-e2e-mt-f4490cdf-serving-cert" not found
Jul 20 13:14:54.216969 ip-10-0-139-1 kubenswrapper[2570]: E0720 13:14:54.216958    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/226a405f-dc09-4ba4-9191-309c33713601-maas-api-tls podName:226a405f-dc09-4ba4-9191-309c33713601 nodeName:}" failed. No retries permitted until 2026-07-20 13:14:54.716941283 +0000 UTC m=+1807.471990636 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/226a405f-dc09-4ba4-9191-309c33713601-maas-api-tls") pod "maas-api-e2e-mt-f4490cdf-9f4b6b4c6-l72rz" (UID: "226a405f-dc09-4ba4-9191-309c33713601") : secret "maas-api-e2e-mt-f4490cdf-serving-cert" not found
Jul 20 13:14:54.217239 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:14:54.217220    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/226a405f-dc09-4ba4-9191-309c33713601-openshift-service-ca\") pod \"maas-api-e2e-mt-f4490cdf-9f4b6b4c6-l72rz\" (UID: \"226a405f-dc09-4ba4-9191-309c33713601\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4490cdf-9f4b6b4c6-l72rz"
Jul 20 13:14:54.229513 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:14:54.229452    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tntdg\" (UniqueName: \"kubernetes.io/projected/226a405f-dc09-4ba4-9191-309c33713601-kube-api-access-tntdg\") pod \"maas-api-e2e-mt-f4490cdf-9f4b6b4c6-l72rz\" (UID: \"226a405f-dc09-4ba4-9191-309c33713601\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4490cdf-9f4b6b4c6-l72rz"
Jul 20 13:14:54.722477 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:14:54.722437    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/226a405f-dc09-4ba4-9191-309c33713601-maas-api-tls\") pod \"maas-api-e2e-mt-f4490cdf-9f4b6b4c6-l72rz\" (UID: \"226a405f-dc09-4ba4-9191-309c33713601\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4490cdf-9f4b6b4c6-l72rz"
Jul 20 13:14:54.724834 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:14:54.724802    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/226a405f-dc09-4ba4-9191-309c33713601-maas-api-tls\") pod \"maas-api-e2e-mt-f4490cdf-9f4b6b4c6-l72rz\" (UID: \"226a405f-dc09-4ba4-9191-309c33713601\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4490cdf-9f4b6b4c6-l72rz"
Jul 20 13:14:54.886333 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:14:54.886292    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4490cdf-9f4b6b4c6-l72rz"
Jul 20 13:14:55.020550 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:14:55.020520    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f4490cdf-9f4b6b4c6-l72rz"]
Jul 20 13:14:55.022123 ip-10-0-139-1 kubenswrapper[2570]: W0720 13:14:55.022076    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod226a405f_dc09_4ba4_9191_309c33713601.slice/crio-80743b7b1eb167658df4162742f76ccd3626d56e96f83ec3f82a4d8c9fc03336 WatchSource:0}: Error finding container 80743b7b1eb167658df4162742f76ccd3626d56e96f83ec3f82a4d8c9fc03336: Status 404 returned error can't find the container with id 80743b7b1eb167658df4162742f76ccd3626d56e96f83ec3f82a4d8c9fc03336
Jul 20 13:14:55.555803 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:14:55.555779    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4490cdf-9f4b6b4c6-l72rz" event={"ID":"226a405f-dc09-4ba4-9191-309c33713601","Type":"ContainerStarted","Data":"80743b7b1eb167658df4162742f76ccd3626d56e96f83ec3f82a4d8c9fc03336"}
Jul 20 13:14:56.566497 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:14:56.566461    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4490cdf-9f4b6b4c6-l72rz" event={"ID":"226a405f-dc09-4ba4-9191-309c33713601","Type":"ContainerStarted","Data":"2bd74f2a6363b0bf27953de81319768d3b4c19ca9846b481cb75581004c2b13d"}
Jul 20 13:14:56.566975 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:14:56.566603    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4490cdf-9f4b6b4c6-l72rz"
Jul 20 13:14:56.586642 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:14:56.586591    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4490cdf-9f4b6b4c6-l72rz" podStartSLOduration=3.073549534 podStartE2EDuration="3.586575829s" totalImagesPullingTime="513.026295ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:14:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:14:56.584067852 +0000 UTC m=+1809.339117228" watchObservedRunningTime="2026-07-20 13:14:56.586575829 +0000 UTC m=+1809.341625207"
Jul 20 13:15:02.579384 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:15:02.579350    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4490cdf-9f4b6b4c6-l72rz"
Jul 20 13:15:15.951199 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:15:15.951152    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f4490cdf-9f4b6b4c6-l72rz"]
Jul 20 13:15:15.951724 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:15:15.951372    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4490cdf-9f4b6b4c6-l72rz" podUID="226a405f-dc09-4ba4-9191-309c33713601" containerName="maas-api" containerID="cri-o://2bd74f2a6363b0bf27953de81319768d3b4c19ca9846b481cb75581004c2b13d" gracePeriod=30
Jul 20 13:15:16.208095 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:15:16.208012    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4490cdf-9f4b6b4c6-l72rz"
Jul 20 13:15:16.324772 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:15:16.324729    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tntdg\" (UniqueName: \"kubernetes.io/projected/226a405f-dc09-4ba4-9191-309c33713601-kube-api-access-tntdg\") pod \"226a405f-dc09-4ba4-9191-309c33713601\" (UID: \"226a405f-dc09-4ba4-9191-309c33713601\") "
Jul 20 13:15:16.324772 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:15:16.324773    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/226a405f-dc09-4ba4-9191-309c33713601-maas-api-tls\") pod \"226a405f-dc09-4ba4-9191-309c33713601\" (UID: \"226a405f-dc09-4ba4-9191-309c33713601\") "
Jul 20 13:15:16.324985 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:15:16.324805    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/226a405f-dc09-4ba4-9191-309c33713601-openshift-service-ca\") pod \"226a405f-dc09-4ba4-9191-309c33713601\" (UID: \"226a405f-dc09-4ba4-9191-309c33713601\") "
Jul 20 13:15:16.325223 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:15:16.325198    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/226a405f-dc09-4ba4-9191-309c33713601-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "226a405f-dc09-4ba4-9191-309c33713601" (UID: "226a405f-dc09-4ba4-9191-309c33713601"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:15:16.326954 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:15:16.326929    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/226a405f-dc09-4ba4-9191-309c33713601-kube-api-access-tntdg" (OuterVolumeSpecName: "kube-api-access-tntdg") pod "226a405f-dc09-4ba4-9191-309c33713601" (UID: "226a405f-dc09-4ba4-9191-309c33713601"). InnerVolumeSpecName "kube-api-access-tntdg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:15:16.327029 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:15:16.326949    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/226a405f-dc09-4ba4-9191-309c33713601-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "226a405f-dc09-4ba4-9191-309c33713601" (UID: "226a405f-dc09-4ba4-9191-309c33713601"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:15:16.426120 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:15:16.426053    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tntdg\" (UniqueName: \"kubernetes.io/projected/226a405f-dc09-4ba4-9191-309c33713601-kube-api-access-tntdg\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:15:16.426120 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:15:16.426117    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/226a405f-dc09-4ba4-9191-309c33713601-maas-api-tls\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:15:16.426120 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:15:16.426127    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/226a405f-dc09-4ba4-9191-309c33713601-openshift-service-ca\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:15:16.675689 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:15:16.675653    2570 generic.go:356] "Generic (PLEG): container finished" podID="226a405f-dc09-4ba4-9191-309c33713601" containerID="2bd74f2a6363b0bf27953de81319768d3b4c19ca9846b481cb75581004c2b13d" exitCode=0
Jul 20 13:15:16.675883 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:15:16.675700    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4490cdf-9f4b6b4c6-l72rz"
Jul 20 13:15:16.675883 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:15:16.675735    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4490cdf-9f4b6b4c6-l72rz" event={"ID":"226a405f-dc09-4ba4-9191-309c33713601","Type":"ContainerDied","Data":"2bd74f2a6363b0bf27953de81319768d3b4c19ca9846b481cb75581004c2b13d"}
Jul 20 13:15:16.675883 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:15:16.675789    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4490cdf-9f4b6b4c6-l72rz" event={"ID":"226a405f-dc09-4ba4-9191-309c33713601","Type":"ContainerDied","Data":"80743b7b1eb167658df4162742f76ccd3626d56e96f83ec3f82a4d8c9fc03336"}
Jul 20 13:15:16.675883 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:15:16.675813    2570 scope.go:117] "RemoveContainer" containerID="2bd74f2a6363b0bf27953de81319768d3b4c19ca9846b481cb75581004c2b13d"
Jul 20 13:15:16.691245 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:15:16.691217    2570 scope.go:117] "RemoveContainer" containerID="2bd74f2a6363b0bf27953de81319768d3b4c19ca9846b481cb75581004c2b13d"
Jul 20 13:15:16.691609 ip-10-0-139-1 kubenswrapper[2570]: E0720 13:15:16.691588    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2bd74f2a6363b0bf27953de81319768d3b4c19ca9846b481cb75581004c2b13d\": container with ID starting with 2bd74f2a6363b0bf27953de81319768d3b4c19ca9846b481cb75581004c2b13d not found: ID does not exist" containerID="2bd74f2a6363b0bf27953de81319768d3b4c19ca9846b481cb75581004c2b13d"
Jul 20 13:15:16.691690 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:15:16.691616    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bd74f2a6363b0bf27953de81319768d3b4c19ca9846b481cb75581004c2b13d"} err="failed to get container status \"2bd74f2a6363b0bf27953de81319768d3b4c19ca9846b481cb75581004c2b13d\": rpc error: code = NotFound desc = could not find container \"2bd74f2a6363b0bf27953de81319768d3b4c19ca9846b481cb75581004c2b13d\": container with ID starting with 2bd74f2a6363b0bf27953de81319768d3b4c19ca9846b481cb75581004c2b13d not found: ID does not exist"
Jul 20 13:15:16.702882 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:15:16.702839    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f4490cdf-9f4b6b4c6-l72rz"]
Jul 20 13:15:16.707786 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:15:16.707754    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f4490cdf-9f4b6b4c6-l72rz"]
Jul 20 13:15:17.807777 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:15:17.807737    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="226a405f-dc09-4ba4-9191-309c33713601" path="/var/lib/kubelet/pods/226a405f-dc09-4ba4-9191-309c33713601/volumes"
Jul 20 13:15:50.036759 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:15:50.036721    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0288096f-7577f7c459-767zn"]
Jul 20 13:15:50.037225 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:15:50.037165    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="226a405f-dc09-4ba4-9191-309c33713601" containerName="maas-api"
Jul 20 13:15:50.037225 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:15:50.037211    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="226a405f-dc09-4ba4-9191-309c33713601" containerName="maas-api"
Jul 20 13:15:50.037315 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:15:50.037302    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="226a405f-dc09-4ba4-9191-309c33713601" containerName="maas-api"
Jul 20 13:15:50.040439 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:15:50.040413    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0288096f-7577f7c459-767zn"
Jul 20 13:15:50.044052 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:15:50.044026    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 13:15:50.044276 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:15:50.044170    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-0288096f-serving-cert\""
Jul 20 13:15:50.044276 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:15:50.044190    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 20 13:15:50.045772 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:15:50.045750    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-ts9xh\""
Jul 20 13:15:50.054428 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:15:50.054396    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0288096f-7577f7c459-767zn"]
Jul 20 13:15:50.128738 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:15:50.128694    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6848t\" (UniqueName: \"kubernetes.io/projected/f94a7777-af24-44fa-bc26-1afa707ae086-kube-api-access-6848t\") pod \"maas-api-e2e-mt-0288096f-7577f7c459-767zn\" (UID: \"f94a7777-af24-44fa-bc26-1afa707ae086\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0288096f-7577f7c459-767zn"
Jul 20 13:15:50.128934 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:15:50.128756    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f94a7777-af24-44fa-bc26-1afa707ae086-openshift-service-ca\") pod \"maas-api-e2e-mt-0288096f-7577f7c459-767zn\" (UID: \"f94a7777-af24-44fa-bc26-1afa707ae086\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0288096f-7577f7c459-767zn"
Jul 20 13:15:50.128934 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:15:50.128795    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f94a7777-af24-44fa-bc26-1afa707ae086-maas-api-tls\") pod \"maas-api-e2e-mt-0288096f-7577f7c459-767zn\" (UID: \"f94a7777-af24-44fa-bc26-1afa707ae086\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0288096f-7577f7c459-767zn"
Jul 20 13:15:50.229764 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:15:50.229718    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6848t\" (UniqueName: \"kubernetes.io/projected/f94a7777-af24-44fa-bc26-1afa707ae086-kube-api-access-6848t\") pod \"maas-api-e2e-mt-0288096f-7577f7c459-767zn\" (UID: \"f94a7777-af24-44fa-bc26-1afa707ae086\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0288096f-7577f7c459-767zn"
Jul 20 13:15:50.229978 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:15:50.229783    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f94a7777-af24-44fa-bc26-1afa707ae086-openshift-service-ca\") pod \"maas-api-e2e-mt-0288096f-7577f7c459-767zn\" (UID: \"f94a7777-af24-44fa-bc26-1afa707ae086\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0288096f-7577f7c459-767zn"
Jul 20 13:15:50.229978 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:15:50.229820    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f94a7777-af24-44fa-bc26-1afa707ae086-maas-api-tls\") pod \"maas-api-e2e-mt-0288096f-7577f7c459-767zn\" (UID: \"f94a7777-af24-44fa-bc26-1afa707ae086\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0288096f-7577f7c459-767zn"
Jul 20 13:15:50.230554 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:15:50.230527    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f94a7777-af24-44fa-bc26-1afa707ae086-openshift-service-ca\") pod \"maas-api-e2e-mt-0288096f-7577f7c459-767zn\" (UID: \"f94a7777-af24-44fa-bc26-1afa707ae086\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0288096f-7577f7c459-767zn"
Jul 20 13:15:50.232364 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:15:50.232333    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f94a7777-af24-44fa-bc26-1afa707ae086-maas-api-tls\") pod \"maas-api-e2e-mt-0288096f-7577f7c459-767zn\" (UID: \"f94a7777-af24-44fa-bc26-1afa707ae086\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0288096f-7577f7c459-767zn"
Jul 20 13:15:50.245874 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:15:50.245836    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6848t\" (UniqueName: \"kubernetes.io/projected/f94a7777-af24-44fa-bc26-1afa707ae086-kube-api-access-6848t\") pod \"maas-api-e2e-mt-0288096f-7577f7c459-767zn\" (UID: \"f94a7777-af24-44fa-bc26-1afa707ae086\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0288096f-7577f7c459-767zn"
Jul 20 13:15:50.353815 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:15:50.353771    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0288096f-7577f7c459-767zn"
Jul 20 13:15:50.506419 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:15:50.506385    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0288096f-7577f7c459-767zn"]
Jul 20 13:15:50.507739 ip-10-0-139-1 kubenswrapper[2570]: W0720 13:15:50.507713    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf94a7777_af24_44fa_bc26_1afa707ae086.slice/crio-050771bf0e886b7bf7e5dfb678c654a2c530d795b29b72bf1b0686413e80b516 WatchSource:0}: Error finding container 050771bf0e886b7bf7e5dfb678c654a2c530d795b29b72bf1b0686413e80b516: Status 404 returned error can't find the container with id 050771bf0e886b7bf7e5dfb678c654a2c530d795b29b72bf1b0686413e80b516
Jul 20 13:15:50.861032 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:15:50.860996    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0288096f-7577f7c459-767zn" event={"ID":"f94a7777-af24-44fa-bc26-1afa707ae086","Type":"ContainerStarted","Data":"050771bf0e886b7bf7e5dfb678c654a2c530d795b29b72bf1b0686413e80b516"}
Jul 20 13:15:51.868562 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:15:51.868524    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0288096f-7577f7c459-767zn" event={"ID":"f94a7777-af24-44fa-bc26-1afa707ae086","Type":"ContainerStarted","Data":"c02c60e9a57e5b97810538ba5ad235613cf022d056f007af34b26f350c0b5968"}
Jul 20 13:15:51.869066 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:15:51.868646    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0288096f-7577f7c459-767zn"
Jul 20 13:15:51.888897 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:15:51.888840    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0288096f-7577f7c459-767zn" podStartSLOduration=1.282155946 podStartE2EDuration="1.888822001s" totalImagesPullingTime="606.666055ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:15:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:15:51.887632785 +0000 UTC m=+1864.642682164" watchObservedRunningTime="2026-07-20 13:15:51.888822001 +0000 UTC m=+1864.643871374"
Jul 20 13:15:57.880146 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:15:57.880112    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0288096f-7577f7c459-767zn"
Jul 20 13:16:13.225974 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:16:13.225895    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-0288096f/e2e-lifecycle-model-0288096f-kserve-69d75f8859-q98mc"]
Jul 20 13:16:13.229295 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:16:13.229278    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-0288096f/e2e-lifecycle-model-0288096f-kserve-69d75f8859-q98mc"
Jul 20 13:16:13.239689 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:16:13.239656    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-0288096f\"/\"default-dockercfg-68lfn\""
Jul 20 13:16:13.239816 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:16:13.239708    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-0288096f\"/\"kube-root-ca.crt\""
Jul 20 13:16:13.239816 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:16:13.239708    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-0288096f\"/\"e2e-lifecycle-model-0288096f-kserve-self-signed-certs\""
Jul 20 13:16:13.239816 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:16:13.239708    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-0288096f\"/\"openshift-service-ca.crt\""
Jul 20 13:16:13.248389 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:16:13.248360    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-0288096f/e2e-lifecycle-model-0288096f-kserve-69d75f8859-q98mc"]
Jul 20 13:16:13.349097 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:16:13.349049    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c3b72f4-5c2f-4883-98de-005aa1d1e069-model-cache\") pod \"e2e-lifecycle-model-0288096f-kserve-69d75f8859-q98mc\" (UID: \"7c3b72f4-5c2f-4883-98de-005aa1d1e069\") " pod="ai-tenant-e2e-mt-0288096f/e2e-lifecycle-model-0288096f-kserve-69d75f8859-q98mc"
Jul 20 13:16:13.349097 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:16:13.349103    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c3b72f4-5c2f-4883-98de-005aa1d1e069-tmp-dir\") pod \"e2e-lifecycle-model-0288096f-kserve-69d75f8859-q98mc\" (UID: \"7c3b72f4-5c2f-4883-98de-005aa1d1e069\") " pod="ai-tenant-e2e-mt-0288096f/e2e-lifecycle-model-0288096f-kserve-69d75f8859-q98mc"
Jul 20 13:16:13.349333 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:16:13.349129    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zt4nj\" (UniqueName: \"kubernetes.io/projected/7c3b72f4-5c2f-4883-98de-005aa1d1e069-kube-api-access-zt4nj\") pod \"e2e-lifecycle-model-0288096f-kserve-69d75f8859-q98mc\" (UID: \"7c3b72f4-5c2f-4883-98de-005aa1d1e069\") " pod="ai-tenant-e2e-mt-0288096f/e2e-lifecycle-model-0288096f-kserve-69d75f8859-q98mc"
Jul 20 13:16:13.349333 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:16:13.349175    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c3b72f4-5c2f-4883-98de-005aa1d1e069-tls-certs\") pod \"e2e-lifecycle-model-0288096f-kserve-69d75f8859-q98mc\" (UID: \"7c3b72f4-5c2f-4883-98de-005aa1d1e069\") " pod="ai-tenant-e2e-mt-0288096f/e2e-lifecycle-model-0288096f-kserve-69d75f8859-q98mc"
Jul 20 13:16:13.349333 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:16:13.349251    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c3b72f4-5c2f-4883-98de-005aa1d1e069-home\") pod \"e2e-lifecycle-model-0288096f-kserve-69d75f8859-q98mc\" (UID: \"7c3b72f4-5c2f-4883-98de-005aa1d1e069\") " pod="ai-tenant-e2e-mt-0288096f/e2e-lifecycle-model-0288096f-kserve-69d75f8859-q98mc"
Jul 20 13:16:13.349333 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:16:13.349305    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c3b72f4-5c2f-4883-98de-005aa1d1e069-dshm\") pod \"e2e-lifecycle-model-0288096f-kserve-69d75f8859-q98mc\" (UID: \"7c3b72f4-5c2f-4883-98de-005aa1d1e069\") " pod="ai-tenant-e2e-mt-0288096f/e2e-lifecycle-model-0288096f-kserve-69d75f8859-q98mc"
Jul 20 13:16:13.450375 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:16:13.450331    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c3b72f4-5c2f-4883-98de-005aa1d1e069-dshm\") pod \"e2e-lifecycle-model-0288096f-kserve-69d75f8859-q98mc\" (UID: \"7c3b72f4-5c2f-4883-98de-005aa1d1e069\") " pod="ai-tenant-e2e-mt-0288096f/e2e-lifecycle-model-0288096f-kserve-69d75f8859-q98mc"
Jul 20 13:16:13.450565 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:16:13.450403    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c3b72f4-5c2f-4883-98de-005aa1d1e069-model-cache\") pod \"e2e-lifecycle-model-0288096f-kserve-69d75f8859-q98mc\" (UID: \"7c3b72f4-5c2f-4883-98de-005aa1d1e069\") " pod="ai-tenant-e2e-mt-0288096f/e2e-lifecycle-model-0288096f-kserve-69d75f8859-q98mc"
Jul 20 13:16:13.450565 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:16:13.450430    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c3b72f4-5c2f-4883-98de-005aa1d1e069-tmp-dir\") pod \"e2e-lifecycle-model-0288096f-kserve-69d75f8859-q98mc\" (UID: \"7c3b72f4-5c2f-4883-98de-005aa1d1e069\") " pod="ai-tenant-e2e-mt-0288096f/e2e-lifecycle-model-0288096f-kserve-69d75f8859-q98mc"
Jul 20 13:16:13.450565 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:16:13.450450    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zt4nj\" (UniqueName: \"kubernetes.io/projected/7c3b72f4-5c2f-4883-98de-005aa1d1e069-kube-api-access-zt4nj\") pod \"e2e-lifecycle-model-0288096f-kserve-69d75f8859-q98mc\" (UID: \"7c3b72f4-5c2f-4883-98de-005aa1d1e069\") " pod="ai-tenant-e2e-mt-0288096f/e2e-lifecycle-model-0288096f-kserve-69d75f8859-q98mc"
Jul 20 13:16:13.450716 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:16:13.450603    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c3b72f4-5c2f-4883-98de-005aa1d1e069-tls-certs\") pod \"e2e-lifecycle-model-0288096f-kserve-69d75f8859-q98mc\" (UID: \"7c3b72f4-5c2f-4883-98de-005aa1d1e069\") " pod="ai-tenant-e2e-mt-0288096f/e2e-lifecycle-model-0288096f-kserve-69d75f8859-q98mc"
Jul 20 13:16:13.450716 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:16:13.450695    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c3b72f4-5c2f-4883-98de-005aa1d1e069-home\") pod \"e2e-lifecycle-model-0288096f-kserve-69d75f8859-q98mc\" (UID: \"7c3b72f4-5c2f-4883-98de-005aa1d1e069\") " pod="ai-tenant-e2e-mt-0288096f/e2e-lifecycle-model-0288096f-kserve-69d75f8859-q98mc"
Jul 20 13:16:13.450890 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:16:13.450871    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c3b72f4-5c2f-4883-98de-005aa1d1e069-model-cache\") pod \"e2e-lifecycle-model-0288096f-kserve-69d75f8859-q98mc\" (UID: \"7c3b72f4-5c2f-4883-98de-005aa1d1e069\") " pod="ai-tenant-e2e-mt-0288096f/e2e-lifecycle-model-0288096f-kserve-69d75f8859-q98mc"
Jul 20 13:16:13.450957 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:16:13.450922    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c3b72f4-5c2f-4883-98de-005aa1d1e069-tmp-dir\") pod \"e2e-lifecycle-model-0288096f-kserve-69d75f8859-q98mc\" (UID: \"7c3b72f4-5c2f-4883-98de-005aa1d1e069\") " pod="ai-tenant-e2e-mt-0288096f/e2e-lifecycle-model-0288096f-kserve-69d75f8859-q98mc"
Jul 20 13:16:13.451016 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:16:13.450978    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c3b72f4-5c2f-4883-98de-005aa1d1e069-home\") pod \"e2e-lifecycle-model-0288096f-kserve-69d75f8859-q98mc\" (UID: \"7c3b72f4-5c2f-4883-98de-005aa1d1e069\") " pod="ai-tenant-e2e-mt-0288096f/e2e-lifecycle-model-0288096f-kserve-69d75f8859-q98mc"
Jul 20 13:16:13.452705 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:16:13.452682    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c3b72f4-5c2f-4883-98de-005aa1d1e069-dshm\") pod \"e2e-lifecycle-model-0288096f-kserve-69d75f8859-q98mc\" (UID: \"7c3b72f4-5c2f-4883-98de-005aa1d1e069\") " pod="ai-tenant-e2e-mt-0288096f/e2e-lifecycle-model-0288096f-kserve-69d75f8859-q98mc"
Jul 20 13:16:13.453021 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:16:13.453001    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c3b72f4-5c2f-4883-98de-005aa1d1e069-tls-certs\") pod \"e2e-lifecycle-model-0288096f-kserve-69d75f8859-q98mc\" (UID: \"7c3b72f4-5c2f-4883-98de-005aa1d1e069\") " pod="ai-tenant-e2e-mt-0288096f/e2e-lifecycle-model-0288096f-kserve-69d75f8859-q98mc"
Jul 20 13:16:13.459548 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:16:13.459524    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zt4nj\" (UniqueName: \"kubernetes.io/projected/7c3b72f4-5c2f-4883-98de-005aa1d1e069-kube-api-access-zt4nj\") pod \"e2e-lifecycle-model-0288096f-kserve-69d75f8859-q98mc\" (UID: \"7c3b72f4-5c2f-4883-98de-005aa1d1e069\") " pod="ai-tenant-e2e-mt-0288096f/e2e-lifecycle-model-0288096f-kserve-69d75f8859-q98mc"
Jul 20 13:16:13.539369 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:16:13.539259    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-0288096f/e2e-lifecycle-model-0288096f-kserve-69d75f8859-q98mc"
Jul 20 13:16:13.678664 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:16:13.678631    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-0288096f/e2e-lifecycle-model-0288096f-kserve-69d75f8859-q98mc"]
Jul 20 13:16:13.679847 ip-10-0-139-1 kubenswrapper[2570]: W0720 13:16:13.679817    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7c3b72f4_5c2f_4883_98de_005aa1d1e069.slice/crio-a63c356f512712a3447788b61140e2eea186d046320014a5fc265e6fd7ccbb42 WatchSource:0}: Error finding container a63c356f512712a3447788b61140e2eea186d046320014a5fc265e6fd7ccbb42: Status 404 returned error can't find the container with id a63c356f512712a3447788b61140e2eea186d046320014a5fc265e6fd7ccbb42
Jul 20 13:16:13.991333 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:16:13.991294    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-0288096f/e2e-lifecycle-model-0288096f-kserve-69d75f8859-q98mc" event={"ID":"7c3b72f4-5c2f-4883-98de-005aa1d1e069","Type":"ContainerStarted","Data":"da3dfd8cb811a66af969b8e366a2343eb5f6eb478470da37b7d7e147ec7da46d"}
Jul 20 13:16:13.991547 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:16:13.991339    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-0288096f/e2e-lifecycle-model-0288096f-kserve-69d75f8859-q98mc" event={"ID":"7c3b72f4-5c2f-4883-98de-005aa1d1e069","Type":"ContainerStarted","Data":"a63c356f512712a3447788b61140e2eea186d046320014a5fc265e6fd7ccbb42"}
Jul 20 13:16:14.010114 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:16:14.010029    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-0288096f/e2e-lifecycle-model-0288096f-kserve-69d75f8859-q98mc" podStartSLOduration=1.010013506 podStartE2EDuration="1.010013506s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:16:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:16:14.009488169 +0000 UTC m=+1886.764537545" watchObservedRunningTime="2026-07-20 13:16:14.010013506 +0000 UTC m=+1886.765062881"
Jul 20 13:16:23.540322 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:16:23.540277    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-0288096f/e2e-lifecycle-model-0288096f-kserve-69d75f8859-q98mc"
Jul 20 13:16:23.540751 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:16:23.540370    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-0288096f/e2e-lifecycle-model-0288096f-kserve-69d75f8859-q98mc"
Jul 20 13:16:23.553066 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:16:23.553035    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-0288096f/e2e-lifecycle-model-0288096f-kserve-69d75f8859-q98mc"
Jul 20 13:16:24.055278 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:16:24.055238    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-0288096f/e2e-lifecycle-model-0288096f-kserve-69d75f8859-q98mc"
Jul 20 13:16:47.957134 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:16:47.957081    2570 scope.go:117] "RemoveContainer" containerID="99b5356244bbc185f04d6a387356a2cfd45b37c55aaa576590e8f8196d5b9348"
Jul 20 13:16:53.581072 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:16:53.581021    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0288096f-7577f7c459-767zn"]
Jul 20 13:16:53.581659 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:16:53.581299    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0288096f-7577f7c459-767zn" podUID="f94a7777-af24-44fa-bc26-1afa707ae086" containerName="maas-api" containerID="cri-o://c02c60e9a57e5b97810538ba5ad235613cf022d056f007af34b26f350c0b5968" gracePeriod=30
Jul 20 13:16:53.835440 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:16:53.835356    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0288096f-7577f7c459-767zn"
Jul 20 13:16:53.932397 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:16:53.932362    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6848t\" (UniqueName: \"kubernetes.io/projected/f94a7777-af24-44fa-bc26-1afa707ae086-kube-api-access-6848t\") pod \"f94a7777-af24-44fa-bc26-1afa707ae086\" (UID: \"f94a7777-af24-44fa-bc26-1afa707ae086\") "
Jul 20 13:16:53.932576 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:16:53.932478    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f94a7777-af24-44fa-bc26-1afa707ae086-maas-api-tls\") pod \"f94a7777-af24-44fa-bc26-1afa707ae086\" (UID: \"f94a7777-af24-44fa-bc26-1afa707ae086\") "
Jul 20 13:16:53.932576 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:16:53.932508    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f94a7777-af24-44fa-bc26-1afa707ae086-openshift-service-ca\") pod \"f94a7777-af24-44fa-bc26-1afa707ae086\" (UID: \"f94a7777-af24-44fa-bc26-1afa707ae086\") "
Jul 20 13:16:53.932915 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:16:53.932889    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f94a7777-af24-44fa-bc26-1afa707ae086-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f94a7777-af24-44fa-bc26-1afa707ae086" (UID: "f94a7777-af24-44fa-bc26-1afa707ae086"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:16:53.934580 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:16:53.934549    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f94a7777-af24-44fa-bc26-1afa707ae086-kube-api-access-6848t" (OuterVolumeSpecName: "kube-api-access-6848t") pod "f94a7777-af24-44fa-bc26-1afa707ae086" (UID: "f94a7777-af24-44fa-bc26-1afa707ae086"). InnerVolumeSpecName "kube-api-access-6848t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:16:53.934702 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:16:53.934575    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f94a7777-af24-44fa-bc26-1afa707ae086-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f94a7777-af24-44fa-bc26-1afa707ae086" (UID: "f94a7777-af24-44fa-bc26-1afa707ae086"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:16:54.033258 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:16:54.033212    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6848t\" (UniqueName: \"kubernetes.io/projected/f94a7777-af24-44fa-bc26-1afa707ae086-kube-api-access-6848t\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:16:54.033258 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:16:54.033248    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f94a7777-af24-44fa-bc26-1afa707ae086-maas-api-tls\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:16:54.033258 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:16:54.033258    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f94a7777-af24-44fa-bc26-1afa707ae086-openshift-service-ca\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:16:54.214622 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:16:54.214522    2570 generic.go:356] "Generic (PLEG): container finished" podID="f94a7777-af24-44fa-bc26-1afa707ae086" containerID="c02c60e9a57e5b97810538ba5ad235613cf022d056f007af34b26f350c0b5968" exitCode=0
Jul 20 13:16:54.214622 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:16:54.214570    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0288096f-7577f7c459-767zn"
Jul 20 13:16:54.214823 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:16:54.214613    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0288096f-7577f7c459-767zn" event={"ID":"f94a7777-af24-44fa-bc26-1afa707ae086","Type":"ContainerDied","Data":"c02c60e9a57e5b97810538ba5ad235613cf022d056f007af34b26f350c0b5968"}
Jul 20 13:16:54.214823 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:16:54.214673    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0288096f-7577f7c459-767zn" event={"ID":"f94a7777-af24-44fa-bc26-1afa707ae086","Type":"ContainerDied","Data":"050771bf0e886b7bf7e5dfb678c654a2c530d795b29b72bf1b0686413e80b516"}
Jul 20 13:16:54.214823 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:16:54.214696    2570 scope.go:117] "RemoveContainer" containerID="c02c60e9a57e5b97810538ba5ad235613cf022d056f007af34b26f350c0b5968"
Jul 20 13:16:54.224716 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:16:54.224691    2570 scope.go:117] "RemoveContainer" containerID="c02c60e9a57e5b97810538ba5ad235613cf022d056f007af34b26f350c0b5968"
Jul 20 13:16:54.225029 ip-10-0-139-1 kubenswrapper[2570]: E0720 13:16:54.225012    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c02c60e9a57e5b97810538ba5ad235613cf022d056f007af34b26f350c0b5968\": container with ID starting with c02c60e9a57e5b97810538ba5ad235613cf022d056f007af34b26f350c0b5968 not found: ID does not exist" containerID="c02c60e9a57e5b97810538ba5ad235613cf022d056f007af34b26f350c0b5968"
Jul 20 13:16:54.225122 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:16:54.225038    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c02c60e9a57e5b97810538ba5ad235613cf022d056f007af34b26f350c0b5968"} err="failed to get container status \"c02c60e9a57e5b97810538ba5ad235613cf022d056f007af34b26f350c0b5968\": rpc error: code = NotFound desc = could not find container \"c02c60e9a57e5b97810538ba5ad235613cf022d056f007af34b26f350c0b5968\": container with ID starting with c02c60e9a57e5b97810538ba5ad235613cf022d056f007af34b26f350c0b5968 not found: ID does not exist"
Jul 20 13:16:54.242577 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:16:54.242546    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0288096f-7577f7c459-767zn"]
Jul 20 13:16:54.244693 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:16:54.244670    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0288096f-7577f7c459-767zn"]
Jul 20 13:16:55.807568 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:16:55.807532    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f94a7777-af24-44fa-bc26-1afa707ae086" path="/var/lib/kubelet/pods/f94a7777-af24-44fa-bc26-1afa707ae086/volumes"
Jul 20 13:17:05.311034 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:17:05.310993    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-0288096f/e2e-lifecycle-model-0288096f-kserve-69d75f8859-q98mc"]
Jul 20 13:17:20.332071 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:17:20.332005    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-0288096f/e2e-lifecycle-model-0288096f-kserve-69d75f8859-q98mc" podUID="7c3b72f4-5c2f-4883-98de-005aa1d1e069" containerName="main" containerID="cri-o://da3dfd8cb811a66af969b8e366a2343eb5f6eb478470da37b7d7e147ec7da46d" gracePeriod=45
Jul 20 13:17:20.587784 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:17:20.587716    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-0288096f/e2e-lifecycle-model-0288096f-kserve-69d75f8859-q98mc"
Jul 20 13:17:20.682966 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:17:20.682933    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c3b72f4-5c2f-4883-98de-005aa1d1e069-dshm\") pod \"7c3b72f4-5c2f-4883-98de-005aa1d1e069\" (UID: \"7c3b72f4-5c2f-4883-98de-005aa1d1e069\") "
Jul 20 13:17:20.683178 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:17:20.682980    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c3b72f4-5c2f-4883-98de-005aa1d1e069-model-cache\") pod \"7c3b72f4-5c2f-4883-98de-005aa1d1e069\" (UID: \"7c3b72f4-5c2f-4883-98de-005aa1d1e069\") "
Jul 20 13:17:20.683178 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:17:20.683022    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c3b72f4-5c2f-4883-98de-005aa1d1e069-tls-certs\") pod \"7c3b72f4-5c2f-4883-98de-005aa1d1e069\" (UID: \"7c3b72f4-5c2f-4883-98de-005aa1d1e069\") "
Jul 20 13:17:20.683178 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:17:20.683046    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zt4nj\" (UniqueName: \"kubernetes.io/projected/7c3b72f4-5c2f-4883-98de-005aa1d1e069-kube-api-access-zt4nj\") pod \"7c3b72f4-5c2f-4883-98de-005aa1d1e069\" (UID: \"7c3b72f4-5c2f-4883-98de-005aa1d1e069\") "
Jul 20 13:17:20.683178 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:17:20.683069    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c3b72f4-5c2f-4883-98de-005aa1d1e069-tmp-dir\") pod \"7c3b72f4-5c2f-4883-98de-005aa1d1e069\" (UID: \"7c3b72f4-5c2f-4883-98de-005aa1d1e069\") "
Jul 20 13:17:20.683178 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:17:20.683167    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c3b72f4-5c2f-4883-98de-005aa1d1e069-home\") pod \"7c3b72f4-5c2f-4883-98de-005aa1d1e069\" (UID: \"7c3b72f4-5c2f-4883-98de-005aa1d1e069\") "
Jul 20 13:17:20.683470 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:17:20.683291    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c3b72f4-5c2f-4883-98de-005aa1d1e069-model-cache" (OuterVolumeSpecName: "model-cache") pod "7c3b72f4-5c2f-4883-98de-005aa1d1e069" (UID: "7c3b72f4-5c2f-4883-98de-005aa1d1e069"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:17:20.683470 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:17:20.683399    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c3b72f4-5c2f-4883-98de-005aa1d1e069-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7c3b72f4-5c2f-4883-98de-005aa1d1e069" (UID: "7c3b72f4-5c2f-4883-98de-005aa1d1e069"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:17:20.683470 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:17:20.683421    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c3b72f4-5c2f-4883-98de-005aa1d1e069-home" (OuterVolumeSpecName: "home") pod "7c3b72f4-5c2f-4883-98de-005aa1d1e069" (UID: "7c3b72f4-5c2f-4883-98de-005aa1d1e069"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:17:20.683595 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:17:20.683549    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c3b72f4-5c2f-4883-98de-005aa1d1e069-home\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:17:20.683595 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:17:20.683560    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c3b72f4-5c2f-4883-98de-005aa1d1e069-model-cache\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:17:20.683595 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:17:20.683569    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c3b72f4-5c2f-4883-98de-005aa1d1e069-tmp-dir\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:17:20.685277 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:17:20.685253    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c3b72f4-5c2f-4883-98de-005aa1d1e069-kube-api-access-zt4nj" (OuterVolumeSpecName: "kube-api-access-zt4nj") pod "7c3b72f4-5c2f-4883-98de-005aa1d1e069" (UID: "7c3b72f4-5c2f-4883-98de-005aa1d1e069"). InnerVolumeSpecName "kube-api-access-zt4nj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:17:20.685519 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:17:20.685504    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c3b72f4-5c2f-4883-98de-005aa1d1e069-dshm" (OuterVolumeSpecName: "dshm") pod "7c3b72f4-5c2f-4883-98de-005aa1d1e069" (UID: "7c3b72f4-5c2f-4883-98de-005aa1d1e069"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:17:20.685574 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:17:20.685518    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c3b72f4-5c2f-4883-98de-005aa1d1e069-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7c3b72f4-5c2f-4883-98de-005aa1d1e069" (UID: "7c3b72f4-5c2f-4883-98de-005aa1d1e069"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:17:20.784585 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:17:20.784540    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c3b72f4-5c2f-4883-98de-005aa1d1e069-dshm\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:17:20.784585 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:17:20.784575    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c3b72f4-5c2f-4883-98de-005aa1d1e069-tls-certs\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:17:20.784585 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:17:20.784585    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zt4nj\" (UniqueName: \"kubernetes.io/projected/7c3b72f4-5c2f-4883-98de-005aa1d1e069-kube-api-access-zt4nj\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:17:21.360297 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:17:21.360263    2570 generic.go:356] "Generic (PLEG): container finished" podID="7c3b72f4-5c2f-4883-98de-005aa1d1e069" containerID="da3dfd8cb811a66af969b8e366a2343eb5f6eb478470da37b7d7e147ec7da46d" exitCode=0
Jul 20 13:17:21.360723 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:17:21.360310    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-0288096f/e2e-lifecycle-model-0288096f-kserve-69d75f8859-q98mc"
Jul 20 13:17:21.360723 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:17:21.360346    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-0288096f/e2e-lifecycle-model-0288096f-kserve-69d75f8859-q98mc" event={"ID":"7c3b72f4-5c2f-4883-98de-005aa1d1e069","Type":"ContainerDied","Data":"da3dfd8cb811a66af969b8e366a2343eb5f6eb478470da37b7d7e147ec7da46d"}
Jul 20 13:17:21.360723 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:17:21.360396    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-0288096f/e2e-lifecycle-model-0288096f-kserve-69d75f8859-q98mc" event={"ID":"7c3b72f4-5c2f-4883-98de-005aa1d1e069","Type":"ContainerDied","Data":"a63c356f512712a3447788b61140e2eea186d046320014a5fc265e6fd7ccbb42"}
Jul 20 13:17:21.360723 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:17:21.360413    2570 scope.go:117] "RemoveContainer" containerID="da3dfd8cb811a66af969b8e366a2343eb5f6eb478470da37b7d7e147ec7da46d"
Jul 20 13:17:21.369828 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:17:21.369811    2570 scope.go:117] "RemoveContainer" containerID="da3dfd8cb811a66af969b8e366a2343eb5f6eb478470da37b7d7e147ec7da46d"
Jul 20 13:17:21.370122 ip-10-0-139-1 kubenswrapper[2570]: E0720 13:17:21.370100    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da3dfd8cb811a66af969b8e366a2343eb5f6eb478470da37b7d7e147ec7da46d\": container with ID starting with da3dfd8cb811a66af969b8e366a2343eb5f6eb478470da37b7d7e147ec7da46d not found: ID does not exist" containerID="da3dfd8cb811a66af969b8e366a2343eb5f6eb478470da37b7d7e147ec7da46d"
Jul 20 13:17:21.370223 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:17:21.370131    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da3dfd8cb811a66af969b8e366a2343eb5f6eb478470da37b7d7e147ec7da46d"} err="failed to get container status \"da3dfd8cb811a66af969b8e366a2343eb5f6eb478470da37b7d7e147ec7da46d\": rpc error: code = NotFound desc = could not find container \"da3dfd8cb811a66af969b8e366a2343eb5f6eb478470da37b7d7e147ec7da46d\": container with ID starting with da3dfd8cb811a66af969b8e366a2343eb5f6eb478470da37b7d7e147ec7da46d not found: ID does not exist"
Jul 20 13:17:21.391545 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:17:21.391509    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-0288096f/e2e-lifecycle-model-0288096f-kserve-69d75f8859-q98mc"]
Jul 20 13:17:21.399127 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:17:21.399098    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-0288096f/e2e-lifecycle-model-0288096f-kserve-69d75f8859-q98mc"]
Jul 20 13:17:21.807857 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:17:21.807779    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c3b72f4-5c2f-4883-98de-005aa1d1e069" path="/var/lib/kubelet/pods/7c3b72f4-5c2f-4883-98de-005aa1d1e069/volumes"
Jul 20 13:18:54.152991 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:18:54.152958    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-98c8e4-6977dc5bb5-sbt2k"]
Jul 20 13:18:54.153518 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:18:54.153345    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c3b72f4-5c2f-4883-98de-005aa1d1e069" containerName="main"
Jul 20 13:18:54.153518 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:18:54.153357    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c3b72f4-5c2f-4883-98de-005aa1d1e069" containerName="main"
Jul 20 13:18:54.153518 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:18:54.153367    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f94a7777-af24-44fa-bc26-1afa707ae086" containerName="maas-api"
Jul 20 13:18:54.153518 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:18:54.153373    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="f94a7777-af24-44fa-bc26-1afa707ae086" containerName="maas-api"
Jul 20 13:18:54.153518 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:18:54.153435    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="f94a7777-af24-44fa-bc26-1afa707ae086" containerName="maas-api"
Jul 20 13:18:54.153518 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:18:54.153445    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c3b72f4-5c2f-4883-98de-005aa1d1e069" containerName="main"
Jul 20 13:18:54.156514 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:18:54.156494    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98c8e4-6977dc5bb5-sbt2k"
Jul 20 13:18:54.161773 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:18:54.161750    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 20 13:18:54.161993 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:18:54.161972    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-ts9xh\""
Jul 20 13:18:54.162548 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:18:54.162530    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-98c8e4-serving-cert\""
Jul 20 13:18:54.166576 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:18:54.166550    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 13:18:54.177770 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:18:54.177747    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-98c8e4-6977dc5bb5-sbt2k"]
Jul 20 13:18:54.217780 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:18:54.217745    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46xfq\" (UniqueName: \"kubernetes.io/projected/f389d2c2-438e-455f-9886-9e800ca93802-kube-api-access-46xfq\") pod \"maas-api-e2e-inf-a-98c8e4-6977dc5bb5-sbt2k\" (UID: \"f389d2c2-438e-455f-9886-9e800ca93802\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98c8e4-6977dc5bb5-sbt2k"
Jul 20 13:18:54.217951 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:18:54.217806    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f389d2c2-438e-455f-9886-9e800ca93802-maas-api-tls\") pod \"maas-api-e2e-inf-a-98c8e4-6977dc5bb5-sbt2k\" (UID: \"f389d2c2-438e-455f-9886-9e800ca93802\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98c8e4-6977dc5bb5-sbt2k"
Jul 20 13:18:54.217951 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:18:54.217830    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f389d2c2-438e-455f-9886-9e800ca93802-openshift-service-ca\") pod \"maas-api-e2e-inf-a-98c8e4-6977dc5bb5-sbt2k\" (UID: \"f389d2c2-438e-455f-9886-9e800ca93802\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98c8e4-6977dc5bb5-sbt2k"
Jul 20 13:18:54.319358 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:18:54.319323    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46xfq\" (UniqueName: \"kubernetes.io/projected/f389d2c2-438e-455f-9886-9e800ca93802-kube-api-access-46xfq\") pod \"maas-api-e2e-inf-a-98c8e4-6977dc5bb5-sbt2k\" (UID: \"f389d2c2-438e-455f-9886-9e800ca93802\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98c8e4-6977dc5bb5-sbt2k"
Jul 20 13:18:54.319538 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:18:54.319382    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f389d2c2-438e-455f-9886-9e800ca93802-maas-api-tls\") pod \"maas-api-e2e-inf-a-98c8e4-6977dc5bb5-sbt2k\" (UID: \"f389d2c2-438e-455f-9886-9e800ca93802\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98c8e4-6977dc5bb5-sbt2k"
Jul 20 13:18:54.319538 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:18:54.319401    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f389d2c2-438e-455f-9886-9e800ca93802-openshift-service-ca\") pod \"maas-api-e2e-inf-a-98c8e4-6977dc5bb5-sbt2k\" (UID: \"f389d2c2-438e-455f-9886-9e800ca93802\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98c8e4-6977dc5bb5-sbt2k"
Jul 20 13:18:54.319538 ip-10-0-139-1 kubenswrapper[2570]: E0720 13:18:54.319525    2570 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-98c8e4-serving-cert: secret "maas-api-e2e-inf-a-98c8e4-serving-cert" not found
Jul 20 13:18:54.319664 ip-10-0-139-1 kubenswrapper[2570]: E0720 13:18:54.319602    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f389d2c2-438e-455f-9886-9e800ca93802-maas-api-tls podName:f389d2c2-438e-455f-9886-9e800ca93802 nodeName:}" failed. No retries permitted until 2026-07-20 13:18:54.819584683 +0000 UTC m=+2047.574634038 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f389d2c2-438e-455f-9886-9e800ca93802-maas-api-tls") pod "maas-api-e2e-inf-a-98c8e4-6977dc5bb5-sbt2k" (UID: "f389d2c2-438e-455f-9886-9e800ca93802") : secret "maas-api-e2e-inf-a-98c8e4-serving-cert" not found
Jul 20 13:18:54.319978 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:18:54.319959    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f389d2c2-438e-455f-9886-9e800ca93802-openshift-service-ca\") pod \"maas-api-e2e-inf-a-98c8e4-6977dc5bb5-sbt2k\" (UID: \"f389d2c2-438e-455f-9886-9e800ca93802\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98c8e4-6977dc5bb5-sbt2k"
Jul 20 13:18:54.340518 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:18:54.340484    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46xfq\" (UniqueName: \"kubernetes.io/projected/f389d2c2-438e-455f-9886-9e800ca93802-kube-api-access-46xfq\") pod \"maas-api-e2e-inf-a-98c8e4-6977dc5bb5-sbt2k\" (UID: \"f389d2c2-438e-455f-9886-9e800ca93802\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98c8e4-6977dc5bb5-sbt2k"
Jul 20 13:18:54.822988 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:18:54.822949    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f389d2c2-438e-455f-9886-9e800ca93802-maas-api-tls\") pod \"maas-api-e2e-inf-a-98c8e4-6977dc5bb5-sbt2k\" (UID: \"f389d2c2-438e-455f-9886-9e800ca93802\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98c8e4-6977dc5bb5-sbt2k"
Jul 20 13:18:54.825340 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:18:54.825308    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f389d2c2-438e-455f-9886-9e800ca93802-maas-api-tls\") pod \"maas-api-e2e-inf-a-98c8e4-6977dc5bb5-sbt2k\" (UID: \"f389d2c2-438e-455f-9886-9e800ca93802\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98c8e4-6977dc5bb5-sbt2k"
Jul 20 13:18:55.066906 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:18:55.066865    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98c8e4-6977dc5bb5-sbt2k"
Jul 20 13:18:55.242176 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:18:55.242149    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-98c8e4-6977dc5bb5-sbt2k"]
Jul 20 13:18:55.243517 ip-10-0-139-1 kubenswrapper[2570]: W0720 13:18:55.243490    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf389d2c2_438e_455f_9886_9e800ca93802.slice/crio-b6f35570d8921887eabd271b4f9df8ad31e110717ea23e3e60ef7eb02391e7dc WatchSource:0}: Error finding container b6f35570d8921887eabd271b4f9df8ad31e110717ea23e3e60ef7eb02391e7dc: Status 404 returned error can't find the container with id b6f35570d8921887eabd271b4f9df8ad31e110717ea23e3e60ef7eb02391e7dc
Jul 20 13:18:55.245006 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:18:55.244985    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 13:18:55.873156 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:18:55.873115    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98c8e4-6977dc5bb5-sbt2k" event={"ID":"f389d2c2-438e-455f-9886-9e800ca93802","Type":"ContainerStarted","Data":"b6f35570d8921887eabd271b4f9df8ad31e110717ea23e3e60ef7eb02391e7dc"}
Jul 20 13:18:56.879525 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:18:56.879485    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98c8e4-6977dc5bb5-sbt2k" event={"ID":"f389d2c2-438e-455f-9886-9e800ca93802","Type":"ContainerStarted","Data":"89d64d87663afd3f881fad8772ae72c25e1e0fcb182bf7a3a3116cda00ab27c4"}
Jul 20 13:18:56.879979 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:18:56.879594    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98c8e4-6977dc5bb5-sbt2k"
Jul 20 13:18:56.905103 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:18:56.905034    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98c8e4-6977dc5bb5-sbt2k" podStartSLOduration=1.608757078 podStartE2EDuration="2.905019178s" totalImagesPullingTime="1.2962621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:18:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:18:56.902927493 +0000 UTC m=+2049.657976867" watchObservedRunningTime="2026-07-20 13:18:56.905019178 +0000 UTC m=+2049.660068553"
Jul 20 13:19:02.640794 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:19:02.640754    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-1feb1a-7f67dcc46c-kc95s"]
Jul 20 13:19:02.645111 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:19:02.645074    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1feb1a-7f67dcc46c-kc95s"
Jul 20 13:19:02.650923 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:19:02.650897    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-1feb1a-serving-cert\""
Jul 20 13:19:02.660133 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:19:02.660104    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-1feb1a-7f67dcc46c-kc95s"]
Jul 20 13:19:02.693886 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:19:02.693849    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt7z9\" (UniqueName: \"kubernetes.io/projected/c1daf0fc-292b-4f03-ad96-fc0fd4a13fa7-kube-api-access-pt7z9\") pod \"maas-api-e2e-inf-b-1feb1a-7f67dcc46c-kc95s\" (UID: \"c1daf0fc-292b-4f03-ad96-fc0fd4a13fa7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1feb1a-7f67dcc46c-kc95s"
Jul 20 13:19:02.694069 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:19:02.693993    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1daf0fc-292b-4f03-ad96-fc0fd4a13fa7-maas-api-tls\") pod \"maas-api-e2e-inf-b-1feb1a-7f67dcc46c-kc95s\" (UID: \"c1daf0fc-292b-4f03-ad96-fc0fd4a13fa7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1feb1a-7f67dcc46c-kc95s"
Jul 20 13:19:02.694069 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:19:02.694034    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1daf0fc-292b-4f03-ad96-fc0fd4a13fa7-openshift-service-ca\") pod \"maas-api-e2e-inf-b-1feb1a-7f67dcc46c-kc95s\" (UID: \"c1daf0fc-292b-4f03-ad96-fc0fd4a13fa7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1feb1a-7f67dcc46c-kc95s"
Jul 20 13:19:02.795345 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:19:02.795301    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pt7z9\" (UniqueName: \"kubernetes.io/projected/c1daf0fc-292b-4f03-ad96-fc0fd4a13fa7-kube-api-access-pt7z9\") pod \"maas-api-e2e-inf-b-1feb1a-7f67dcc46c-kc95s\" (UID: \"c1daf0fc-292b-4f03-ad96-fc0fd4a13fa7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1feb1a-7f67dcc46c-kc95s"
Jul 20 13:19:02.795504 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:19:02.795411    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1daf0fc-292b-4f03-ad96-fc0fd4a13fa7-maas-api-tls\") pod \"maas-api-e2e-inf-b-1feb1a-7f67dcc46c-kc95s\" (UID: \"c1daf0fc-292b-4f03-ad96-fc0fd4a13fa7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1feb1a-7f67dcc46c-kc95s"
Jul 20 13:19:02.795504 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:19:02.795441    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1daf0fc-292b-4f03-ad96-fc0fd4a13fa7-openshift-service-ca\") pod \"maas-api-e2e-inf-b-1feb1a-7f67dcc46c-kc95s\" (UID: \"c1daf0fc-292b-4f03-ad96-fc0fd4a13fa7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1feb1a-7f67dcc46c-kc95s"
Jul 20 13:19:02.796211 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:19:02.796192    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1daf0fc-292b-4f03-ad96-fc0fd4a13fa7-openshift-service-ca\") pod \"maas-api-e2e-inf-b-1feb1a-7f67dcc46c-kc95s\" (UID: \"c1daf0fc-292b-4f03-ad96-fc0fd4a13fa7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1feb1a-7f67dcc46c-kc95s"
Jul 20 13:19:02.797871 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:19:02.797853    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1daf0fc-292b-4f03-ad96-fc0fd4a13fa7-maas-api-tls\") pod \"maas-api-e2e-inf-b-1feb1a-7f67dcc46c-kc95s\" (UID: \"c1daf0fc-292b-4f03-ad96-fc0fd4a13fa7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1feb1a-7f67dcc46c-kc95s"
Jul 20 13:19:02.819133 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:19:02.819076    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt7z9\" (UniqueName: \"kubernetes.io/projected/c1daf0fc-292b-4f03-ad96-fc0fd4a13fa7-kube-api-access-pt7z9\") pod \"maas-api-e2e-inf-b-1feb1a-7f67dcc46c-kc95s\" (UID: \"c1daf0fc-292b-4f03-ad96-fc0fd4a13fa7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1feb1a-7f67dcc46c-kc95s"
Jul 20 13:19:02.895126 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:19:02.895043    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98c8e4-6977dc5bb5-sbt2k"
Jul 20 13:19:02.955106 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:19:02.955060    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1feb1a-7f67dcc46c-kc95s"
Jul 20 13:19:03.109172 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:19:03.109132    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-1feb1a-7f67dcc46c-kc95s"]
Jul 20 13:19:03.114319 ip-10-0-139-1 kubenswrapper[2570]: W0720 13:19:03.114288    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1daf0fc_292b_4f03_ad96_fc0fd4a13fa7.slice/crio-d3b26e92aa0ddd9f2ec040d1a5382f45e8baa24f58141ff40e770634aa464cfe WatchSource:0}: Error finding container d3b26e92aa0ddd9f2ec040d1a5382f45e8baa24f58141ff40e770634aa464cfe: Status 404 returned error can't find the container with id d3b26e92aa0ddd9f2ec040d1a5382f45e8baa24f58141ff40e770634aa464cfe
Jul 20 13:19:03.922851 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:19:03.922811    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1feb1a-7f67dcc46c-kc95s" event={"ID":"c1daf0fc-292b-4f03-ad96-fc0fd4a13fa7","Type":"ContainerStarted","Data":"82bfec99ce3880d572eb4c0e6989a9a7cf3b0d1ccb60c20c900eec33d82844f1"}
Jul 20 13:19:03.923287 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:19:03.922875    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1feb1a-7f67dcc46c-kc95s" event={"ID":"c1daf0fc-292b-4f03-ad96-fc0fd4a13fa7","Type":"ContainerStarted","Data":"d3b26e92aa0ddd9f2ec040d1a5382f45e8baa24f58141ff40e770634aa464cfe"}
Jul 20 13:19:03.923287 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:19:03.922903    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1feb1a-7f67dcc46c-kc95s"
Jul 20 13:19:03.955965 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:19:03.955868    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1feb1a-7f67dcc46c-kc95s" podStartSLOduration=1.366157752 podStartE2EDuration="1.955851552s" totalImagesPullingTime="589.6938ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:19:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:19:03.954274153 +0000 UTC m=+2056.709323530" watchObservedRunningTime="2026-07-20 13:19:03.955851552 +0000 UTC m=+2056.710900926"
Jul 20 13:19:09.934253 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:19:09.934175    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1feb1a-7f67dcc46c-kc95s"
Jul 20 13:19:15.700528 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:19:15.700481    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-98c8e4/test-model-98c8e4-kserve-cc7f6679f-v5bn2"]
Jul 20 13:19:15.704417 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:19:15.704393    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-98c8e4/test-model-98c8e4-kserve-cc7f6679f-v5bn2"
Jul 20 13:19:15.709269 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:19:15.709241    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-98c8e4\"/\"test-model-98c8e4-kserve-self-signed-certs\""
Jul 20 13:19:15.709390 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:19:15.709273    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-98c8e4\"/\"default-dockercfg-hjnvz\""
Jul 20 13:19:15.709390 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:19:15.709359    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-98c8e4\"/\"kube-root-ca.crt\""
Jul 20 13:19:15.709390 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:19:15.709381    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-98c8e4\"/\"openshift-service-ca.crt\""
Jul 20 13:19:15.721591 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:19:15.721553    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-98c8e4/test-model-98c8e4-kserve-cc7f6679f-v5bn2"]
Jul 20 13:19:15.812452 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:19:15.812407    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5q8jx\" (UniqueName: \"kubernetes.io/projected/f40e2e73-23c5-4261-8cce-894459ec03f9-kube-api-access-5q8jx\") pod \"test-model-98c8e4-kserve-cc7f6679f-v5bn2\" (UID: \"f40e2e73-23c5-4261-8cce-894459ec03f9\") " pod="ai-tenant-e2e-inf-a-98c8e4/test-model-98c8e4-kserve-cc7f6679f-v5bn2"
Jul 20 13:19:15.812652 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:19:15.812468    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f40e2e73-23c5-4261-8cce-894459ec03f9-home\") pod \"test-model-98c8e4-kserve-cc7f6679f-v5bn2\" (UID: \"f40e2e73-23c5-4261-8cce-894459ec03f9\") " pod="ai-tenant-e2e-inf-a-98c8e4/test-model-98c8e4-kserve-cc7f6679f-v5bn2"
Jul 20 13:19:15.812652 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:19:15.812564    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f40e2e73-23c5-4261-8cce-894459ec03f9-dshm\") pod \"test-model-98c8e4-kserve-cc7f6679f-v5bn2\" (UID: \"f40e2e73-23c5-4261-8cce-894459ec03f9\") " pod="ai-tenant-e2e-inf-a-98c8e4/test-model-98c8e4-kserve-cc7f6679f-v5bn2"
Jul 20 13:19:15.812652 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:19:15.812597    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f40e2e73-23c5-4261-8cce-894459ec03f9-tls-certs\") pod \"test-model-98c8e4-kserve-cc7f6679f-v5bn2\" (UID: \"f40e2e73-23c5-4261-8cce-894459ec03f9\") " pod="ai-tenant-e2e-inf-a-98c8e4/test-model-98c8e4-kserve-cc7f6679f-v5bn2"
Jul 20 13:19:15.812817 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:19:15.812714    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f40e2e73-23c5-4261-8cce-894459ec03f9-tmp-dir\") pod \"test-model-98c8e4-kserve-cc7f6679f-v5bn2\" (UID: \"f40e2e73-23c5-4261-8cce-894459ec03f9\") " pod="ai-tenant-e2e-inf-a-98c8e4/test-model-98c8e4-kserve-cc7f6679f-v5bn2"
Jul 20 13:19:15.812817 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:19:15.812766    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f40e2e73-23c5-4261-8cce-894459ec03f9-model-cache\") pod \"test-model-98c8e4-kserve-cc7f6679f-v5bn2\" (UID: \"f40e2e73-23c5-4261-8cce-894459ec03f9\") " pod="ai-tenant-e2e-inf-a-98c8e4/test-model-98c8e4-kserve-cc7f6679f-v5bn2"
Jul 20 13:19:15.914096 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:19:15.914063    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f40e2e73-23c5-4261-8cce-894459ec03f9-tmp-dir\") pod \"test-model-98c8e4-kserve-cc7f6679f-v5bn2\" (UID: \"f40e2e73-23c5-4261-8cce-894459ec03f9\") " pod="ai-tenant-e2e-inf-a-98c8e4/test-model-98c8e4-kserve-cc7f6679f-v5bn2"
Jul 20 13:19:15.914279 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:19:15.914141    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f40e2e73-23c5-4261-8cce-894459ec03f9-model-cache\") pod \"test-model-98c8e4-kserve-cc7f6679f-v5bn2\" (UID: \"f40e2e73-23c5-4261-8cce-894459ec03f9\") " pod="ai-tenant-e2e-inf-a-98c8e4/test-model-98c8e4-kserve-cc7f6679f-v5bn2"
Jul 20 13:19:15.914279 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:19:15.914170    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5q8jx\" (UniqueName: \"kubernetes.io/projected/f40e2e73-23c5-4261-8cce-894459ec03f9-kube-api-access-5q8jx\") pod \"test-model-98c8e4-kserve-cc7f6679f-v5bn2\" (UID: \"f40e2e73-23c5-4261-8cce-894459ec03f9\") " pod="ai-tenant-e2e-inf-a-98c8e4/test-model-98c8e4-kserve-cc7f6679f-v5bn2"
Jul 20 13:19:15.914279 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:19:15.914198    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f40e2e73-23c5-4261-8cce-894459ec03f9-home\") pod \"test-model-98c8e4-kserve-cc7f6679f-v5bn2\" (UID: \"f40e2e73-23c5-4261-8cce-894459ec03f9\") " pod="ai-tenant-e2e-inf-a-98c8e4/test-model-98c8e4-kserve-cc7f6679f-v5bn2"
Jul 20 13:19:15.914279 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:19:15.914230    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f40e2e73-23c5-4261-8cce-894459ec03f9-dshm\") pod \"test-model-98c8e4-kserve-cc7f6679f-v5bn2\" (UID: \"f40e2e73-23c5-4261-8cce-894459ec03f9\") " pod="ai-tenant-e2e-inf-a-98c8e4/test-model-98c8e4-kserve-cc7f6679f-v5bn2"
Jul 20 13:19:15.914279 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:19:15.914248    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f40e2e73-23c5-4261-8cce-894459ec03f9-tls-certs\") pod \"test-model-98c8e4-kserve-cc7f6679f-v5bn2\" (UID: \"f40e2e73-23c5-4261-8cce-894459ec03f9\") " pod="ai-tenant-e2e-inf-a-98c8e4/test-model-98c8e4-kserve-cc7f6679f-v5bn2"
Jul 20 13:19:15.914560 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:19:15.914502    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f40e2e73-23c5-4261-8cce-894459ec03f9-tmp-dir\") pod \"test-model-98c8e4-kserve-cc7f6679f-v5bn2\" (UID: \"f40e2e73-23c5-4261-8cce-894459ec03f9\") " pod="ai-tenant-e2e-inf-a-98c8e4/test-model-98c8e4-kserve-cc7f6679f-v5bn2"
Jul 20 13:19:15.914560 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:19:15.914518    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f40e2e73-23c5-4261-8cce-894459ec03f9-model-cache\") pod \"test-model-98c8e4-kserve-cc7f6679f-v5bn2\" (UID: \"f40e2e73-23c5-4261-8cce-894459ec03f9\") " pod="ai-tenant-e2e-inf-a-98c8e4/test-model-98c8e4-kserve-cc7f6679f-v5bn2"
Jul 20 13:19:15.914655 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:19:15.914577    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f40e2e73-23c5-4261-8cce-894459ec03f9-home\") pod \"test-model-98c8e4-kserve-cc7f6679f-v5bn2\" (UID: \"f40e2e73-23c5-4261-8cce-894459ec03f9\") " pod="ai-tenant-e2e-inf-a-98c8e4/test-model-98c8e4-kserve-cc7f6679f-v5bn2"
Jul 20 13:19:15.916503 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:19:15.916476    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f40e2e73-23c5-4261-8cce-894459ec03f9-dshm\") pod \"test-model-98c8e4-kserve-cc7f6679f-v5bn2\" (UID: \"f40e2e73-23c5-4261-8cce-894459ec03f9\") " pod="ai-tenant-e2e-inf-a-98c8e4/test-model-98c8e4-kserve-cc7f6679f-v5bn2"
Jul 20 13:19:15.916760 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:19:15.916744    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f40e2e73-23c5-4261-8cce-894459ec03f9-tls-certs\") pod \"test-model-98c8e4-kserve-cc7f6679f-v5bn2\" (UID: \"f40e2e73-23c5-4261-8cce-894459ec03f9\") " pod="ai-tenant-e2e-inf-a-98c8e4/test-model-98c8e4-kserve-cc7f6679f-v5bn2"
Jul 20 13:19:15.928778 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:19:15.928744    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5q8jx\" (UniqueName: \"kubernetes.io/projected/f40e2e73-23c5-4261-8cce-894459ec03f9-kube-api-access-5q8jx\") pod \"test-model-98c8e4-kserve-cc7f6679f-v5bn2\" (UID: \"f40e2e73-23c5-4261-8cce-894459ec03f9\") " pod="ai-tenant-e2e-inf-a-98c8e4/test-model-98c8e4-kserve-cc7f6679f-v5bn2"
Jul 20 13:19:16.023272 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:19:16.023196    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-98c8e4/test-model-98c8e4-kserve-cc7f6679f-v5bn2"
Jul 20 13:19:16.157313 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:19:16.157282    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-98c8e4/test-model-98c8e4-kserve-cc7f6679f-v5bn2"]
Jul 20 13:19:16.158388 ip-10-0-139-1 kubenswrapper[2570]: W0720 13:19:16.158360    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf40e2e73_23c5_4261_8cce_894459ec03f9.slice/crio-e50b7ffb138af75900ef655eae4ae6c08ee7f79c93de699a72304530c94a287d WatchSource:0}: Error finding container e50b7ffb138af75900ef655eae4ae6c08ee7f79c93de699a72304530c94a287d: Status 404 returned error can't find the container with id e50b7ffb138af75900ef655eae4ae6c08ee7f79c93de699a72304530c94a287d
Jul 20 13:19:16.993294 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:19:16.993253    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-98c8e4/test-model-98c8e4-kserve-cc7f6679f-v5bn2" event={"ID":"f40e2e73-23c5-4261-8cce-894459ec03f9","Type":"ContainerStarted","Data":"ee2b6b1e5b29081796d0d1b102bd49be4caca6ba309dcc6760fc8cc7f0584f28"}
Jul 20 13:19:16.993676 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:19:16.993305    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-98c8e4/test-model-98c8e4-kserve-cc7f6679f-v5bn2" event={"ID":"f40e2e73-23c5-4261-8cce-894459ec03f9","Type":"ContainerStarted","Data":"e50b7ffb138af75900ef655eae4ae6c08ee7f79c93de699a72304530c94a287d"}
Jul 20 13:19:17.032544 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:19:17.032496    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-98c8e4/test-model-98c8e4-kserve-cc7f6679f-v5bn2" podStartSLOduration=2.03248087 podStartE2EDuration="2.03248087s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:19:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:19:17.0318077 +0000 UTC m=+2069.786857086" watchObservedRunningTime="2026-07-20 13:19:17.03248087 +0000 UTC m=+2069.787530244"
Jul 20 13:19:26.024402 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:19:26.024370    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-98c8e4/test-model-98c8e4-kserve-cc7f6679f-v5bn2"
Jul 20 13:19:26.024859 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:19:26.024421    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-98c8e4/test-model-98c8e4-kserve-cc7f6679f-v5bn2"
Jul 20 13:19:26.036916 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:19:26.036892    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-98c8e4/test-model-98c8e4-kserve-cc7f6679f-v5bn2"
Jul 20 13:19:26.058780 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:19:26.058752    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-98c8e4/test-model-98c8e4-kserve-cc7f6679f-v5bn2"
Jul 20 13:19:47.947815 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:19:47.947789    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rhdn8_5efe9094-763c-4689-85b7-83e0ccb19811/ovn-acl-logging/0.log"
Jul 20 13:19:47.964564 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:19:47.964539    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rhdn8_5efe9094-763c-4689-85b7-83e0ccb19811/ovn-acl-logging/0.log"
Jul 20 13:20:03.299654 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:03.299613    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-1feb1a/test-model-1feb1a-kserve-7565bf65-qwvkz"]
Jul 20 13:20:03.302968 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:03.302948    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-1feb1a/test-model-1feb1a-kserve-7565bf65-qwvkz"
Jul 20 13:20:03.306282 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:03.306254    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-1feb1a\"/\"kube-root-ca.crt\""
Jul 20 13:20:03.307808 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:03.307781    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-1feb1a\"/\"openshift-service-ca.crt\""
Jul 20 13:20:03.307901 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:03.307810    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-1feb1a\"/\"default-dockercfg-2p75v\""
Jul 20 13:20:03.307901 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:03.307886    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-1feb1a\"/\"test-model-1feb1a-kserve-self-signed-certs\""
Jul 20 13:20:03.318972 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:03.318942    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-1feb1a/test-model-1feb1a-kserve-7565bf65-qwvkz"]
Jul 20 13:20:03.437459 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:03.437417    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a3cc2d64-e14d-463d-8678-e4502184738d-dshm\") pod \"test-model-1feb1a-kserve-7565bf65-qwvkz\" (UID: \"a3cc2d64-e14d-463d-8678-e4502184738d\") " pod="ai-tenant-e2e-inf-b-1feb1a/test-model-1feb1a-kserve-7565bf65-qwvkz"
Jul 20 13:20:03.437459 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:03.437464    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a3cc2d64-e14d-463d-8678-e4502184738d-tls-certs\") pod \"test-model-1feb1a-kserve-7565bf65-qwvkz\" (UID: \"a3cc2d64-e14d-463d-8678-e4502184738d\") " pod="ai-tenant-e2e-inf-b-1feb1a/test-model-1feb1a-kserve-7565bf65-qwvkz"
Jul 20 13:20:03.437689 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:03.437492    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a3cc2d64-e14d-463d-8678-e4502184738d-model-cache\") pod \"test-model-1feb1a-kserve-7565bf65-qwvkz\" (UID: \"a3cc2d64-e14d-463d-8678-e4502184738d\") " pod="ai-tenant-e2e-inf-b-1feb1a/test-model-1feb1a-kserve-7565bf65-qwvkz"
Jul 20 13:20:03.437689 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:03.437568    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a3cc2d64-e14d-463d-8678-e4502184738d-home\") pod \"test-model-1feb1a-kserve-7565bf65-qwvkz\" (UID: \"a3cc2d64-e14d-463d-8678-e4502184738d\") " pod="ai-tenant-e2e-inf-b-1feb1a/test-model-1feb1a-kserve-7565bf65-qwvkz"
Jul 20 13:20:03.437689 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:03.437659    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3cc2d64-e14d-463d-8678-e4502184738d-tmp-dir\") pod \"test-model-1feb1a-kserve-7565bf65-qwvkz\" (UID: \"a3cc2d64-e14d-463d-8678-e4502184738d\") " pod="ai-tenant-e2e-inf-b-1feb1a/test-model-1feb1a-kserve-7565bf65-qwvkz"
Jul 20 13:20:03.437689 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:03.437688    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cd5xf\" (UniqueName: \"kubernetes.io/projected/a3cc2d64-e14d-463d-8678-e4502184738d-kube-api-access-cd5xf\") pod \"test-model-1feb1a-kserve-7565bf65-qwvkz\" (UID: \"a3cc2d64-e14d-463d-8678-e4502184738d\") " pod="ai-tenant-e2e-inf-b-1feb1a/test-model-1feb1a-kserve-7565bf65-qwvkz"
Jul 20 13:20:03.538746 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:03.538711    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a3cc2d64-e14d-463d-8678-e4502184738d-dshm\") pod \"test-model-1feb1a-kserve-7565bf65-qwvkz\" (UID: \"a3cc2d64-e14d-463d-8678-e4502184738d\") " pod="ai-tenant-e2e-inf-b-1feb1a/test-model-1feb1a-kserve-7565bf65-qwvkz"
Jul 20 13:20:03.538923 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:03.538754    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a3cc2d64-e14d-463d-8678-e4502184738d-tls-certs\") pod \"test-model-1feb1a-kserve-7565bf65-qwvkz\" (UID: \"a3cc2d64-e14d-463d-8678-e4502184738d\") " pod="ai-tenant-e2e-inf-b-1feb1a/test-model-1feb1a-kserve-7565bf65-qwvkz"
Jul 20 13:20:03.538923 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:03.538785    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a3cc2d64-e14d-463d-8678-e4502184738d-model-cache\") pod \"test-model-1feb1a-kserve-7565bf65-qwvkz\" (UID: \"a3cc2d64-e14d-463d-8678-e4502184738d\") " pod="ai-tenant-e2e-inf-b-1feb1a/test-model-1feb1a-kserve-7565bf65-qwvkz"
Jul 20 13:20:03.538923 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:03.538895    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a3cc2d64-e14d-463d-8678-e4502184738d-home\") pod \"test-model-1feb1a-kserve-7565bf65-qwvkz\" (UID: \"a3cc2d64-e14d-463d-8678-e4502184738d\") " pod="ai-tenant-e2e-inf-b-1feb1a/test-model-1feb1a-kserve-7565bf65-qwvkz"
Jul 20 13:20:03.539106 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:03.539012    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3cc2d64-e14d-463d-8678-e4502184738d-tmp-dir\") pod \"test-model-1feb1a-kserve-7565bf65-qwvkz\" (UID: \"a3cc2d64-e14d-463d-8678-e4502184738d\") " pod="ai-tenant-e2e-inf-b-1feb1a/test-model-1feb1a-kserve-7565bf65-qwvkz"
Jul 20 13:20:03.539106 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:03.539059    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cd5xf\" (UniqueName: \"kubernetes.io/projected/a3cc2d64-e14d-463d-8678-e4502184738d-kube-api-access-cd5xf\") pod \"test-model-1feb1a-kserve-7565bf65-qwvkz\" (UID: \"a3cc2d64-e14d-463d-8678-e4502184738d\") " pod="ai-tenant-e2e-inf-b-1feb1a/test-model-1feb1a-kserve-7565bf65-qwvkz"
Jul 20 13:20:03.539240 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:03.539146    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a3cc2d64-e14d-463d-8678-e4502184738d-model-cache\") pod \"test-model-1feb1a-kserve-7565bf65-qwvkz\" (UID: \"a3cc2d64-e14d-463d-8678-e4502184738d\") " pod="ai-tenant-e2e-inf-b-1feb1a/test-model-1feb1a-kserve-7565bf65-qwvkz"
Jul 20 13:20:03.539299 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:03.539282    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a3cc2d64-e14d-463d-8678-e4502184738d-home\") pod \"test-model-1feb1a-kserve-7565bf65-qwvkz\" (UID: \"a3cc2d64-e14d-463d-8678-e4502184738d\") " pod="ai-tenant-e2e-inf-b-1feb1a/test-model-1feb1a-kserve-7565bf65-qwvkz"
Jul 20 13:20:03.539344 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:03.539330    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3cc2d64-e14d-463d-8678-e4502184738d-tmp-dir\") pod \"test-model-1feb1a-kserve-7565bf65-qwvkz\" (UID: \"a3cc2d64-e14d-463d-8678-e4502184738d\") " pod="ai-tenant-e2e-inf-b-1feb1a/test-model-1feb1a-kserve-7565bf65-qwvkz"
Jul 20 13:20:03.541200 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:03.541182    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a3cc2d64-e14d-463d-8678-e4502184738d-dshm\") pod \"test-model-1feb1a-kserve-7565bf65-qwvkz\" (UID: \"a3cc2d64-e14d-463d-8678-e4502184738d\") " pod="ai-tenant-e2e-inf-b-1feb1a/test-model-1feb1a-kserve-7565bf65-qwvkz"
Jul 20 13:20:03.541329 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:03.541313    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a3cc2d64-e14d-463d-8678-e4502184738d-tls-certs\") pod \"test-model-1feb1a-kserve-7565bf65-qwvkz\" (UID: \"a3cc2d64-e14d-463d-8678-e4502184738d\") " pod="ai-tenant-e2e-inf-b-1feb1a/test-model-1feb1a-kserve-7565bf65-qwvkz"
Jul 20 13:20:03.548378 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:03.548358    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cd5xf\" (UniqueName: \"kubernetes.io/projected/a3cc2d64-e14d-463d-8678-e4502184738d-kube-api-access-cd5xf\") pod \"test-model-1feb1a-kserve-7565bf65-qwvkz\" (UID: \"a3cc2d64-e14d-463d-8678-e4502184738d\") " pod="ai-tenant-e2e-inf-b-1feb1a/test-model-1feb1a-kserve-7565bf65-qwvkz"
Jul 20 13:20:03.613398 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:03.613362    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-1feb1a/test-model-1feb1a-kserve-7565bf65-qwvkz"
Jul 20 13:20:03.756868 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:03.756836    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-1feb1a/test-model-1feb1a-kserve-7565bf65-qwvkz"]
Jul 20 13:20:03.758377 ip-10-0-139-1 kubenswrapper[2570]: W0720 13:20:03.758351    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda3cc2d64_e14d_463d_8678_e4502184738d.slice/crio-a055d1a6d74df5e13cffc01e89b720f528d8e28126261f69841db0017748cae2 WatchSource:0}: Error finding container a055d1a6d74df5e13cffc01e89b720f528d8e28126261f69841db0017748cae2: Status 404 returned error can't find the container with id a055d1a6d74df5e13cffc01e89b720f528d8e28126261f69841db0017748cae2
Jul 20 13:20:04.252501 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:04.252464    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-1feb1a/test-model-1feb1a-kserve-7565bf65-qwvkz" event={"ID":"a3cc2d64-e14d-463d-8678-e4502184738d","Type":"ContainerStarted","Data":"bd7dad56a8fac8e5002602ca908830848184183b9384e94d3044a731fea4ede6"}
Jul 20 13:20:04.252501 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:04.252512    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-1feb1a/test-model-1feb1a-kserve-7565bf65-qwvkz" event={"ID":"a3cc2d64-e14d-463d-8678-e4502184738d","Type":"ContainerStarted","Data":"a055d1a6d74df5e13cffc01e89b720f528d8e28126261f69841db0017748cae2"}
Jul 20 13:20:04.276153 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:04.276057    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-1feb1a/test-model-1feb1a-kserve-7565bf65-qwvkz" podStartSLOduration=1.276038912 podStartE2EDuration="1.276038912s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:20:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:20:04.274941039 +0000 UTC m=+2117.029990415" watchObservedRunningTime="2026-07-20 13:20:04.276038912 +0000 UTC m=+2117.031088344"
Jul 20 13:20:13.614010 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:13.613962    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-1feb1a/test-model-1feb1a-kserve-7565bf65-qwvkz"
Jul 20 13:20:13.614010 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:13.614018    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-1feb1a/test-model-1feb1a-kserve-7565bf65-qwvkz"
Jul 20 13:20:13.626720 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:13.626692    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-1feb1a/test-model-1feb1a-kserve-7565bf65-qwvkz"
Jul 20 13:20:14.320889 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:14.320857    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-1feb1a/test-model-1feb1a-kserve-7565bf65-qwvkz"
Jul 20 13:20:42.017435 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:42.017341    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-98c8e4/test-model-98c8e4-kserve-cc7f6679f-v5bn2"]
Jul 20 13:20:43.060325 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:43.060290    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-1feb1a/test-model-1feb1a-kserve-7565bf65-qwvkz"]
Jul 20 13:20:53.783830 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:53.783797    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-98c8e4-6977dc5bb5-sbt2k"]
Jul 20 13:20:53.784385 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:53.784064    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98c8e4-6977dc5bb5-sbt2k" podUID="f389d2c2-438e-455f-9886-9e800ca93802" containerName="maas-api" containerID="cri-o://89d64d87663afd3f881fad8772ae72c25e1e0fcb182bf7a3a3116cda00ab27c4" gracePeriod=30
Jul 20 13:20:54.026636 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:54.026600    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98c8e4-6977dc5bb5-sbt2k"
Jul 20 13:20:54.100796 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:54.100764    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-46xfq\" (UniqueName: \"kubernetes.io/projected/f389d2c2-438e-455f-9886-9e800ca93802-kube-api-access-46xfq\") pod \"f389d2c2-438e-455f-9886-9e800ca93802\" (UID: \"f389d2c2-438e-455f-9886-9e800ca93802\") "
Jul 20 13:20:54.100958 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:54.100896    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f389d2c2-438e-455f-9886-9e800ca93802-openshift-service-ca\") pod \"f389d2c2-438e-455f-9886-9e800ca93802\" (UID: \"f389d2c2-438e-455f-9886-9e800ca93802\") "
Jul 20 13:20:54.100958 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:54.100922    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f389d2c2-438e-455f-9886-9e800ca93802-maas-api-tls\") pod \"f389d2c2-438e-455f-9886-9e800ca93802\" (UID: \"f389d2c2-438e-455f-9886-9e800ca93802\") "
Jul 20 13:20:54.101316 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:54.101284    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f389d2c2-438e-455f-9886-9e800ca93802-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f389d2c2-438e-455f-9886-9e800ca93802" (UID: "f389d2c2-438e-455f-9886-9e800ca93802"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:20:54.102836 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:54.102804    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f389d2c2-438e-455f-9886-9e800ca93802-kube-api-access-46xfq" (OuterVolumeSpecName: "kube-api-access-46xfq") pod "f389d2c2-438e-455f-9886-9e800ca93802" (UID: "f389d2c2-438e-455f-9886-9e800ca93802"). InnerVolumeSpecName "kube-api-access-46xfq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:20:54.102942 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:54.102881    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f389d2c2-438e-455f-9886-9e800ca93802-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f389d2c2-438e-455f-9886-9e800ca93802" (UID: "f389d2c2-438e-455f-9886-9e800ca93802"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:20:54.202127 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:54.202077    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-46xfq\" (UniqueName: \"kubernetes.io/projected/f389d2c2-438e-455f-9886-9e800ca93802-kube-api-access-46xfq\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:20:54.202127 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:54.202124    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f389d2c2-438e-455f-9886-9e800ca93802-openshift-service-ca\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:20:54.202127 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:54.202134    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f389d2c2-438e-455f-9886-9e800ca93802-maas-api-tls\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:20:54.532460 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:54.532370    2570 generic.go:356] "Generic (PLEG): container finished" podID="f389d2c2-438e-455f-9886-9e800ca93802" containerID="89d64d87663afd3f881fad8772ae72c25e1e0fcb182bf7a3a3116cda00ab27c4" exitCode=0
Jul 20 13:20:54.532460 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:54.532418    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98c8e4-6977dc5bb5-sbt2k"
Jul 20 13:20:54.532665 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:54.532455    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98c8e4-6977dc5bb5-sbt2k" event={"ID":"f389d2c2-438e-455f-9886-9e800ca93802","Type":"ContainerDied","Data":"89d64d87663afd3f881fad8772ae72c25e1e0fcb182bf7a3a3116cda00ab27c4"}
Jul 20 13:20:54.532665 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:54.532511    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98c8e4-6977dc5bb5-sbt2k" event={"ID":"f389d2c2-438e-455f-9886-9e800ca93802","Type":"ContainerDied","Data":"b6f35570d8921887eabd271b4f9df8ad31e110717ea23e3e60ef7eb02391e7dc"}
Jul 20 13:20:54.532665 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:54.532538    2570 scope.go:117] "RemoveContainer" containerID="89d64d87663afd3f881fad8772ae72c25e1e0fcb182bf7a3a3116cda00ab27c4"
Jul 20 13:20:54.542195 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:54.542179    2570 scope.go:117] "RemoveContainer" containerID="89d64d87663afd3f881fad8772ae72c25e1e0fcb182bf7a3a3116cda00ab27c4"
Jul 20 13:20:54.542433 ip-10-0-139-1 kubenswrapper[2570]: E0720 13:20:54.542416    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89d64d87663afd3f881fad8772ae72c25e1e0fcb182bf7a3a3116cda00ab27c4\": container with ID starting with 89d64d87663afd3f881fad8772ae72c25e1e0fcb182bf7a3a3116cda00ab27c4 not found: ID does not exist" containerID="89d64d87663afd3f881fad8772ae72c25e1e0fcb182bf7a3a3116cda00ab27c4"
Jul 20 13:20:54.542485 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:54.542443    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89d64d87663afd3f881fad8772ae72c25e1e0fcb182bf7a3a3116cda00ab27c4"} err="failed to get container status \"89d64d87663afd3f881fad8772ae72c25e1e0fcb182bf7a3a3116cda00ab27c4\": rpc error: code = NotFound desc = could not find container \"89d64d87663afd3f881fad8772ae72c25e1e0fcb182bf7a3a3116cda00ab27c4\": container with ID starting with 89d64d87663afd3f881fad8772ae72c25e1e0fcb182bf7a3a3116cda00ab27c4 not found: ID does not exist"
Jul 20 13:20:54.556872 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:54.556845    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-98c8e4-6977dc5bb5-sbt2k"]
Jul 20 13:20:54.561295 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:54.561276    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-98c8e4-6977dc5bb5-sbt2k"]
Jul 20 13:20:55.808051 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:55.808018    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f389d2c2-438e-455f-9886-9e800ca93802" path="/var/lib/kubelet/pods/f389d2c2-438e-455f-9886-9e800ca93802/volumes"
Jul 20 13:20:57.037327 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:57.037284    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-98c8e4/test-model-98c8e4-kserve-cc7f6679f-v5bn2" podUID="f40e2e73-23c5-4261-8cce-894459ec03f9" containerName="main" containerID="cri-o://ee2b6b1e5b29081796d0d1b102bd49be4caca6ba309dcc6760fc8cc7f0584f28" gracePeriod=45
Jul 20 13:20:57.286844 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:57.286821    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-98c8e4/test-model-98c8e4-kserve-cc7f6679f-v5bn2"
Jul 20 13:20:57.434647 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:57.434609    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f40e2e73-23c5-4261-8cce-894459ec03f9-model-cache\") pod \"f40e2e73-23c5-4261-8cce-894459ec03f9\" (UID: \"f40e2e73-23c5-4261-8cce-894459ec03f9\") "
Jul 20 13:20:57.434859 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:57.434664    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f40e2e73-23c5-4261-8cce-894459ec03f9-home\") pod \"f40e2e73-23c5-4261-8cce-894459ec03f9\" (UID: \"f40e2e73-23c5-4261-8cce-894459ec03f9\") "
Jul 20 13:20:57.434859 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:57.434702    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5q8jx\" (UniqueName: \"kubernetes.io/projected/f40e2e73-23c5-4261-8cce-894459ec03f9-kube-api-access-5q8jx\") pod \"f40e2e73-23c5-4261-8cce-894459ec03f9\" (UID: \"f40e2e73-23c5-4261-8cce-894459ec03f9\") "
Jul 20 13:20:57.434859 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:57.434729    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f40e2e73-23c5-4261-8cce-894459ec03f9-tls-certs\") pod \"f40e2e73-23c5-4261-8cce-894459ec03f9\" (UID: \"f40e2e73-23c5-4261-8cce-894459ec03f9\") "
Jul 20 13:20:57.434859 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:57.434759    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f40e2e73-23c5-4261-8cce-894459ec03f9-tmp-dir\") pod \"f40e2e73-23c5-4261-8cce-894459ec03f9\" (UID: \"f40e2e73-23c5-4261-8cce-894459ec03f9\") "
Jul 20 13:20:57.435076 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:57.434900    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f40e2e73-23c5-4261-8cce-894459ec03f9-dshm\") pod \"f40e2e73-23c5-4261-8cce-894459ec03f9\" (UID: \"f40e2e73-23c5-4261-8cce-894459ec03f9\") "
Jul 20 13:20:57.435076 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:57.434924    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f40e2e73-23c5-4261-8cce-894459ec03f9-model-cache" (OuterVolumeSpecName: "model-cache") pod "f40e2e73-23c5-4261-8cce-894459ec03f9" (UID: "f40e2e73-23c5-4261-8cce-894459ec03f9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:20:57.435076 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:57.434978    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f40e2e73-23c5-4261-8cce-894459ec03f9-home" (OuterVolumeSpecName: "home") pod "f40e2e73-23c5-4261-8cce-894459ec03f9" (UID: "f40e2e73-23c5-4261-8cce-894459ec03f9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:20:57.435076 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:57.435052    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f40e2e73-23c5-4261-8cce-894459ec03f9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f40e2e73-23c5-4261-8cce-894459ec03f9" (UID: "f40e2e73-23c5-4261-8cce-894459ec03f9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:20:57.435232 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:57.435209    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f40e2e73-23c5-4261-8cce-894459ec03f9-model-cache\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:20:57.435232 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:57.435223    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f40e2e73-23c5-4261-8cce-894459ec03f9-home\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:20:57.435293 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:57.435251    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f40e2e73-23c5-4261-8cce-894459ec03f9-tmp-dir\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:20:57.437101 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:57.437066    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f40e2e73-23c5-4261-8cce-894459ec03f9-dshm" (OuterVolumeSpecName: "dshm") pod "f40e2e73-23c5-4261-8cce-894459ec03f9" (UID: "f40e2e73-23c5-4261-8cce-894459ec03f9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:20:57.437194 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:57.437104    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f40e2e73-23c5-4261-8cce-894459ec03f9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f40e2e73-23c5-4261-8cce-894459ec03f9" (UID: "f40e2e73-23c5-4261-8cce-894459ec03f9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:20:57.437194 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:57.437112    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f40e2e73-23c5-4261-8cce-894459ec03f9-kube-api-access-5q8jx" (OuterVolumeSpecName: "kube-api-access-5q8jx") pod "f40e2e73-23c5-4261-8cce-894459ec03f9" (UID: "f40e2e73-23c5-4261-8cce-894459ec03f9"). InnerVolumeSpecName "kube-api-access-5q8jx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:20:57.535720 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:57.535686    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f40e2e73-23c5-4261-8cce-894459ec03f9-dshm\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:20:57.535720 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:57.535717    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5q8jx\" (UniqueName: \"kubernetes.io/projected/f40e2e73-23c5-4261-8cce-894459ec03f9-kube-api-access-5q8jx\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:20:57.535908 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:57.535730    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f40e2e73-23c5-4261-8cce-894459ec03f9-tls-certs\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:20:57.550719 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:57.550689    2570 generic.go:356] "Generic (PLEG): container finished" podID="f40e2e73-23c5-4261-8cce-894459ec03f9" containerID="ee2b6b1e5b29081796d0d1b102bd49be4caca6ba309dcc6760fc8cc7f0584f28" exitCode=0
Jul 20 13:20:57.550873 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:57.550731    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-98c8e4/test-model-98c8e4-kserve-cc7f6679f-v5bn2"
Jul 20 13:20:57.550873 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:57.550772    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-98c8e4/test-model-98c8e4-kserve-cc7f6679f-v5bn2" event={"ID":"f40e2e73-23c5-4261-8cce-894459ec03f9","Type":"ContainerDied","Data":"ee2b6b1e5b29081796d0d1b102bd49be4caca6ba309dcc6760fc8cc7f0584f28"}
Jul 20 13:20:57.550873 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:57.550812    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-98c8e4/test-model-98c8e4-kserve-cc7f6679f-v5bn2" event={"ID":"f40e2e73-23c5-4261-8cce-894459ec03f9","Type":"ContainerDied","Data":"e50b7ffb138af75900ef655eae4ae6c08ee7f79c93de699a72304530c94a287d"}
Jul 20 13:20:57.550873 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:57.550829    2570 scope.go:117] "RemoveContainer" containerID="ee2b6b1e5b29081796d0d1b102bd49be4caca6ba309dcc6760fc8cc7f0584f28"
Jul 20 13:20:57.560528 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:57.560509    2570 scope.go:117] "RemoveContainer" containerID="ee2b6b1e5b29081796d0d1b102bd49be4caca6ba309dcc6760fc8cc7f0584f28"
Jul 20 13:20:57.560759 ip-10-0-139-1 kubenswrapper[2570]: E0720 13:20:57.560742    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee2b6b1e5b29081796d0d1b102bd49be4caca6ba309dcc6760fc8cc7f0584f28\": container with ID starting with ee2b6b1e5b29081796d0d1b102bd49be4caca6ba309dcc6760fc8cc7f0584f28 not found: ID does not exist" containerID="ee2b6b1e5b29081796d0d1b102bd49be4caca6ba309dcc6760fc8cc7f0584f28"
Jul 20 13:20:57.560806 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:57.560766    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee2b6b1e5b29081796d0d1b102bd49be4caca6ba309dcc6760fc8cc7f0584f28"} err="failed to get container status \"ee2b6b1e5b29081796d0d1b102bd49be4caca6ba309dcc6760fc8cc7f0584f28\": rpc error: code = NotFound desc = could not find container \"ee2b6b1e5b29081796d0d1b102bd49be4caca6ba309dcc6760fc8cc7f0584f28\": container with ID starting with ee2b6b1e5b29081796d0d1b102bd49be4caca6ba309dcc6760fc8cc7f0584f28 not found: ID does not exist"
Jul 20 13:20:57.574940 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:57.574920    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-98c8e4/test-model-98c8e4-kserve-cc7f6679f-v5bn2"]
Jul 20 13:20:57.583258 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:57.583235    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-98c8e4/test-model-98c8e4-kserve-cc7f6679f-v5bn2"]
Jul 20 13:20:57.808385 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:57.808306    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f40e2e73-23c5-4261-8cce-894459ec03f9" path="/var/lib/kubelet/pods/f40e2e73-23c5-4261-8cce-894459ec03f9/volumes"
Jul 20 13:20:58.080472 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:58.080426    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-1feb1a/test-model-1feb1a-kserve-7565bf65-qwvkz" podUID="a3cc2d64-e14d-463d-8678-e4502184738d" containerName="main" containerID="cri-o://bd7dad56a8fac8e5002602ca908830848184183b9384e94d3044a731fea4ede6" gracePeriod=45
Jul 20 13:20:58.334131 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:58.334057    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-1feb1a/test-model-1feb1a-kserve-7565bf65-qwvkz"
Jul 20 13:20:58.444509 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:58.444475    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a3cc2d64-e14d-463d-8678-e4502184738d-tls-certs\") pod \"a3cc2d64-e14d-463d-8678-e4502184738d\" (UID: \"a3cc2d64-e14d-463d-8678-e4502184738d\") "
Jul 20 13:20:58.444509 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:58.444513    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a3cc2d64-e14d-463d-8678-e4502184738d-home\") pod \"a3cc2d64-e14d-463d-8678-e4502184738d\" (UID: \"a3cc2d64-e14d-463d-8678-e4502184738d\") "
Jul 20 13:20:58.444728 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:58.444534    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cd5xf\" (UniqueName: \"kubernetes.io/projected/a3cc2d64-e14d-463d-8678-e4502184738d-kube-api-access-cd5xf\") pod \"a3cc2d64-e14d-463d-8678-e4502184738d\" (UID: \"a3cc2d64-e14d-463d-8678-e4502184738d\") "
Jul 20 13:20:58.444728 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:58.444588    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a3cc2d64-e14d-463d-8678-e4502184738d-model-cache\") pod \"a3cc2d64-e14d-463d-8678-e4502184738d\" (UID: \"a3cc2d64-e14d-463d-8678-e4502184738d\") "
Jul 20 13:20:58.444802 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:58.444758    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a3cc2d64-e14d-463d-8678-e4502184738d-dshm\") pod \"a3cc2d64-e14d-463d-8678-e4502184738d\" (UID: \"a3cc2d64-e14d-463d-8678-e4502184738d\") "
Jul 20 13:20:58.444847 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:58.444816    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3cc2d64-e14d-463d-8678-e4502184738d-home" (OuterVolumeSpecName: "home") pod "a3cc2d64-e14d-463d-8678-e4502184738d" (UID: "a3cc2d64-e14d-463d-8678-e4502184738d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:20:58.444847 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:58.444834    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3cc2d64-e14d-463d-8678-e4502184738d-tmp-dir\") pod \"a3cc2d64-e14d-463d-8678-e4502184738d\" (UID: \"a3cc2d64-e14d-463d-8678-e4502184738d\") "
Jul 20 13:20:58.444933 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:58.444855    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3cc2d64-e14d-463d-8678-e4502184738d-model-cache" (OuterVolumeSpecName: "model-cache") pod "a3cc2d64-e14d-463d-8678-e4502184738d" (UID: "a3cc2d64-e14d-463d-8678-e4502184738d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:20:58.445052 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:58.445031    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3cc2d64-e14d-463d-8678-e4502184738d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a3cc2d64-e14d-463d-8678-e4502184738d" (UID: "a3cc2d64-e14d-463d-8678-e4502184738d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:20:58.445248 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:58.445233    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3cc2d64-e14d-463d-8678-e4502184738d-tmp-dir\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:20:58.445248 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:58.445248    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a3cc2d64-e14d-463d-8678-e4502184738d-home\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:20:58.445389 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:58.445257    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a3cc2d64-e14d-463d-8678-e4502184738d-model-cache\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:20:58.446973 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:58.446949    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3cc2d64-e14d-463d-8678-e4502184738d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a3cc2d64-e14d-463d-8678-e4502184738d" (UID: "a3cc2d64-e14d-463d-8678-e4502184738d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:20:58.447058 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:58.446953    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3cc2d64-e14d-463d-8678-e4502184738d-dshm" (OuterVolumeSpecName: "dshm") pod "a3cc2d64-e14d-463d-8678-e4502184738d" (UID: "a3cc2d64-e14d-463d-8678-e4502184738d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:20:58.447058 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:58.446982    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3cc2d64-e14d-463d-8678-e4502184738d-kube-api-access-cd5xf" (OuterVolumeSpecName: "kube-api-access-cd5xf") pod "a3cc2d64-e14d-463d-8678-e4502184738d" (UID: "a3cc2d64-e14d-463d-8678-e4502184738d"). InnerVolumeSpecName "kube-api-access-cd5xf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:20:58.546719 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:58.546682    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a3cc2d64-e14d-463d-8678-e4502184738d-dshm\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:20:58.546719 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:58.546714    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a3cc2d64-e14d-463d-8678-e4502184738d-tls-certs\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:20:58.546719 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:58.546725    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cd5xf\" (UniqueName: \"kubernetes.io/projected/a3cc2d64-e14d-463d-8678-e4502184738d-kube-api-access-cd5xf\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:20:58.557717 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:58.557679    2570 generic.go:356] "Generic (PLEG): container finished" podID="a3cc2d64-e14d-463d-8678-e4502184738d" containerID="bd7dad56a8fac8e5002602ca908830848184183b9384e94d3044a731fea4ede6" exitCode=0
Jul 20 13:20:58.557717 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:58.557720    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-1feb1a/test-model-1feb1a-kserve-7565bf65-qwvkz"
Jul 20 13:20:58.557974 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:58.557759    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-1feb1a/test-model-1feb1a-kserve-7565bf65-qwvkz" event={"ID":"a3cc2d64-e14d-463d-8678-e4502184738d","Type":"ContainerDied","Data":"bd7dad56a8fac8e5002602ca908830848184183b9384e94d3044a731fea4ede6"}
Jul 20 13:20:58.557974 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:58.557800    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-1feb1a/test-model-1feb1a-kserve-7565bf65-qwvkz" event={"ID":"a3cc2d64-e14d-463d-8678-e4502184738d","Type":"ContainerDied","Data":"a055d1a6d74df5e13cffc01e89b720f528d8e28126261f69841db0017748cae2"}
Jul 20 13:20:58.557974 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:58.557821    2570 scope.go:117] "RemoveContainer" containerID="bd7dad56a8fac8e5002602ca908830848184183b9384e94d3044a731fea4ede6"
Jul 20 13:20:58.568096 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:58.568067    2570 scope.go:117] "RemoveContainer" containerID="bd7dad56a8fac8e5002602ca908830848184183b9384e94d3044a731fea4ede6"
Jul 20 13:20:58.568392 ip-10-0-139-1 kubenswrapper[2570]: E0720 13:20:58.568373    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd7dad56a8fac8e5002602ca908830848184183b9384e94d3044a731fea4ede6\": container with ID starting with bd7dad56a8fac8e5002602ca908830848184183b9384e94d3044a731fea4ede6 not found: ID does not exist" containerID="bd7dad56a8fac8e5002602ca908830848184183b9384e94d3044a731fea4ede6"
Jul 20 13:20:58.568458 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:58.568406    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd7dad56a8fac8e5002602ca908830848184183b9384e94d3044a731fea4ede6"} err="failed to get container status \"bd7dad56a8fac8e5002602ca908830848184183b9384e94d3044a731fea4ede6\": rpc error: code = NotFound desc = could not find container \"bd7dad56a8fac8e5002602ca908830848184183b9384e94d3044a731fea4ede6\": container with ID starting with bd7dad56a8fac8e5002602ca908830848184183b9384e94d3044a731fea4ede6 not found: ID does not exist"
Jul 20 13:20:58.582669 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:58.582641    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-1feb1a/test-model-1feb1a-kserve-7565bf65-qwvkz"]
Jul 20 13:20:58.587557 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:58.587498    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-1feb1a/test-model-1feb1a-kserve-7565bf65-qwvkz"]
Jul 20 13:20:59.815280 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:20:59.815246    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3cc2d64-e14d-463d-8678-e4502184738d" path="/var/lib/kubelet/pods/a3cc2d64-e14d-463d-8678-e4502184738d/volumes"
Jul 20 13:21:16.047923 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:16.047885    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-1feb1a-7f67dcc46c-kc95s"]
Jul 20 13:21:16.050384 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:16.048113    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1feb1a-7f67dcc46c-kc95s" podUID="c1daf0fc-292b-4f03-ad96-fc0fd4a13fa7" containerName="maas-api" containerID="cri-o://82bfec99ce3880d572eb4c0e6989a9a7cf3b0d1ccb60c20c900eec33d82844f1" gracePeriod=30
Jul 20 13:21:16.301924 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:16.301849    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1feb1a-7f67dcc46c-kc95s"
Jul 20 13:21:16.416205 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:16.416166    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1daf0fc-292b-4f03-ad96-fc0fd4a13fa7-maas-api-tls\") pod \"c1daf0fc-292b-4f03-ad96-fc0fd4a13fa7\" (UID: \"c1daf0fc-292b-4f03-ad96-fc0fd4a13fa7\") "
Jul 20 13:21:16.416205 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:16.416207    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1daf0fc-292b-4f03-ad96-fc0fd4a13fa7-openshift-service-ca\") pod \"c1daf0fc-292b-4f03-ad96-fc0fd4a13fa7\" (UID: \"c1daf0fc-292b-4f03-ad96-fc0fd4a13fa7\") "
Jul 20 13:21:16.416483 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:16.416272    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pt7z9\" (UniqueName: \"kubernetes.io/projected/c1daf0fc-292b-4f03-ad96-fc0fd4a13fa7-kube-api-access-pt7z9\") pod \"c1daf0fc-292b-4f03-ad96-fc0fd4a13fa7\" (UID: \"c1daf0fc-292b-4f03-ad96-fc0fd4a13fa7\") "
Jul 20 13:21:16.416671 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:16.416647    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1daf0fc-292b-4f03-ad96-fc0fd4a13fa7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c1daf0fc-292b-4f03-ad96-fc0fd4a13fa7" (UID: "c1daf0fc-292b-4f03-ad96-fc0fd4a13fa7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:21:16.418405 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:16.418378    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1daf0fc-292b-4f03-ad96-fc0fd4a13fa7-kube-api-access-pt7z9" (OuterVolumeSpecName: "kube-api-access-pt7z9") pod "c1daf0fc-292b-4f03-ad96-fc0fd4a13fa7" (UID: "c1daf0fc-292b-4f03-ad96-fc0fd4a13fa7"). InnerVolumeSpecName "kube-api-access-pt7z9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:21:16.418514 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:16.418427    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1daf0fc-292b-4f03-ad96-fc0fd4a13fa7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c1daf0fc-292b-4f03-ad96-fc0fd4a13fa7" (UID: "c1daf0fc-292b-4f03-ad96-fc0fd4a13fa7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:21:16.517441 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:16.517399    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1daf0fc-292b-4f03-ad96-fc0fd4a13fa7-maas-api-tls\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:21:16.517441 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:16.517433    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1daf0fc-292b-4f03-ad96-fc0fd4a13fa7-openshift-service-ca\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:21:16.517441 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:16.517443    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pt7z9\" (UniqueName: \"kubernetes.io/projected/c1daf0fc-292b-4f03-ad96-fc0fd4a13fa7-kube-api-access-pt7z9\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:21:16.662017 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:16.661982    2570 generic.go:356] "Generic (PLEG): container finished" podID="c1daf0fc-292b-4f03-ad96-fc0fd4a13fa7" containerID="82bfec99ce3880d572eb4c0e6989a9a7cf3b0d1ccb60c20c900eec33d82844f1" exitCode=0
Jul 20 13:21:16.662228 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:16.662029    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1feb1a-7f67dcc46c-kc95s"
Jul 20 13:21:16.662228 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:16.662068    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1feb1a-7f67dcc46c-kc95s" event={"ID":"c1daf0fc-292b-4f03-ad96-fc0fd4a13fa7","Type":"ContainerDied","Data":"82bfec99ce3880d572eb4c0e6989a9a7cf3b0d1ccb60c20c900eec33d82844f1"}
Jul 20 13:21:16.662228 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:16.662153    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1feb1a-7f67dcc46c-kc95s" event={"ID":"c1daf0fc-292b-4f03-ad96-fc0fd4a13fa7","Type":"ContainerDied","Data":"d3b26e92aa0ddd9f2ec040d1a5382f45e8baa24f58141ff40e770634aa464cfe"}
Jul 20 13:21:16.662228 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:16.662184    2570 scope.go:117] "RemoveContainer" containerID="82bfec99ce3880d572eb4c0e6989a9a7cf3b0d1ccb60c20c900eec33d82844f1"
Jul 20 13:21:16.672591 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:16.672563    2570 scope.go:117] "RemoveContainer" containerID="82bfec99ce3880d572eb4c0e6989a9a7cf3b0d1ccb60c20c900eec33d82844f1"
Jul 20 13:21:16.672943 ip-10-0-139-1 kubenswrapper[2570]: E0720 13:21:16.672922    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82bfec99ce3880d572eb4c0e6989a9a7cf3b0d1ccb60c20c900eec33d82844f1\": container with ID starting with 82bfec99ce3880d572eb4c0e6989a9a7cf3b0d1ccb60c20c900eec33d82844f1 not found: ID does not exist" containerID="82bfec99ce3880d572eb4c0e6989a9a7cf3b0d1ccb60c20c900eec33d82844f1"
Jul 20 13:21:16.673001 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:16.672955    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82bfec99ce3880d572eb4c0e6989a9a7cf3b0d1ccb60c20c900eec33d82844f1"} err="failed to get container status \"82bfec99ce3880d572eb4c0e6989a9a7cf3b0d1ccb60c20c900eec33d82844f1\": rpc error: code = NotFound desc = could not find container \"82bfec99ce3880d572eb4c0e6989a9a7cf3b0d1ccb60c20c900eec33d82844f1\": container with ID starting with 82bfec99ce3880d572eb4c0e6989a9a7cf3b0d1ccb60c20c900eec33d82844f1 not found: ID does not exist"
Jul 20 13:21:16.688398 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:16.688361    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-1feb1a-7f67dcc46c-kc95s"]
Jul 20 13:21:16.693684 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:16.693653    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-1feb1a-7f67dcc46c-kc95s"]
Jul 20 13:21:17.808381 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:17.808346    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1daf0fc-292b-4f03-ad96-fc0fd4a13fa7" path="/var/lib/kubelet/pods/c1daf0fc-292b-4f03-ad96-fc0fd4a13fa7/volumes"
Jul 20 13:21:31.809184 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:31.809150    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-f9fd1f-dfcd8cc4c-d274g"]
Jul 20 13:21:31.809653 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:31.809497    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f40e2e73-23c5-4261-8cce-894459ec03f9" containerName="main"
Jul 20 13:21:31.809653 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:31.809508    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="f40e2e73-23c5-4261-8cce-894459ec03f9" containerName="main"
Jul 20 13:21:31.809653 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:31.809518    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f389d2c2-438e-455f-9886-9e800ca93802" containerName="maas-api"
Jul 20 13:21:31.809653 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:31.809524    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="f389d2c2-438e-455f-9886-9e800ca93802" containerName="maas-api"
Jul 20 13:21:31.809653 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:31.809535    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1daf0fc-292b-4f03-ad96-fc0fd4a13fa7" containerName="maas-api"
Jul 20 13:21:31.809653 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:31.809540    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1daf0fc-292b-4f03-ad96-fc0fd4a13fa7" containerName="maas-api"
Jul 20 13:21:31.809653 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:31.809552    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3cc2d64-e14d-463d-8678-e4502184738d" containerName="main"
Jul 20 13:21:31.809653 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:31.809557    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3cc2d64-e14d-463d-8678-e4502184738d" containerName="main"
Jul 20 13:21:31.809653 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:31.809613    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1daf0fc-292b-4f03-ad96-fc0fd4a13fa7" containerName="maas-api"
Jul 20 13:21:31.809653 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:31.809621    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="f389d2c2-438e-455f-9886-9e800ca93802" containerName="maas-api"
Jul 20 13:21:31.809653 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:31.809630    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="f40e2e73-23c5-4261-8cce-894459ec03f9" containerName="main"
Jul 20 13:21:31.809653 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:31.809635    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3cc2d64-e14d-463d-8678-e4502184738d" containerName="main"
Jul 20 13:21:31.812669 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:31.812645    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f9fd1f-dfcd8cc4c-d274g"
Jul 20 13:21:31.816476 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:31.816450    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-ts9xh\""
Jul 20 13:21:31.816625 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:31.816576    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 13:21:31.818175 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:31.818155    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-f9fd1f-serving-cert\""
Jul 20 13:21:31.818276 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:31.818189    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 20 13:21:31.825765 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:31.825735    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-f9fd1f-dfcd8cc4c-d274g"]
Jul 20 13:21:31.962960 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:31.962915    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vl2bq\" (UniqueName: \"kubernetes.io/projected/ed32102f-976f-40ee-a1aa-a52b3722b991-kube-api-access-vl2bq\") pod \"maas-api-e2e-api-a-f9fd1f-dfcd8cc4c-d274g\" (UID: \"ed32102f-976f-40ee-a1aa-a52b3722b991\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f9fd1f-dfcd8cc4c-d274g"
Jul 20 13:21:31.963205 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:31.963022    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed32102f-976f-40ee-a1aa-a52b3722b991-openshift-service-ca\") pod \"maas-api-e2e-api-a-f9fd1f-dfcd8cc4c-d274g\" (UID: \"ed32102f-976f-40ee-a1aa-a52b3722b991\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f9fd1f-dfcd8cc4c-d274g"
Jul 20 13:21:31.963205 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:31.963080    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed32102f-976f-40ee-a1aa-a52b3722b991-maas-api-tls\") pod \"maas-api-e2e-api-a-f9fd1f-dfcd8cc4c-d274g\" (UID: \"ed32102f-976f-40ee-a1aa-a52b3722b991\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f9fd1f-dfcd8cc4c-d274g"
Jul 20 13:21:32.064029 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:32.063931    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vl2bq\" (UniqueName: \"kubernetes.io/projected/ed32102f-976f-40ee-a1aa-a52b3722b991-kube-api-access-vl2bq\") pod \"maas-api-e2e-api-a-f9fd1f-dfcd8cc4c-d274g\" (UID: \"ed32102f-976f-40ee-a1aa-a52b3722b991\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f9fd1f-dfcd8cc4c-d274g"
Jul 20 13:21:32.064029 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:32.064001    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed32102f-976f-40ee-a1aa-a52b3722b991-openshift-service-ca\") pod \"maas-api-e2e-api-a-f9fd1f-dfcd8cc4c-d274g\" (UID: \"ed32102f-976f-40ee-a1aa-a52b3722b991\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f9fd1f-dfcd8cc4c-d274g"
Jul 20 13:21:32.064268 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:32.064037    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed32102f-976f-40ee-a1aa-a52b3722b991-maas-api-tls\") pod \"maas-api-e2e-api-a-f9fd1f-dfcd8cc4c-d274g\" (UID: \"ed32102f-976f-40ee-a1aa-a52b3722b991\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f9fd1f-dfcd8cc4c-d274g"
Jul 20 13:21:32.064677 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:32.064648    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed32102f-976f-40ee-a1aa-a52b3722b991-openshift-service-ca\") pod \"maas-api-e2e-api-a-f9fd1f-dfcd8cc4c-d274g\" (UID: \"ed32102f-976f-40ee-a1aa-a52b3722b991\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f9fd1f-dfcd8cc4c-d274g"
Jul 20 13:21:32.066508 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:32.066484    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed32102f-976f-40ee-a1aa-a52b3722b991-maas-api-tls\") pod \"maas-api-e2e-api-a-f9fd1f-dfcd8cc4c-d274g\" (UID: \"ed32102f-976f-40ee-a1aa-a52b3722b991\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f9fd1f-dfcd8cc4c-d274g"
Jul 20 13:21:32.074865 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:32.074840    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vl2bq\" (UniqueName: \"kubernetes.io/projected/ed32102f-976f-40ee-a1aa-a52b3722b991-kube-api-access-vl2bq\") pod \"maas-api-e2e-api-a-f9fd1f-dfcd8cc4c-d274g\" (UID: \"ed32102f-976f-40ee-a1aa-a52b3722b991\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f9fd1f-dfcd8cc4c-d274g"
Jul 20 13:21:32.124617 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:32.124571    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f9fd1f-dfcd8cc4c-d274g"
Jul 20 13:21:32.273875 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:32.273839    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-f9fd1f-dfcd8cc4c-d274g"]
Jul 20 13:21:32.274868 ip-10-0-139-1 kubenswrapper[2570]: W0720 13:21:32.274840    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded32102f_976f_40ee_a1aa_a52b3722b991.slice/crio-974ec5e530af055fe83b78befd9dca2476c5e0f565a9efb55fd1029f77f431e1 WatchSource:0}: Error finding container 974ec5e530af055fe83b78befd9dca2476c5e0f565a9efb55fd1029f77f431e1: Status 404 returned error can't find the container with id 974ec5e530af055fe83b78befd9dca2476c5e0f565a9efb55fd1029f77f431e1
Jul 20 13:21:32.755275 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:32.755233    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f9fd1f-dfcd8cc4c-d274g" event={"ID":"ed32102f-976f-40ee-a1aa-a52b3722b991","Type":"ContainerStarted","Data":"974ec5e530af055fe83b78befd9dca2476c5e0f565a9efb55fd1029f77f431e1"}
Jul 20 13:21:33.762980 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:33.762940    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f9fd1f-dfcd8cc4c-d274g" event={"ID":"ed32102f-976f-40ee-a1aa-a52b3722b991","Type":"ContainerStarted","Data":"a9e48eea9d2fc1747c145c08c3131070baba6e1d76a5aba1b3bfa6e7120cf42d"}
Jul 20 13:21:33.763411 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:33.763013    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f9fd1f-dfcd8cc4c-d274g"
Jul 20 13:21:33.783767 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:33.783706    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f9fd1f-dfcd8cc4c-d274g" podStartSLOduration=2.311302793 podStartE2EDuration="2.783687805s" totalImagesPullingTime="472.385012ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:21:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:21:33.782995786 +0000 UTC m=+2206.538045192" watchObservedRunningTime="2026-07-20 13:21:33.783687805 +0000 UTC m=+2206.538737180"
Jul 20 13:21:39.777689 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:39.777657    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f9fd1f-dfcd8cc4c-d274g"
Jul 20 13:21:40.296119 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:40.296061    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1797d3-648b4dc9c7-6dz76"]
Jul 20 13:21:40.299753 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:40.299727    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1797d3-648b4dc9c7-6dz76"
Jul 20 13:21:40.303394 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:40.303363    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-1797d3-serving-cert\""
Jul 20 13:21:40.312907 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:40.312877    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1797d3-648b4dc9c7-6dz76"]
Jul 20 13:21:40.446566 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:40.446522    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwwrl\" (UniqueName: \"kubernetes.io/projected/75cc130b-40d5-42f3-9db5-4c23226d40e8-kube-api-access-bwwrl\") pod \"maas-api-e2e-api-b-1797d3-648b4dc9c7-6dz76\" (UID: \"75cc130b-40d5-42f3-9db5-4c23226d40e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1797d3-648b4dc9c7-6dz76"
Jul 20 13:21:40.446566 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:40.446572    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75cc130b-40d5-42f3-9db5-4c23226d40e8-maas-api-tls\") pod \"maas-api-e2e-api-b-1797d3-648b4dc9c7-6dz76\" (UID: \"75cc130b-40d5-42f3-9db5-4c23226d40e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1797d3-648b4dc9c7-6dz76"
Jul 20 13:21:40.446821 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:40.446596    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75cc130b-40d5-42f3-9db5-4c23226d40e8-openshift-service-ca\") pod \"maas-api-e2e-api-b-1797d3-648b4dc9c7-6dz76\" (UID: \"75cc130b-40d5-42f3-9db5-4c23226d40e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1797d3-648b4dc9c7-6dz76"
Jul 20 13:21:40.547552 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:40.547450    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwwrl\" (UniqueName: \"kubernetes.io/projected/75cc130b-40d5-42f3-9db5-4c23226d40e8-kube-api-access-bwwrl\") pod \"maas-api-e2e-api-b-1797d3-648b4dc9c7-6dz76\" (UID: \"75cc130b-40d5-42f3-9db5-4c23226d40e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1797d3-648b4dc9c7-6dz76"
Jul 20 13:21:40.547552 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:40.547504    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75cc130b-40d5-42f3-9db5-4c23226d40e8-maas-api-tls\") pod \"maas-api-e2e-api-b-1797d3-648b4dc9c7-6dz76\" (UID: \"75cc130b-40d5-42f3-9db5-4c23226d40e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1797d3-648b4dc9c7-6dz76"
Jul 20 13:21:40.547552 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:40.547531    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75cc130b-40d5-42f3-9db5-4c23226d40e8-openshift-service-ca\") pod \"maas-api-e2e-api-b-1797d3-648b4dc9c7-6dz76\" (UID: \"75cc130b-40d5-42f3-9db5-4c23226d40e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1797d3-648b4dc9c7-6dz76"
Jul 20 13:21:40.548274 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:40.548249    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75cc130b-40d5-42f3-9db5-4c23226d40e8-openshift-service-ca\") pod \"maas-api-e2e-api-b-1797d3-648b4dc9c7-6dz76\" (UID: \"75cc130b-40d5-42f3-9db5-4c23226d40e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1797d3-648b4dc9c7-6dz76"
Jul 20 13:21:40.549950 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:40.549931    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75cc130b-40d5-42f3-9db5-4c23226d40e8-maas-api-tls\") pod \"maas-api-e2e-api-b-1797d3-648b4dc9c7-6dz76\" (UID: \"75cc130b-40d5-42f3-9db5-4c23226d40e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1797d3-648b4dc9c7-6dz76"
Jul 20 13:21:40.565352 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:40.565323    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwwrl\" (UniqueName: \"kubernetes.io/projected/75cc130b-40d5-42f3-9db5-4c23226d40e8-kube-api-access-bwwrl\") pod \"maas-api-e2e-api-b-1797d3-648b4dc9c7-6dz76\" (UID: \"75cc130b-40d5-42f3-9db5-4c23226d40e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1797d3-648b4dc9c7-6dz76"
Jul 20 13:21:40.611321 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:40.611283    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1797d3-648b4dc9c7-6dz76"
Jul 20 13:21:40.773386 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:40.773358    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1797d3-648b4dc9c7-6dz76"]
Jul 20 13:21:40.775159 ip-10-0-139-1 kubenswrapper[2570]: W0720 13:21:40.775121    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75cc130b_40d5_42f3_9db5_4c23226d40e8.slice/crio-e709fce2a2f2a97dd3689342ccc21a4dbde059911c39ed0b355a2ecbbd7f5f4f WatchSource:0}: Error finding container e709fce2a2f2a97dd3689342ccc21a4dbde059911c39ed0b355a2ecbbd7f5f4f: Status 404 returned error can't find the container with id e709fce2a2f2a97dd3689342ccc21a4dbde059911c39ed0b355a2ecbbd7f5f4f
Jul 20 13:21:40.806978 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:40.806883    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1797d3-648b4dc9c7-6dz76" event={"ID":"75cc130b-40d5-42f3-9db5-4c23226d40e8","Type":"ContainerStarted","Data":"e709fce2a2f2a97dd3689342ccc21a4dbde059911c39ed0b355a2ecbbd7f5f4f"}
Jul 20 13:21:41.814031 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:41.813980    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1797d3-648b4dc9c7-6dz76" event={"ID":"75cc130b-40d5-42f3-9db5-4c23226d40e8","Type":"ContainerStarted","Data":"951e486c26fb19241df4100c26ddb2180cdd38ee33223108d380ac876f9826d6"}
Jul 20 13:21:41.814492 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:41.814206    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1797d3-648b4dc9c7-6dz76"
Jul 20 13:21:41.838591 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:41.838525    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1797d3-648b4dc9c7-6dz76" podStartSLOduration=1.330379428 podStartE2EDuration="1.838505864s" totalImagesPullingTime="508.126436ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:21:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:21:41.835431405 +0000 UTC m=+2214.590480803" watchObservedRunningTime="2026-07-20 13:21:41.838505864 +0000 UTC m=+2214.593555236"
Jul 20 13:21:47.825544 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:21:47.825515    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1797d3-648b4dc9c7-6dz76"
Jul 20 13:22:09.407760 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:09.407672    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-f9fd1f-dfcd8cc4c-d274g"]
Jul 20 13:22:09.408329 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:09.407911    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f9fd1f-dfcd8cc4c-d274g" podUID="ed32102f-976f-40ee-a1aa-a52b3722b991" containerName="maas-api" containerID="cri-o://a9e48eea9d2fc1747c145c08c3131070baba6e1d76a5aba1b3bfa6e7120cf42d" gracePeriod=30
Jul 20 13:22:09.659975 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:09.659913    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f9fd1f-dfcd8cc4c-d274g"
Jul 20 13:22:09.729378 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:09.729344    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vl2bq\" (UniqueName: \"kubernetes.io/projected/ed32102f-976f-40ee-a1aa-a52b3722b991-kube-api-access-vl2bq\") pod \"ed32102f-976f-40ee-a1aa-a52b3722b991\" (UID: \"ed32102f-976f-40ee-a1aa-a52b3722b991\") "
Jul 20 13:22:09.729378 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:09.729383    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed32102f-976f-40ee-a1aa-a52b3722b991-openshift-service-ca\") pod \"ed32102f-976f-40ee-a1aa-a52b3722b991\" (UID: \"ed32102f-976f-40ee-a1aa-a52b3722b991\") "
Jul 20 13:22:09.729636 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:09.729416    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed32102f-976f-40ee-a1aa-a52b3722b991-maas-api-tls\") pod \"ed32102f-976f-40ee-a1aa-a52b3722b991\" (UID: \"ed32102f-976f-40ee-a1aa-a52b3722b991\") "
Jul 20 13:22:09.729725 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:09.729697    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed32102f-976f-40ee-a1aa-a52b3722b991-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ed32102f-976f-40ee-a1aa-a52b3722b991" (UID: "ed32102f-976f-40ee-a1aa-a52b3722b991"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:22:09.731581 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:09.731547    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed32102f-976f-40ee-a1aa-a52b3722b991-kube-api-access-vl2bq" (OuterVolumeSpecName: "kube-api-access-vl2bq") pod "ed32102f-976f-40ee-a1aa-a52b3722b991" (UID: "ed32102f-976f-40ee-a1aa-a52b3722b991"). InnerVolumeSpecName "kube-api-access-vl2bq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:22:09.731700 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:09.731585    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed32102f-976f-40ee-a1aa-a52b3722b991-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ed32102f-976f-40ee-a1aa-a52b3722b991" (UID: "ed32102f-976f-40ee-a1aa-a52b3722b991"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:22:09.830463 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:09.830430    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vl2bq\" (UniqueName: \"kubernetes.io/projected/ed32102f-976f-40ee-a1aa-a52b3722b991-kube-api-access-vl2bq\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:22:09.830463 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:09.830461    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed32102f-976f-40ee-a1aa-a52b3722b991-openshift-service-ca\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:22:09.830673 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:09.830478    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed32102f-976f-40ee-a1aa-a52b3722b991-maas-api-tls\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:22:09.978618 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:09.978531    2570 generic.go:356] "Generic (PLEG): container finished" podID="ed32102f-976f-40ee-a1aa-a52b3722b991" containerID="a9e48eea9d2fc1747c145c08c3131070baba6e1d76a5aba1b3bfa6e7120cf42d" exitCode=0
Jul 20 13:22:09.978618 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:09.978579    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f9fd1f-dfcd8cc4c-d274g"
Jul 20 13:22:09.978814 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:09.978616    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f9fd1f-dfcd8cc4c-d274g" event={"ID":"ed32102f-976f-40ee-a1aa-a52b3722b991","Type":"ContainerDied","Data":"a9e48eea9d2fc1747c145c08c3131070baba6e1d76a5aba1b3bfa6e7120cf42d"}
Jul 20 13:22:09.978814 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:09.978677    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f9fd1f-dfcd8cc4c-d274g" event={"ID":"ed32102f-976f-40ee-a1aa-a52b3722b991","Type":"ContainerDied","Data":"974ec5e530af055fe83b78befd9dca2476c5e0f565a9efb55fd1029f77f431e1"}
Jul 20 13:22:09.978814 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:09.978708    2570 scope.go:117] "RemoveContainer" containerID="a9e48eea9d2fc1747c145c08c3131070baba6e1d76a5aba1b3bfa6e7120cf42d"
Jul 20 13:22:09.990486 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:09.990459    2570 scope.go:117] "RemoveContainer" containerID="a9e48eea9d2fc1747c145c08c3131070baba6e1d76a5aba1b3bfa6e7120cf42d"
Jul 20 13:22:09.990864 ip-10-0-139-1 kubenswrapper[2570]: E0720 13:22:09.990842    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9e48eea9d2fc1747c145c08c3131070baba6e1d76a5aba1b3bfa6e7120cf42d\": container with ID starting with a9e48eea9d2fc1747c145c08c3131070baba6e1d76a5aba1b3bfa6e7120cf42d not found: ID does not exist" containerID="a9e48eea9d2fc1747c145c08c3131070baba6e1d76a5aba1b3bfa6e7120cf42d"
Jul 20 13:22:09.990960 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:09.990877    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9e48eea9d2fc1747c145c08c3131070baba6e1d76a5aba1b3bfa6e7120cf42d"} err="failed to get container status \"a9e48eea9d2fc1747c145c08c3131070baba6e1d76a5aba1b3bfa6e7120cf42d\": rpc error: code = NotFound desc = could not find container \"a9e48eea9d2fc1747c145c08c3131070baba6e1d76a5aba1b3bfa6e7120cf42d\": container with ID starting with a9e48eea9d2fc1747c145c08c3131070baba6e1d76a5aba1b3bfa6e7120cf42d not found: ID does not exist"
Jul 20 13:22:10.002941 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:10.002916    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-f9fd1f-dfcd8cc4c-d274g"]
Jul 20 13:22:10.007624 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:10.007599    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-f9fd1f-dfcd8cc4c-d274g"]
Jul 20 13:22:11.807555 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:11.807521    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed32102f-976f-40ee-a1aa-a52b3722b991" path="/var/lib/kubelet/pods/ed32102f-976f-40ee-a1aa-a52b3722b991/volumes"
Jul 20 13:22:35.587507 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:35.587471    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1797d3-648b4dc9c7-6dz76"]
Jul 20 13:22:35.588057 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:35.587720    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1797d3-648b4dc9c7-6dz76" podUID="75cc130b-40d5-42f3-9db5-4c23226d40e8" containerName="maas-api" containerID="cri-o://951e486c26fb19241df4100c26ddb2180cdd38ee33223108d380ac876f9826d6" gracePeriod=30
Jul 20 13:22:35.833495 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:35.833466    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1797d3-648b4dc9c7-6dz76"
Jul 20 13:22:35.880615 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:35.880522    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75cc130b-40d5-42f3-9db5-4c23226d40e8-openshift-service-ca\") pod \"75cc130b-40d5-42f3-9db5-4c23226d40e8\" (UID: \"75cc130b-40d5-42f3-9db5-4c23226d40e8\") "
Jul 20 13:22:35.880615 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:35.880585    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bwwrl\" (UniqueName: \"kubernetes.io/projected/75cc130b-40d5-42f3-9db5-4c23226d40e8-kube-api-access-bwwrl\") pod \"75cc130b-40d5-42f3-9db5-4c23226d40e8\" (UID: \"75cc130b-40d5-42f3-9db5-4c23226d40e8\") "
Jul 20 13:22:35.880615 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:35.880608    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75cc130b-40d5-42f3-9db5-4c23226d40e8-maas-api-tls\") pod \"75cc130b-40d5-42f3-9db5-4c23226d40e8\" (UID: \"75cc130b-40d5-42f3-9db5-4c23226d40e8\") "
Jul 20 13:22:35.880941 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:35.880915    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75cc130b-40d5-42f3-9db5-4c23226d40e8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "75cc130b-40d5-42f3-9db5-4c23226d40e8" (UID: "75cc130b-40d5-42f3-9db5-4c23226d40e8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:22:35.882812 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:35.882779    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75cc130b-40d5-42f3-9db5-4c23226d40e8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "75cc130b-40d5-42f3-9db5-4c23226d40e8" (UID: "75cc130b-40d5-42f3-9db5-4c23226d40e8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:22:35.882927 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:35.882831    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75cc130b-40d5-42f3-9db5-4c23226d40e8-kube-api-access-bwwrl" (OuterVolumeSpecName: "kube-api-access-bwwrl") pod "75cc130b-40d5-42f3-9db5-4c23226d40e8" (UID: "75cc130b-40d5-42f3-9db5-4c23226d40e8"). InnerVolumeSpecName "kube-api-access-bwwrl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:22:35.981594 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:35.981552    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bwwrl\" (UniqueName: \"kubernetes.io/projected/75cc130b-40d5-42f3-9db5-4c23226d40e8-kube-api-access-bwwrl\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:22:35.981594 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:35.981588    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75cc130b-40d5-42f3-9db5-4c23226d40e8-maas-api-tls\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:22:35.981594 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:35.981597    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75cc130b-40d5-42f3-9db5-4c23226d40e8-openshift-service-ca\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:22:36.119073 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:36.119036    2570 generic.go:356] "Generic (PLEG): container finished" podID="75cc130b-40d5-42f3-9db5-4c23226d40e8" containerID="951e486c26fb19241df4100c26ddb2180cdd38ee33223108d380ac876f9826d6" exitCode=0
Jul 20 13:22:36.119276 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:36.119115    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1797d3-648b4dc9c7-6dz76" event={"ID":"75cc130b-40d5-42f3-9db5-4c23226d40e8","Type":"ContainerDied","Data":"951e486c26fb19241df4100c26ddb2180cdd38ee33223108d380ac876f9826d6"}
Jul 20 13:22:36.119276 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:36.119169    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1797d3-648b4dc9c7-6dz76" event={"ID":"75cc130b-40d5-42f3-9db5-4c23226d40e8","Type":"ContainerDied","Data":"e709fce2a2f2a97dd3689342ccc21a4dbde059911c39ed0b355a2ecbbd7f5f4f"}
Jul 20 13:22:36.119276 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:36.119176    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1797d3-648b4dc9c7-6dz76"
Jul 20 13:22:36.119276 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:36.119194    2570 scope.go:117] "RemoveContainer" containerID="951e486c26fb19241df4100c26ddb2180cdd38ee33223108d380ac876f9826d6"
Jul 20 13:22:36.128683 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:36.128663    2570 scope.go:117] "RemoveContainer" containerID="951e486c26fb19241df4100c26ddb2180cdd38ee33223108d380ac876f9826d6"
Jul 20 13:22:36.128935 ip-10-0-139-1 kubenswrapper[2570]: E0720 13:22:36.128912    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"951e486c26fb19241df4100c26ddb2180cdd38ee33223108d380ac876f9826d6\": container with ID starting with 951e486c26fb19241df4100c26ddb2180cdd38ee33223108d380ac876f9826d6 not found: ID does not exist" containerID="951e486c26fb19241df4100c26ddb2180cdd38ee33223108d380ac876f9826d6"
Jul 20 13:22:36.128999 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:36.128950    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"951e486c26fb19241df4100c26ddb2180cdd38ee33223108d380ac876f9826d6"} err="failed to get container status \"951e486c26fb19241df4100c26ddb2180cdd38ee33223108d380ac876f9826d6\": rpc error: code = NotFound desc = could not find container \"951e486c26fb19241df4100c26ddb2180cdd38ee33223108d380ac876f9826d6\": container with ID starting with 951e486c26fb19241df4100c26ddb2180cdd38ee33223108d380ac876f9826d6 not found: ID does not exist"
Jul 20 13:22:36.152537 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:36.152460    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1797d3-648b4dc9c7-6dz76"]
Jul 20 13:22:36.154584 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:36.154563    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1797d3-648b4dc9c7-6dz76"]
Jul 20 13:22:37.807918 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:37.807880    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75cc130b-40d5-42f3-9db5-4c23226d40e8" path="/var/lib/kubelet/pods/75cc130b-40d5-42f3-9db5-4c23226d40e8/volumes"
Jul 20 13:22:51.135629 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:51.135592    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-7f57a3-69c7f5957-c654j"]
Jul 20 13:22:51.136036 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:51.136008    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75cc130b-40d5-42f3-9db5-4c23226d40e8" containerName="maas-api"
Jul 20 13:22:51.136036 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:51.136021    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="75cc130b-40d5-42f3-9db5-4c23226d40e8" containerName="maas-api"
Jul 20 13:22:51.136148 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:51.136050    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed32102f-976f-40ee-a1aa-a52b3722b991" containerName="maas-api"
Jul 20 13:22:51.136148 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:51.136056    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed32102f-976f-40ee-a1aa-a52b3722b991" containerName="maas-api"
Jul 20 13:22:51.136148 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:51.136136    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="75cc130b-40d5-42f3-9db5-4c23226d40e8" containerName="maas-api"
Jul 20 13:22:51.136148 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:51.136149    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed32102f-976f-40ee-a1aa-a52b3722b991" containerName="maas-api"
Jul 20 13:22:51.140787 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:51.140769    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7f57a3-69c7f5957-c654j"
Jul 20 13:22:51.144054 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:51.144031    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-7f57a3-serving-cert\""
Jul 20 13:22:51.144054 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:51.144051    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 20 13:22:51.145883 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:51.145850    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-ts9xh\""
Jul 20 13:22:51.146020 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:51.145851    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 13:22:51.149492 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:51.149470    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-7f57a3-69c7f5957-c654j"]
Jul 20 13:22:51.222855 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:51.222821    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c5b45b6-8290-4db3-b2a3-ffeb3ce11c8e-openshift-service-ca\") pod \"maas-api-e2e-shared-a-7f57a3-69c7f5957-c654j\" (UID: \"9c5b45b6-8290-4db3-b2a3-ffeb3ce11c8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7f57a3-69c7f5957-c654j"
Jul 20 13:22:51.223041 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:51.222890    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6l2n5\" (UniqueName: \"kubernetes.io/projected/9c5b45b6-8290-4db3-b2a3-ffeb3ce11c8e-kube-api-access-6l2n5\") pod \"maas-api-e2e-shared-a-7f57a3-69c7f5957-c654j\" (UID: \"9c5b45b6-8290-4db3-b2a3-ffeb3ce11c8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7f57a3-69c7f5957-c654j"
Jul 20 13:22:51.223041 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:51.222931    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c5b45b6-8290-4db3-b2a3-ffeb3ce11c8e-maas-api-tls\") pod \"maas-api-e2e-shared-a-7f57a3-69c7f5957-c654j\" (UID: \"9c5b45b6-8290-4db3-b2a3-ffeb3ce11c8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7f57a3-69c7f5957-c654j"
Jul 20 13:22:51.323845 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:51.323805    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c5b45b6-8290-4db3-b2a3-ffeb3ce11c8e-openshift-service-ca\") pod \"maas-api-e2e-shared-a-7f57a3-69c7f5957-c654j\" (UID: \"9c5b45b6-8290-4db3-b2a3-ffeb3ce11c8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7f57a3-69c7f5957-c654j"
Jul 20 13:22:51.324052 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:51.323874    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6l2n5\" (UniqueName: \"kubernetes.io/projected/9c5b45b6-8290-4db3-b2a3-ffeb3ce11c8e-kube-api-access-6l2n5\") pod \"maas-api-e2e-shared-a-7f57a3-69c7f5957-c654j\" (UID: \"9c5b45b6-8290-4db3-b2a3-ffeb3ce11c8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7f57a3-69c7f5957-c654j"
Jul 20 13:22:51.324052 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:51.323920    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c5b45b6-8290-4db3-b2a3-ffeb3ce11c8e-maas-api-tls\") pod \"maas-api-e2e-shared-a-7f57a3-69c7f5957-c654j\" (UID: \"9c5b45b6-8290-4db3-b2a3-ffeb3ce11c8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7f57a3-69c7f5957-c654j"
Jul 20 13:22:51.324528 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:51.324505    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c5b45b6-8290-4db3-b2a3-ffeb3ce11c8e-openshift-service-ca\") pod \"maas-api-e2e-shared-a-7f57a3-69c7f5957-c654j\" (UID: \"9c5b45b6-8290-4db3-b2a3-ffeb3ce11c8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7f57a3-69c7f5957-c654j"
Jul 20 13:22:51.326367 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:51.326345    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c5b45b6-8290-4db3-b2a3-ffeb3ce11c8e-maas-api-tls\") pod \"maas-api-e2e-shared-a-7f57a3-69c7f5957-c654j\" (UID: \"9c5b45b6-8290-4db3-b2a3-ffeb3ce11c8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7f57a3-69c7f5957-c654j"
Jul 20 13:22:51.341399 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:51.341366    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l2n5\" (UniqueName: \"kubernetes.io/projected/9c5b45b6-8290-4db3-b2a3-ffeb3ce11c8e-kube-api-access-6l2n5\") pod \"maas-api-e2e-shared-a-7f57a3-69c7f5957-c654j\" (UID: \"9c5b45b6-8290-4db3-b2a3-ffeb3ce11c8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7f57a3-69c7f5957-c654j"
Jul 20 13:22:51.452404 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:51.452318    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7f57a3-69c7f5957-c654j"
Jul 20 13:22:51.607269 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:51.607244    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-7f57a3-69c7f5957-c654j"]
Jul 20 13:22:51.609252 ip-10-0-139-1 kubenswrapper[2570]: W0720 13:22:51.609226    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c5b45b6_8290_4db3_b2a3_ffeb3ce11c8e.slice/crio-cbdaf4bbd8e163ee0fc1f50a41ceae0980c747f12eb10a69eaf559259c930afc WatchSource:0}: Error finding container cbdaf4bbd8e163ee0fc1f50a41ceae0980c747f12eb10a69eaf559259c930afc: Status 404 returned error can't find the container with id cbdaf4bbd8e163ee0fc1f50a41ceae0980c747f12eb10a69eaf559259c930afc
Jul 20 13:22:52.215306 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:52.215264    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7f57a3-69c7f5957-c654j" event={"ID":"9c5b45b6-8290-4db3-b2a3-ffeb3ce11c8e","Type":"ContainerStarted","Data":"81c5b362c31b6a370275a162ceb14f095b58904dbf04083d9d73a070fda38756"}
Jul 20 13:22:52.215728 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:52.215325    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7f57a3-69c7f5957-c654j" event={"ID":"9c5b45b6-8290-4db3-b2a3-ffeb3ce11c8e","Type":"ContainerStarted","Data":"cbdaf4bbd8e163ee0fc1f50a41ceae0980c747f12eb10a69eaf559259c930afc"}
Jul 20 13:22:52.215728 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:52.215411    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7f57a3-69c7f5957-c654j"
Jul 20 13:22:52.239251 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:52.239128    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7f57a3-69c7f5957-c654j" podStartSLOduration=0.877509043 podStartE2EDuration="1.239113966s" totalImagesPullingTime="361.604923ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:22:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:22:52.236842807 +0000 UTC m=+2284.991892181" watchObservedRunningTime="2026-07-20 13:22:52.239113966 +0000 UTC m=+2284.994163341"
Jul 20 13:22:58.226948 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:58.226915    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7f57a3-69c7f5957-c654j"
Jul 20 13:22:59.170302 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:59.170266    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b8383c-579968ddf6-qh74m"]
Jul 20 13:22:59.173954 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:59.173929    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b8383c-579968ddf6-qh74m"
Jul 20 13:22:59.179535 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:59.179507    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-b8383c-serving-cert\""
Jul 20 13:22:59.192495 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:59.192465    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b8383c-579968ddf6-qh74m"]
Jul 20 13:22:59.300811 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:59.300769    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/969dfcc8-46f1-46ce-bba6-fc7b76aad3d2-openshift-service-ca\") pod \"maas-api-e2e-shared-b-b8383c-579968ddf6-qh74m\" (UID: \"969dfcc8-46f1-46ce-bba6-fc7b76aad3d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b8383c-579968ddf6-qh74m"
Jul 20 13:22:59.301243 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:59.300826    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dz5kt\" (UniqueName: \"kubernetes.io/projected/969dfcc8-46f1-46ce-bba6-fc7b76aad3d2-kube-api-access-dz5kt\") pod \"maas-api-e2e-shared-b-b8383c-579968ddf6-qh74m\" (UID: \"969dfcc8-46f1-46ce-bba6-fc7b76aad3d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b8383c-579968ddf6-qh74m"
Jul 20 13:22:59.301243 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:59.300861    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/969dfcc8-46f1-46ce-bba6-fc7b76aad3d2-maas-api-tls\") pod \"maas-api-e2e-shared-b-b8383c-579968ddf6-qh74m\" (UID: \"969dfcc8-46f1-46ce-bba6-fc7b76aad3d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b8383c-579968ddf6-qh74m"
Jul 20 13:22:59.401635 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:59.401594    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/969dfcc8-46f1-46ce-bba6-fc7b76aad3d2-openshift-service-ca\") pod \"maas-api-e2e-shared-b-b8383c-579968ddf6-qh74m\" (UID: \"969dfcc8-46f1-46ce-bba6-fc7b76aad3d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b8383c-579968ddf6-qh74m"
Jul 20 13:22:59.401814 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:59.401646    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dz5kt\" (UniqueName: \"kubernetes.io/projected/969dfcc8-46f1-46ce-bba6-fc7b76aad3d2-kube-api-access-dz5kt\") pod \"maas-api-e2e-shared-b-b8383c-579968ddf6-qh74m\" (UID: \"969dfcc8-46f1-46ce-bba6-fc7b76aad3d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b8383c-579968ddf6-qh74m"
Jul 20 13:22:59.401814 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:59.401673    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/969dfcc8-46f1-46ce-bba6-fc7b76aad3d2-maas-api-tls\") pod \"maas-api-e2e-shared-b-b8383c-579968ddf6-qh74m\" (UID: \"969dfcc8-46f1-46ce-bba6-fc7b76aad3d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b8383c-579968ddf6-qh74m"
Jul 20 13:22:59.401935 ip-10-0-139-1 kubenswrapper[2570]: E0720 13:22:59.401820    2570 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-b8383c-serving-cert: secret "maas-api-e2e-shared-b-b8383c-serving-cert" not found
Jul 20 13:22:59.401935 ip-10-0-139-1 kubenswrapper[2570]: E0720 13:22:59.401893    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/969dfcc8-46f1-46ce-bba6-fc7b76aad3d2-maas-api-tls podName:969dfcc8-46f1-46ce-bba6-fc7b76aad3d2 nodeName:}" failed. No retries permitted until 2026-07-20 13:22:59.901875704 +0000 UTC m=+2292.656925058 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/969dfcc8-46f1-46ce-bba6-fc7b76aad3d2-maas-api-tls") pod "maas-api-e2e-shared-b-b8383c-579968ddf6-qh74m" (UID: "969dfcc8-46f1-46ce-bba6-fc7b76aad3d2") : secret "maas-api-e2e-shared-b-b8383c-serving-cert" not found
Jul 20 13:22:59.402360 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:59.402341    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/969dfcc8-46f1-46ce-bba6-fc7b76aad3d2-openshift-service-ca\") pod \"maas-api-e2e-shared-b-b8383c-579968ddf6-qh74m\" (UID: \"969dfcc8-46f1-46ce-bba6-fc7b76aad3d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b8383c-579968ddf6-qh74m"
Jul 20 13:22:59.413905 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:59.413878    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dz5kt\" (UniqueName: \"kubernetes.io/projected/969dfcc8-46f1-46ce-bba6-fc7b76aad3d2-kube-api-access-dz5kt\") pod \"maas-api-e2e-shared-b-b8383c-579968ddf6-qh74m\" (UID: \"969dfcc8-46f1-46ce-bba6-fc7b76aad3d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b8383c-579968ddf6-qh74m"
Jul 20 13:22:59.906832 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:59.906797    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/969dfcc8-46f1-46ce-bba6-fc7b76aad3d2-maas-api-tls\") pod \"maas-api-e2e-shared-b-b8383c-579968ddf6-qh74m\" (UID: \"969dfcc8-46f1-46ce-bba6-fc7b76aad3d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b8383c-579968ddf6-qh74m"
Jul 20 13:22:59.909413 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:22:59.909386    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/969dfcc8-46f1-46ce-bba6-fc7b76aad3d2-maas-api-tls\") pod \"maas-api-e2e-shared-b-b8383c-579968ddf6-qh74m\" (UID: \"969dfcc8-46f1-46ce-bba6-fc7b76aad3d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b8383c-579968ddf6-qh74m"
Jul 20 13:23:00.086101 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:00.086047    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b8383c-579968ddf6-qh74m"
Jul 20 13:23:00.227757 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:00.227730    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b8383c-579968ddf6-qh74m"]
Jul 20 13:23:00.229418 ip-10-0-139-1 kubenswrapper[2570]: W0720 13:23:00.229389    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod969dfcc8_46f1_46ce_bba6_fc7b76aad3d2.slice/crio-70be63fa4acbc575f122a27f1580b5845c6bd7b85a2a5aa7d9c54bc169ad6a74 WatchSource:0}: Error finding container 70be63fa4acbc575f122a27f1580b5845c6bd7b85a2a5aa7d9c54bc169ad6a74: Status 404 returned error can't find the container with id 70be63fa4acbc575f122a27f1580b5845c6bd7b85a2a5aa7d9c54bc169ad6a74
Jul 20 13:23:00.260960 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:00.260922    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b8383c-579968ddf6-qh74m" event={"ID":"969dfcc8-46f1-46ce-bba6-fc7b76aad3d2","Type":"ContainerStarted","Data":"70be63fa4acbc575f122a27f1580b5845c6bd7b85a2a5aa7d9c54bc169ad6a74"}
Jul 20 13:23:01.268783 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:01.268683    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b8383c-579968ddf6-qh74m" event={"ID":"969dfcc8-46f1-46ce-bba6-fc7b76aad3d2","Type":"ContainerStarted","Data":"9a2b7c5d47449de57b5f7d569c2cb8df12f398df720b312bfefb4cf4d33df223"}
Jul 20 13:23:01.268783 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:01.268770    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b8383c-579968ddf6-qh74m"
Jul 20 13:23:01.292402 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:01.292344    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b8383c-579968ddf6-qh74m" podStartSLOduration=1.567675592 podStartE2EDuration="2.292325359s" totalImagesPullingTime="724.649767ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:22:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:23:01.290870657 +0000 UTC m=+2294.045920037" watchObservedRunningTime="2026-07-20 13:23:01.292325359 +0000 UTC m=+2294.047374733"
Jul 20 13:23:07.279960 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:07.279933    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b8383c-579968ddf6-qh74m"
Jul 20 13:23:19.890849 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:19.890817    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-7f57a3/auth-test-model-7f57a3-kserve-759777dc95-vk8kz"]
Jul 20 13:23:19.894756 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:19.894730    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7f57a3/auth-test-model-7f57a3-kserve-759777dc95-vk8kz"
Jul 20 13:23:19.900027 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:19.899999    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-7f57a3\"/\"kube-root-ca.crt\""
Jul 20 13:23:19.900209 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:19.900111    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-7f57a3\"/\"default-dockercfg-zhc6j\""
Jul 20 13:23:19.900209 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:19.900160    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-7f57a3\"/\"openshift-service-ca.crt\""
Jul 20 13:23:19.900209 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:19.900163    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-7f57a3\"/\"auth-test-model-7f57a3-kserve-self-signed-certs\""
Jul 20 13:23:19.907529 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:19.907503    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-7f57a3/auth-test-model-7f57a3-kserve-759777dc95-vk8kz"]
Jul 20 13:23:19.986010 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:19.985969    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/194ba4a6-2bc5-415e-8efe-8d8cc1096e1d-model-cache\") pod \"auth-test-model-7f57a3-kserve-759777dc95-vk8kz\" (UID: \"194ba4a6-2bc5-415e-8efe-8d8cc1096e1d\") " pod="ai-tenant-e2e-shared-a-7f57a3/auth-test-model-7f57a3-kserve-759777dc95-vk8kz"
Jul 20 13:23:19.986010 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:19.986011    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/194ba4a6-2bc5-415e-8efe-8d8cc1096e1d-home\") pod \"auth-test-model-7f57a3-kserve-759777dc95-vk8kz\" (UID: \"194ba4a6-2bc5-415e-8efe-8d8cc1096e1d\") " pod="ai-tenant-e2e-shared-a-7f57a3/auth-test-model-7f57a3-kserve-759777dc95-vk8kz"
Jul 20 13:23:19.986252 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:19.986060    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5mch\" (UniqueName: \"kubernetes.io/projected/194ba4a6-2bc5-415e-8efe-8d8cc1096e1d-kube-api-access-w5mch\") pod \"auth-test-model-7f57a3-kserve-759777dc95-vk8kz\" (UID: \"194ba4a6-2bc5-415e-8efe-8d8cc1096e1d\") " pod="ai-tenant-e2e-shared-a-7f57a3/auth-test-model-7f57a3-kserve-759777dc95-vk8kz"
Jul 20 13:23:19.986252 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:19.986155    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/194ba4a6-2bc5-415e-8efe-8d8cc1096e1d-tls-certs\") pod \"auth-test-model-7f57a3-kserve-759777dc95-vk8kz\" (UID: \"194ba4a6-2bc5-415e-8efe-8d8cc1096e1d\") " pod="ai-tenant-e2e-shared-a-7f57a3/auth-test-model-7f57a3-kserve-759777dc95-vk8kz"
Jul 20 13:23:19.986252 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:19.986182    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/194ba4a6-2bc5-415e-8efe-8d8cc1096e1d-dshm\") pod \"auth-test-model-7f57a3-kserve-759777dc95-vk8kz\" (UID: \"194ba4a6-2bc5-415e-8efe-8d8cc1096e1d\") " pod="ai-tenant-e2e-shared-a-7f57a3/auth-test-model-7f57a3-kserve-759777dc95-vk8kz"
Jul 20 13:23:19.986252 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:19.986210    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/194ba4a6-2bc5-415e-8efe-8d8cc1096e1d-tmp-dir\") pod \"auth-test-model-7f57a3-kserve-759777dc95-vk8kz\" (UID: \"194ba4a6-2bc5-415e-8efe-8d8cc1096e1d\") " pod="ai-tenant-e2e-shared-a-7f57a3/auth-test-model-7f57a3-kserve-759777dc95-vk8kz"
Jul 20 13:23:20.087493 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:20.087449    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/194ba4a6-2bc5-415e-8efe-8d8cc1096e1d-model-cache\") pod \"auth-test-model-7f57a3-kserve-759777dc95-vk8kz\" (UID: \"194ba4a6-2bc5-415e-8efe-8d8cc1096e1d\") " pod="ai-tenant-e2e-shared-a-7f57a3/auth-test-model-7f57a3-kserve-759777dc95-vk8kz"
Jul 20 13:23:20.087700 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:20.087503    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/194ba4a6-2bc5-415e-8efe-8d8cc1096e1d-home\") pod \"auth-test-model-7f57a3-kserve-759777dc95-vk8kz\" (UID: \"194ba4a6-2bc5-415e-8efe-8d8cc1096e1d\") " pod="ai-tenant-e2e-shared-a-7f57a3/auth-test-model-7f57a3-kserve-759777dc95-vk8kz"
Jul 20 13:23:20.087700 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:20.087535    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5mch\" (UniqueName: \"kubernetes.io/projected/194ba4a6-2bc5-415e-8efe-8d8cc1096e1d-kube-api-access-w5mch\") pod \"auth-test-model-7f57a3-kserve-759777dc95-vk8kz\" (UID: \"194ba4a6-2bc5-415e-8efe-8d8cc1096e1d\") " pod="ai-tenant-e2e-shared-a-7f57a3/auth-test-model-7f57a3-kserve-759777dc95-vk8kz"
Jul 20 13:23:20.087700 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:20.087583    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/194ba4a6-2bc5-415e-8efe-8d8cc1096e1d-tls-certs\") pod \"auth-test-model-7f57a3-kserve-759777dc95-vk8kz\" (UID: \"194ba4a6-2bc5-415e-8efe-8d8cc1096e1d\") " pod="ai-tenant-e2e-shared-a-7f57a3/auth-test-model-7f57a3-kserve-759777dc95-vk8kz"
Jul 20 13:23:20.087700 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:20.087635    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/194ba4a6-2bc5-415e-8efe-8d8cc1096e1d-dshm\") pod \"auth-test-model-7f57a3-kserve-759777dc95-vk8kz\" (UID: \"194ba4a6-2bc5-415e-8efe-8d8cc1096e1d\") " pod="ai-tenant-e2e-shared-a-7f57a3/auth-test-model-7f57a3-kserve-759777dc95-vk8kz"
Jul 20 13:23:20.087933 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:20.087705    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/194ba4a6-2bc5-415e-8efe-8d8cc1096e1d-tmp-dir\") pod \"auth-test-model-7f57a3-kserve-759777dc95-vk8kz\" (UID: \"194ba4a6-2bc5-415e-8efe-8d8cc1096e1d\") " pod="ai-tenant-e2e-shared-a-7f57a3/auth-test-model-7f57a3-kserve-759777dc95-vk8kz"
Jul 20 13:23:20.087933 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:20.087884    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/194ba4a6-2bc5-415e-8efe-8d8cc1096e1d-model-cache\") pod \"auth-test-model-7f57a3-kserve-759777dc95-vk8kz\" (UID: \"194ba4a6-2bc5-415e-8efe-8d8cc1096e1d\") " pod="ai-tenant-e2e-shared-a-7f57a3/auth-test-model-7f57a3-kserve-759777dc95-vk8kz"
Jul 20 13:23:20.087933 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:20.087921    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/194ba4a6-2bc5-415e-8efe-8d8cc1096e1d-home\") pod \"auth-test-model-7f57a3-kserve-759777dc95-vk8kz\" (UID: \"194ba4a6-2bc5-415e-8efe-8d8cc1096e1d\") " pod="ai-tenant-e2e-shared-a-7f57a3/auth-test-model-7f57a3-kserve-759777dc95-vk8kz"
Jul 20 13:23:20.088067 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:20.088048    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/194ba4a6-2bc5-415e-8efe-8d8cc1096e1d-tmp-dir\") pod \"auth-test-model-7f57a3-kserve-759777dc95-vk8kz\" (UID: \"194ba4a6-2bc5-415e-8efe-8d8cc1096e1d\") " pod="ai-tenant-e2e-shared-a-7f57a3/auth-test-model-7f57a3-kserve-759777dc95-vk8kz"
Jul 20 13:23:20.089908 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:20.089880    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/194ba4a6-2bc5-415e-8efe-8d8cc1096e1d-dshm\") pod \"auth-test-model-7f57a3-kserve-759777dc95-vk8kz\" (UID: \"194ba4a6-2bc5-415e-8efe-8d8cc1096e1d\") " pod="ai-tenant-e2e-shared-a-7f57a3/auth-test-model-7f57a3-kserve-759777dc95-vk8kz"
Jul 20 13:23:20.090232 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:20.090214    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/194ba4a6-2bc5-415e-8efe-8d8cc1096e1d-tls-certs\") pod \"auth-test-model-7f57a3-kserve-759777dc95-vk8kz\" (UID: \"194ba4a6-2bc5-415e-8efe-8d8cc1096e1d\") " pod="ai-tenant-e2e-shared-a-7f57a3/auth-test-model-7f57a3-kserve-759777dc95-vk8kz"
Jul 20 13:23:20.097310 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:20.097285    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5mch\" (UniqueName: \"kubernetes.io/projected/194ba4a6-2bc5-415e-8efe-8d8cc1096e1d-kube-api-access-w5mch\") pod \"auth-test-model-7f57a3-kserve-759777dc95-vk8kz\" (UID: \"194ba4a6-2bc5-415e-8efe-8d8cc1096e1d\") " pod="ai-tenant-e2e-shared-a-7f57a3/auth-test-model-7f57a3-kserve-759777dc95-vk8kz"
Jul 20 13:23:20.204648 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:20.204555    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7f57a3/auth-test-model-7f57a3-kserve-759777dc95-vk8kz"
Jul 20 13:23:20.344344 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:20.344312    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-7f57a3/auth-test-model-7f57a3-kserve-759777dc95-vk8kz"]
Jul 20 13:23:20.345014 ip-10-0-139-1 kubenswrapper[2570]: W0720 13:23:20.344986    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod194ba4a6_2bc5_415e_8efe_8d8cc1096e1d.slice/crio-9b022f3b2d30ff20c56ca9d44c657f000d8cba6df419a2d1947bbcf9ed822dc2 WatchSource:0}: Error finding container 9b022f3b2d30ff20c56ca9d44c657f000d8cba6df419a2d1947bbcf9ed822dc2: Status 404 returned error can't find the container with id 9b022f3b2d30ff20c56ca9d44c657f000d8cba6df419a2d1947bbcf9ed822dc2
Jul 20 13:23:20.371981 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:20.371951    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7f57a3/auth-test-model-7f57a3-kserve-759777dc95-vk8kz" event={"ID":"194ba4a6-2bc5-415e-8efe-8d8cc1096e1d","Type":"ContainerStarted","Data":"9b022f3b2d30ff20c56ca9d44c657f000d8cba6df419a2d1947bbcf9ed822dc2"}
Jul 20 13:23:21.379372 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:21.379331    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7f57a3/auth-test-model-7f57a3-kserve-759777dc95-vk8kz" event={"ID":"194ba4a6-2bc5-415e-8efe-8d8cc1096e1d","Type":"ContainerStarted","Data":"0db3909ceba2c9b6352f0493427e33a34995ca260eb748c4ecc1016e51e81e66"}
Jul 20 13:23:21.401871 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:21.401815    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-7f57a3/auth-test-model-7f57a3-kserve-759777dc95-vk8kz" podStartSLOduration=2.40179917 podStartE2EDuration="2.40179917s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:23:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:23:21.399427137 +0000 UTC m=+2314.154476514" watchObservedRunningTime="2026-07-20 13:23:21.40179917 +0000 UTC m=+2314.156848545"
Jul 20 13:23:30.205285 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:30.205234    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-7f57a3/auth-test-model-7f57a3-kserve-759777dc95-vk8kz"
Jul 20 13:23:30.205808 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:30.205307    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-7f57a3/auth-test-model-7f57a3-kserve-759777dc95-vk8kz"
Jul 20 13:23:30.217800 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:30.217774    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-7f57a3/auth-test-model-7f57a3-kserve-759777dc95-vk8kz"
Jul 20 13:23:30.438148 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:30.438118    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-7f57a3/auth-test-model-7f57a3-kserve-759777dc95-vk8kz"
Jul 20 13:23:44.192584 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:44.192507    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-b8383c/auth-test-model-b8383c-kserve-6b4d79b5f-m7rfj"]
Jul 20 13:23:44.196311 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:44.196293    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b8383c/auth-test-model-b8383c-kserve-6b4d79b5f-m7rfj"
Jul 20 13:23:44.199711 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:44.199690    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b8383c\"/\"default-dockercfg-c88sc\""
Jul 20 13:23:44.201415 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:44.201394    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b8383c\"/\"kube-root-ca.crt\""
Jul 20 13:23:44.201648 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:44.201606    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b8383c\"/\"openshift-service-ca.crt\""
Jul 20 13:23:44.201745 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:44.201643    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b8383c\"/\"auth-test-model-b8383c-kserve-self-signed-certs\""
Jul 20 13:23:44.212612 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:44.212586    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b8383c/auth-test-model-b8383c-kserve-6b4d79b5f-m7rfj"]
Jul 20 13:23:44.321703 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:44.321661    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab-dshm\") pod \"auth-test-model-b8383c-kserve-6b4d79b5f-m7rfj\" (UID: \"31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab\") " pod="ai-tenant-e2e-shared-b-b8383c/auth-test-model-b8383c-kserve-6b4d79b5f-m7rfj"
Jul 20 13:23:44.321889 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:44.321711    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab-model-cache\") pod \"auth-test-model-b8383c-kserve-6b4d79b5f-m7rfj\" (UID: \"31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab\") " pod="ai-tenant-e2e-shared-b-b8383c/auth-test-model-b8383c-kserve-6b4d79b5f-m7rfj"
Jul 20 13:23:44.321889 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:44.321740    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab-tls-certs\") pod \"auth-test-model-b8383c-kserve-6b4d79b5f-m7rfj\" (UID: \"31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab\") " pod="ai-tenant-e2e-shared-b-b8383c/auth-test-model-b8383c-kserve-6b4d79b5f-m7rfj"
Jul 20 13:23:44.321889 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:44.321824    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flg6f\" (UniqueName: \"kubernetes.io/projected/31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab-kube-api-access-flg6f\") pod \"auth-test-model-b8383c-kserve-6b4d79b5f-m7rfj\" (UID: \"31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab\") " pod="ai-tenant-e2e-shared-b-b8383c/auth-test-model-b8383c-kserve-6b4d79b5f-m7rfj"
Jul 20 13:23:44.321889 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:44.321864    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab-home\") pod \"auth-test-model-b8383c-kserve-6b4d79b5f-m7rfj\" (UID: \"31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab\") " pod="ai-tenant-e2e-shared-b-b8383c/auth-test-model-b8383c-kserve-6b4d79b5f-m7rfj"
Jul 20 13:23:44.321889 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:44.321878    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab-tmp-dir\") pod \"auth-test-model-b8383c-kserve-6b4d79b5f-m7rfj\" (UID: \"31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab\") " pod="ai-tenant-e2e-shared-b-b8383c/auth-test-model-b8383c-kserve-6b4d79b5f-m7rfj"
Jul 20 13:23:44.422975 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:44.422934    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab-dshm\") pod \"auth-test-model-b8383c-kserve-6b4d79b5f-m7rfj\" (UID: \"31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab\") " pod="ai-tenant-e2e-shared-b-b8383c/auth-test-model-b8383c-kserve-6b4d79b5f-m7rfj"
Jul 20 13:23:44.423188 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:44.422983    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab-model-cache\") pod \"auth-test-model-b8383c-kserve-6b4d79b5f-m7rfj\" (UID: \"31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab\") " pod="ai-tenant-e2e-shared-b-b8383c/auth-test-model-b8383c-kserve-6b4d79b5f-m7rfj"
Jul 20 13:23:44.423188 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:44.423028    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab-tls-certs\") pod \"auth-test-model-b8383c-kserve-6b4d79b5f-m7rfj\" (UID: \"31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab\") " pod="ai-tenant-e2e-shared-b-b8383c/auth-test-model-b8383c-kserve-6b4d79b5f-m7rfj"
Jul 20 13:23:44.423188 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:44.423130    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flg6f\" (UniqueName: \"kubernetes.io/projected/31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab-kube-api-access-flg6f\") pod \"auth-test-model-b8383c-kserve-6b4d79b5f-m7rfj\" (UID: \"31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab\") " pod="ai-tenant-e2e-shared-b-b8383c/auth-test-model-b8383c-kserve-6b4d79b5f-m7rfj"
Jul 20 13:23:44.423377 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:44.423190    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab-home\") pod \"auth-test-model-b8383c-kserve-6b4d79b5f-m7rfj\" (UID: \"31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab\") " pod="ai-tenant-e2e-shared-b-b8383c/auth-test-model-b8383c-kserve-6b4d79b5f-m7rfj"
Jul 20 13:23:44.423377 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:44.423216    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab-tmp-dir\") pod \"auth-test-model-b8383c-kserve-6b4d79b5f-m7rfj\" (UID: \"31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab\") " pod="ai-tenant-e2e-shared-b-b8383c/auth-test-model-b8383c-kserve-6b4d79b5f-m7rfj"
Jul 20 13:23:44.423495 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:44.423442    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab-model-cache\") pod \"auth-test-model-b8383c-kserve-6b4d79b5f-m7rfj\" (UID: \"31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab\") " pod="ai-tenant-e2e-shared-b-b8383c/auth-test-model-b8383c-kserve-6b4d79b5f-m7rfj"
Jul 20 13:23:44.423554 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:44.423521    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab-home\") pod \"auth-test-model-b8383c-kserve-6b4d79b5f-m7rfj\" (UID: \"31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab\") " pod="ai-tenant-e2e-shared-b-b8383c/auth-test-model-b8383c-kserve-6b4d79b5f-m7rfj"
Jul 20 13:23:44.425321 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:44.423763    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab-tmp-dir\") pod \"auth-test-model-b8383c-kserve-6b4d79b5f-m7rfj\" (UID: \"31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab\") " pod="ai-tenant-e2e-shared-b-b8383c/auth-test-model-b8383c-kserve-6b4d79b5f-m7rfj"
Jul 20 13:23:44.425958 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:44.425936    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab-dshm\") pod \"auth-test-model-b8383c-kserve-6b4d79b5f-m7rfj\" (UID: \"31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab\") " pod="ai-tenant-e2e-shared-b-b8383c/auth-test-model-b8383c-kserve-6b4d79b5f-m7rfj"
Jul 20 13:23:44.426240 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:44.426216    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab-tls-certs\") pod \"auth-test-model-b8383c-kserve-6b4d79b5f-m7rfj\" (UID: \"31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab\") " pod="ai-tenant-e2e-shared-b-b8383c/auth-test-model-b8383c-kserve-6b4d79b5f-m7rfj"
Jul 20 13:23:44.434020 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:44.433990    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flg6f\" (UniqueName: \"kubernetes.io/projected/31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab-kube-api-access-flg6f\") pod \"auth-test-model-b8383c-kserve-6b4d79b5f-m7rfj\" (UID: \"31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab\") " pod="ai-tenant-e2e-shared-b-b8383c/auth-test-model-b8383c-kserve-6b4d79b5f-m7rfj"
Jul 20 13:23:44.506527 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:44.506438    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b8383c/auth-test-model-b8383c-kserve-6b4d79b5f-m7rfj"
Jul 20 13:23:44.655270 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:44.655237    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b8383c/auth-test-model-b8383c-kserve-6b4d79b5f-m7rfj"]
Jul 20 13:23:44.656646 ip-10-0-139-1 kubenswrapper[2570]: W0720 13:23:44.656622    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod31e2cda7_bf8c_4bbe_bbc5_71bfde3200ab.slice/crio-4d6e9f376e399326c971829c9b721cf0b40b81038328d43bc5dd574d95b1caf9 WatchSource:0}: Error finding container 4d6e9f376e399326c971829c9b721cf0b40b81038328d43bc5dd574d95b1caf9: Status 404 returned error can't find the container with id 4d6e9f376e399326c971829c9b721cf0b40b81038328d43bc5dd574d95b1caf9
Jul 20 13:23:45.515328 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:45.515288    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b8383c/auth-test-model-b8383c-kserve-6b4d79b5f-m7rfj" event={"ID":"31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab","Type":"ContainerStarted","Data":"d912bc50db2090bc6dab5c05f40f987308b34c0d2e68cf6613c04f2307ba3c00"}
Jul 20 13:23:45.515328 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:45.515334    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b8383c/auth-test-model-b8383c-kserve-6b4d79b5f-m7rfj" event={"ID":"31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab","Type":"ContainerStarted","Data":"4d6e9f376e399326c971829c9b721cf0b40b81038328d43bc5dd574d95b1caf9"}
Jul 20 13:23:45.537741 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:45.537686    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-b8383c/auth-test-model-b8383c-kserve-6b4d79b5f-m7rfj" podStartSLOduration=1.537666969 podStartE2EDuration="1.537666969s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:23:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:23:45.5347215 +0000 UTC m=+2338.289770875" watchObservedRunningTime="2026-07-20 13:23:45.537666969 +0000 UTC m=+2338.292716344"
Jul 20 13:23:54.507589 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:54.507544    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-b8383c/auth-test-model-b8383c-kserve-6b4d79b5f-m7rfj"
Jul 20 13:23:54.508141 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:54.507605    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-b8383c/auth-test-model-b8383c-kserve-6b4d79b5f-m7rfj"
Jul 20 13:23:54.520238 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:54.520197    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-b8383c/auth-test-model-b8383c-kserve-6b4d79b5f-m7rfj"
Jul 20 13:23:54.575080 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:23:54.575044    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-b8383c/auth-test-model-b8383c-kserve-6b4d79b5f-m7rfj"
Jul 20 13:24:47.993562 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:24:47.993535    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rhdn8_5efe9094-763c-4689-85b7-83e0ccb19811/ovn-acl-logging/0.log"
Jul 20 13:24:48.003423 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:24:48.003398    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rhdn8_5efe9094-763c-4689-85b7-83e0ccb19811/ovn-acl-logging/0.log"
Jul 20 13:26:02.755424 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:02.755386    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-7f57a3/auth-test-model-7f57a3-kserve-759777dc95-vk8kz"]
Jul 20 13:26:03.703197 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:03.703159    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b8383c/auth-test-model-b8383c-kserve-6b4d79b5f-m7rfj"]
Jul 20 13:26:17.775580 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:17.775527    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-7f57a3/auth-test-model-7f57a3-kserve-759777dc95-vk8kz" podUID="194ba4a6-2bc5-415e-8efe-8d8cc1096e1d" containerName="main" containerID="cri-o://0db3909ceba2c9b6352f0493427e33a34995ca260eb748c4ecc1016e51e81e66" gracePeriod=45
Jul 20 13:26:18.017769 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:18.017744    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7f57a3/auth-test-model-7f57a3-kserve-759777dc95-vk8kz"
Jul 20 13:26:18.078933 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:18.078908    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/194ba4a6-2bc5-415e-8efe-8d8cc1096e1d-model-cache\") pod \"194ba4a6-2bc5-415e-8efe-8d8cc1096e1d\" (UID: \"194ba4a6-2bc5-415e-8efe-8d8cc1096e1d\") "
Jul 20 13:26:18.079145 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:18.078962    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/194ba4a6-2bc5-415e-8efe-8d8cc1096e1d-tls-certs\") pod \"194ba4a6-2bc5-415e-8efe-8d8cc1096e1d\" (UID: \"194ba4a6-2bc5-415e-8efe-8d8cc1096e1d\") "
Jul 20 13:26:18.079145 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:18.079006    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/194ba4a6-2bc5-415e-8efe-8d8cc1096e1d-tmp-dir\") pod \"194ba4a6-2bc5-415e-8efe-8d8cc1096e1d\" (UID: \"194ba4a6-2bc5-415e-8efe-8d8cc1096e1d\") "
Jul 20 13:26:18.079145 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:18.079030    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/194ba4a6-2bc5-415e-8efe-8d8cc1096e1d-dshm\") pod \"194ba4a6-2bc5-415e-8efe-8d8cc1096e1d\" (UID: \"194ba4a6-2bc5-415e-8efe-8d8cc1096e1d\") "
Jul 20 13:26:18.079145 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:18.079069    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/194ba4a6-2bc5-415e-8efe-8d8cc1096e1d-home\") pod \"194ba4a6-2bc5-415e-8efe-8d8cc1096e1d\" (UID: \"194ba4a6-2bc5-415e-8efe-8d8cc1096e1d\") "
Jul 20 13:26:18.079382 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:18.079185    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w5mch\" (UniqueName: \"kubernetes.io/projected/194ba4a6-2bc5-415e-8efe-8d8cc1096e1d-kube-api-access-w5mch\") pod \"194ba4a6-2bc5-415e-8efe-8d8cc1096e1d\" (UID: \"194ba4a6-2bc5-415e-8efe-8d8cc1096e1d\") "
Jul 20 13:26:18.079382 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:18.079213    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/194ba4a6-2bc5-415e-8efe-8d8cc1096e1d-model-cache" (OuterVolumeSpecName: "model-cache") pod "194ba4a6-2bc5-415e-8efe-8d8cc1096e1d" (UID: "194ba4a6-2bc5-415e-8efe-8d8cc1096e1d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:26:18.079382 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:18.079363    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/194ba4a6-2bc5-415e-8efe-8d8cc1096e1d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "194ba4a6-2bc5-415e-8efe-8d8cc1096e1d" (UID: "194ba4a6-2bc5-415e-8efe-8d8cc1096e1d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:26:18.079506 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:18.079390    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/194ba4a6-2bc5-415e-8efe-8d8cc1096e1d-home" (OuterVolumeSpecName: "home") pod "194ba4a6-2bc5-415e-8efe-8d8cc1096e1d" (UID: "194ba4a6-2bc5-415e-8efe-8d8cc1096e1d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:26:18.079543 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:18.079531    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/194ba4a6-2bc5-415e-8efe-8d8cc1096e1d-model-cache\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:26:18.079577 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:18.079546    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/194ba4a6-2bc5-415e-8efe-8d8cc1096e1d-tmp-dir\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:26:18.079577 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:18.079555    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/194ba4a6-2bc5-415e-8efe-8d8cc1096e1d-home\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:26:18.081372 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:18.081346    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/194ba4a6-2bc5-415e-8efe-8d8cc1096e1d-kube-api-access-w5mch" (OuterVolumeSpecName: "kube-api-access-w5mch") pod "194ba4a6-2bc5-415e-8efe-8d8cc1096e1d" (UID: "194ba4a6-2bc5-415e-8efe-8d8cc1096e1d"). InnerVolumeSpecName "kube-api-access-w5mch". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:26:18.081493 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:18.081377    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/194ba4a6-2bc5-415e-8efe-8d8cc1096e1d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "194ba4a6-2bc5-415e-8efe-8d8cc1096e1d" (UID: "194ba4a6-2bc5-415e-8efe-8d8cc1096e1d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:26:18.081493 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:18.081383    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/194ba4a6-2bc5-415e-8efe-8d8cc1096e1d-dshm" (OuterVolumeSpecName: "dshm") pod "194ba4a6-2bc5-415e-8efe-8d8cc1096e1d" (UID: "194ba4a6-2bc5-415e-8efe-8d8cc1096e1d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:26:18.180719 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:18.180681    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/194ba4a6-2bc5-415e-8efe-8d8cc1096e1d-tls-certs\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:26:18.180719 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:18.180713    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/194ba4a6-2bc5-415e-8efe-8d8cc1096e1d-dshm\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:26:18.180922 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:18.180730    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5mch\" (UniqueName: \"kubernetes.io/projected/194ba4a6-2bc5-415e-8efe-8d8cc1096e1d-kube-api-access-w5mch\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:26:18.376698 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:18.376611    2570 generic.go:356] "Generic (PLEG): container finished" podID="194ba4a6-2bc5-415e-8efe-8d8cc1096e1d" containerID="0db3909ceba2c9b6352f0493427e33a34995ca260eb748c4ecc1016e51e81e66" exitCode=0
Jul 20 13:26:18.376698 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:18.376668    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7f57a3/auth-test-model-7f57a3-kserve-759777dc95-vk8kz"
Jul 20 13:26:18.376912 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:18.376692    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7f57a3/auth-test-model-7f57a3-kserve-759777dc95-vk8kz" event={"ID":"194ba4a6-2bc5-415e-8efe-8d8cc1096e1d","Type":"ContainerDied","Data":"0db3909ceba2c9b6352f0493427e33a34995ca260eb748c4ecc1016e51e81e66"}
Jul 20 13:26:18.376912 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:18.376736    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7f57a3/auth-test-model-7f57a3-kserve-759777dc95-vk8kz" event={"ID":"194ba4a6-2bc5-415e-8efe-8d8cc1096e1d","Type":"ContainerDied","Data":"9b022f3b2d30ff20c56ca9d44c657f000d8cba6df419a2d1947bbcf9ed822dc2"}
Jul 20 13:26:18.376912 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:18.376754    2570 scope.go:117] "RemoveContainer" containerID="0db3909ceba2c9b6352f0493427e33a34995ca260eb748c4ecc1016e51e81e66"
Jul 20 13:26:18.386669 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:18.386652    2570 scope.go:117] "RemoveContainer" containerID="0db3909ceba2c9b6352f0493427e33a34995ca260eb748c4ecc1016e51e81e66"
Jul 20 13:26:18.386951 ip-10-0-139-1 kubenswrapper[2570]: E0720 13:26:18.386933    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0db3909ceba2c9b6352f0493427e33a34995ca260eb748c4ecc1016e51e81e66\": container with ID starting with 0db3909ceba2c9b6352f0493427e33a34995ca260eb748c4ecc1016e51e81e66 not found: ID does not exist" containerID="0db3909ceba2c9b6352f0493427e33a34995ca260eb748c4ecc1016e51e81e66"
Jul 20 13:26:18.387031 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:18.386957    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0db3909ceba2c9b6352f0493427e33a34995ca260eb748c4ecc1016e51e81e66"} err="failed to get container status \"0db3909ceba2c9b6352f0493427e33a34995ca260eb748c4ecc1016e51e81e66\": rpc error: code = NotFound desc = could not find container \"0db3909ceba2c9b6352f0493427e33a34995ca260eb748c4ecc1016e51e81e66\": container with ID starting with 0db3909ceba2c9b6352f0493427e33a34995ca260eb748c4ecc1016e51e81e66 not found: ID does not exist"
Jul 20 13:26:18.401505 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:18.401476    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-7f57a3/auth-test-model-7f57a3-kserve-759777dc95-vk8kz"]
Jul 20 13:26:18.405390 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:18.405366    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-7f57a3/auth-test-model-7f57a3-kserve-759777dc95-vk8kz"]
Jul 20 13:26:18.723686 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:18.723593    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-b8383c/auth-test-model-b8383c-kserve-6b4d79b5f-m7rfj" podUID="31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab" containerName="main" containerID="cri-o://d912bc50db2090bc6dab5c05f40f987308b34c0d2e68cf6613c04f2307ba3c00" gracePeriod=45
Jul 20 13:26:18.973394 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:18.973369    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b8383c/auth-test-model-b8383c-kserve-6b4d79b5f-m7rfj"
Jul 20 13:26:19.089189 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:19.089154    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab-tls-certs\") pod \"31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab\" (UID: \"31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab\") "
Jul 20 13:26:19.089189 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:19.089194    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-flg6f\" (UniqueName: \"kubernetes.io/projected/31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab-kube-api-access-flg6f\") pod \"31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab\" (UID: \"31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab\") "
Jul 20 13:26:19.089436 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:19.089234    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab-model-cache\") pod \"31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab\" (UID: \"31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab\") "
Jul 20 13:26:19.089436 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:19.089265    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab-dshm\") pod \"31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab\" (UID: \"31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab\") "
Jul 20 13:26:19.089436 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:19.089281    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab-tmp-dir\") pod \"31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab\" (UID: \"31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab\") "
Jul 20 13:26:19.089436 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:19.089321    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab-home\") pod \"31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab\" (UID: \"31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab\") "
Jul 20 13:26:19.089661 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:19.089594    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab" (UID: "31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:26:19.089661 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:19.089609    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab-model-cache" (OuterVolumeSpecName: "model-cache") pod "31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab" (UID: "31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:26:19.089661 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:19.089637    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab-home" (OuterVolumeSpecName: "home") pod "31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab" (UID: "31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:26:19.091501 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:19.091467    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab-dshm" (OuterVolumeSpecName: "dshm") pod "31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab" (UID: "31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:26:19.091627 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:19.091538    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab" (UID: "31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:26:19.091627 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:19.091558    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab-kube-api-access-flg6f" (OuterVolumeSpecName: "kube-api-access-flg6f") pod "31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab" (UID: "31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab"). InnerVolumeSpecName "kube-api-access-flg6f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:26:19.190931 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:19.190895    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab-model-cache\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:26:19.190931 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:19.190925    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab-dshm\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:26:19.190931 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:19.190934    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab-tmp-dir\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:26:19.190931 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:19.190942    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab-home\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:26:19.191273 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:19.190951    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab-tls-certs\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:26:19.191273 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:19.190959    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-flg6f\" (UniqueName: \"kubernetes.io/projected/31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab-kube-api-access-flg6f\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:26:19.384499 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:19.384416    2570 generic.go:356] "Generic (PLEG): container finished" podID="31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab" containerID="d912bc50db2090bc6dab5c05f40f987308b34c0d2e68cf6613c04f2307ba3c00" exitCode=0
Jul 20 13:26:19.384499 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:19.384465    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b8383c/auth-test-model-b8383c-kserve-6b4d79b5f-m7rfj"
Jul 20 13:26:19.384685 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:19.384469    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b8383c/auth-test-model-b8383c-kserve-6b4d79b5f-m7rfj" event={"ID":"31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab","Type":"ContainerDied","Data":"d912bc50db2090bc6dab5c05f40f987308b34c0d2e68cf6613c04f2307ba3c00"}
Jul 20 13:26:19.384685 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:19.384590    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b8383c/auth-test-model-b8383c-kserve-6b4d79b5f-m7rfj" event={"ID":"31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab","Type":"ContainerDied","Data":"4d6e9f376e399326c971829c9b721cf0b40b81038328d43bc5dd574d95b1caf9"}
Jul 20 13:26:19.384685 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:19.384617    2570 scope.go:117] "RemoveContainer" containerID="d912bc50db2090bc6dab5c05f40f987308b34c0d2e68cf6613c04f2307ba3c00"
Jul 20 13:26:19.394591 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:19.394564    2570 scope.go:117] "RemoveContainer" containerID="d912bc50db2090bc6dab5c05f40f987308b34c0d2e68cf6613c04f2307ba3c00"
Jul 20 13:26:19.394879 ip-10-0-139-1 kubenswrapper[2570]: E0720 13:26:19.394860    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d912bc50db2090bc6dab5c05f40f987308b34c0d2e68cf6613c04f2307ba3c00\": container with ID starting with d912bc50db2090bc6dab5c05f40f987308b34c0d2e68cf6613c04f2307ba3c00 not found: ID does not exist" containerID="d912bc50db2090bc6dab5c05f40f987308b34c0d2e68cf6613c04f2307ba3c00"
Jul 20 13:26:19.394946 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:19.394892    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d912bc50db2090bc6dab5c05f40f987308b34c0d2e68cf6613c04f2307ba3c00"} err="failed to get container status \"d912bc50db2090bc6dab5c05f40f987308b34c0d2e68cf6613c04f2307ba3c00\": rpc error: code = NotFound desc = could not find container \"d912bc50db2090bc6dab5c05f40f987308b34c0d2e68cf6613c04f2307ba3c00\": container with ID starting with d912bc50db2090bc6dab5c05f40f987308b34c0d2e68cf6613c04f2307ba3c00 not found: ID does not exist"
Jul 20 13:26:19.424719 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:19.424690    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b8383c/auth-test-model-b8383c-kserve-6b4d79b5f-m7rfj"]
Jul 20 13:26:19.433487 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:19.433455    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-b8383c/auth-test-model-b8383c-kserve-6b4d79b5f-m7rfj"]
Jul 20 13:26:19.808413 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:19.808332    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="194ba4a6-2bc5-415e-8efe-8d8cc1096e1d" path="/var/lib/kubelet/pods/194ba4a6-2bc5-415e-8efe-8d8cc1096e1d/volumes"
Jul 20 13:26:19.808738 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:19.808724    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab" path="/var/lib/kubelet/pods/31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab/volumes"
Jul 20 13:26:20.484754 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:20.484719    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-7f57a3/sub-test-model-7f57a3-kserve-75c5c97d6f-w6xnk"]
Jul 20 13:26:20.485154 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:20.485121    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab" containerName="main"
Jul 20 13:26:20.485154 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:20.485135    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab" containerName="main"
Jul 20 13:26:20.485154 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:20.485145    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="194ba4a6-2bc5-415e-8efe-8d8cc1096e1d" containerName="main"
Jul 20 13:26:20.485154 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:20.485151    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="194ba4a6-2bc5-415e-8efe-8d8cc1096e1d" containerName="main"
Jul 20 13:26:20.485298 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:20.485217    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="194ba4a6-2bc5-415e-8efe-8d8cc1096e1d" containerName="main"
Jul 20 13:26:20.485298 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:20.485229    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="31e2cda7-bf8c-4bbe-bbc5-71bfde3200ab" containerName="main"
Jul 20 13:26:20.489334 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:20.489311    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7f57a3/sub-test-model-7f57a3-kserve-75c5c97d6f-w6xnk"
Jul 20 13:26:20.492792 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:20.492762    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-7f57a3\"/\"kube-root-ca.crt\""
Jul 20 13:26:20.492949 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:20.492929    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-7f57a3\"/\"openshift-service-ca.crt\""
Jul 20 13:26:20.495149 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:20.494950    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-7f57a3\"/\"default-dockercfg-zhc6j\""
Jul 20 13:26:20.495291 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:20.495221    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-7f57a3\"/\"sub-test-model-7f57a3-kserve-self-signed-certs\""
Jul 20 13:26:20.501876 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:20.501826    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-7f57a3/sub-test-model-7f57a3-kserve-75c5c97d6f-w6xnk"]
Jul 20 13:26:20.602864 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:20.602829    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92500c82-4cbb-43d5-a891-7c865b3ad1cf-model-cache\") pod \"sub-test-model-7f57a3-kserve-75c5c97d6f-w6xnk\" (UID: \"92500c82-4cbb-43d5-a891-7c865b3ad1cf\") " pod="ai-tenant-e2e-shared-a-7f57a3/sub-test-model-7f57a3-kserve-75c5c97d6f-w6xnk"
Jul 20 13:26:20.602864 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:20.602872    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bwgd\" (UniqueName: \"kubernetes.io/projected/92500c82-4cbb-43d5-a891-7c865b3ad1cf-kube-api-access-6bwgd\") pod \"sub-test-model-7f57a3-kserve-75c5c97d6f-w6xnk\" (UID: \"92500c82-4cbb-43d5-a891-7c865b3ad1cf\") " pod="ai-tenant-e2e-shared-a-7f57a3/sub-test-model-7f57a3-kserve-75c5c97d6f-w6xnk"
Jul 20 13:26:20.603117 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:20.602931    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92500c82-4cbb-43d5-a891-7c865b3ad1cf-tls-certs\") pod \"sub-test-model-7f57a3-kserve-75c5c97d6f-w6xnk\" (UID: \"92500c82-4cbb-43d5-a891-7c865b3ad1cf\") " pod="ai-tenant-e2e-shared-a-7f57a3/sub-test-model-7f57a3-kserve-75c5c97d6f-w6xnk"
Jul 20 13:26:20.603117 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:20.603010    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92500c82-4cbb-43d5-a891-7c865b3ad1cf-tmp-dir\") pod \"sub-test-model-7f57a3-kserve-75c5c97d6f-w6xnk\" (UID: \"92500c82-4cbb-43d5-a891-7c865b3ad1cf\") " pod="ai-tenant-e2e-shared-a-7f57a3/sub-test-model-7f57a3-kserve-75c5c97d6f-w6xnk"
Jul 20 13:26:20.603117 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:20.603045    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92500c82-4cbb-43d5-a891-7c865b3ad1cf-home\") pod \"sub-test-model-7f57a3-kserve-75c5c97d6f-w6xnk\" (UID: \"92500c82-4cbb-43d5-a891-7c865b3ad1cf\") " pod="ai-tenant-e2e-shared-a-7f57a3/sub-test-model-7f57a3-kserve-75c5c97d6f-w6xnk"
Jul 20 13:26:20.603117 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:20.603065    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92500c82-4cbb-43d5-a891-7c865b3ad1cf-dshm\") pod \"sub-test-model-7f57a3-kserve-75c5c97d6f-w6xnk\" (UID: \"92500c82-4cbb-43d5-a891-7c865b3ad1cf\") " pod="ai-tenant-e2e-shared-a-7f57a3/sub-test-model-7f57a3-kserve-75c5c97d6f-w6xnk"
Jul 20 13:26:20.703765 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:20.703724    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92500c82-4cbb-43d5-a891-7c865b3ad1cf-tls-certs\") pod \"sub-test-model-7f57a3-kserve-75c5c97d6f-w6xnk\" (UID: \"92500c82-4cbb-43d5-a891-7c865b3ad1cf\") " pod="ai-tenant-e2e-shared-a-7f57a3/sub-test-model-7f57a3-kserve-75c5c97d6f-w6xnk"
Jul 20 13:26:20.703974 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:20.703792    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92500c82-4cbb-43d5-a891-7c865b3ad1cf-tmp-dir\") pod \"sub-test-model-7f57a3-kserve-75c5c97d6f-w6xnk\" (UID: \"92500c82-4cbb-43d5-a891-7c865b3ad1cf\") " pod="ai-tenant-e2e-shared-a-7f57a3/sub-test-model-7f57a3-kserve-75c5c97d6f-w6xnk"
Jul 20 13:26:20.703974 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:20.703814    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92500c82-4cbb-43d5-a891-7c865b3ad1cf-home\") pod \"sub-test-model-7f57a3-kserve-75c5c97d6f-w6xnk\" (UID: \"92500c82-4cbb-43d5-a891-7c865b3ad1cf\") " pod="ai-tenant-e2e-shared-a-7f57a3/sub-test-model-7f57a3-kserve-75c5c97d6f-w6xnk"
Jul 20 13:26:20.703974 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:20.703830    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92500c82-4cbb-43d5-a891-7c865b3ad1cf-dshm\") pod \"sub-test-model-7f57a3-kserve-75c5c97d6f-w6xnk\" (UID: \"92500c82-4cbb-43d5-a891-7c865b3ad1cf\") " pod="ai-tenant-e2e-shared-a-7f57a3/sub-test-model-7f57a3-kserve-75c5c97d6f-w6xnk"
Jul 20 13:26:20.703974 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:20.703933    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92500c82-4cbb-43d5-a891-7c865b3ad1cf-model-cache\") pod \"sub-test-model-7f57a3-kserve-75c5c97d6f-w6xnk\" (UID: \"92500c82-4cbb-43d5-a891-7c865b3ad1cf\") " pod="ai-tenant-e2e-shared-a-7f57a3/sub-test-model-7f57a3-kserve-75c5c97d6f-w6xnk"
Jul 20 13:26:20.703974 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:20.703969    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bwgd\" (UniqueName: \"kubernetes.io/projected/92500c82-4cbb-43d5-a891-7c865b3ad1cf-kube-api-access-6bwgd\") pod \"sub-test-model-7f57a3-kserve-75c5c97d6f-w6xnk\" (UID: \"92500c82-4cbb-43d5-a891-7c865b3ad1cf\") " pod="ai-tenant-e2e-shared-a-7f57a3/sub-test-model-7f57a3-kserve-75c5c97d6f-w6xnk"
Jul 20 13:26:20.704333 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:20.704302    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92500c82-4cbb-43d5-a891-7c865b3ad1cf-home\") pod \"sub-test-model-7f57a3-kserve-75c5c97d6f-w6xnk\" (UID: \"92500c82-4cbb-43d5-a891-7c865b3ad1cf\") " pod="ai-tenant-e2e-shared-a-7f57a3/sub-test-model-7f57a3-kserve-75c5c97d6f-w6xnk"
Jul 20 13:26:20.704455 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:20.704383    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92500c82-4cbb-43d5-a891-7c865b3ad1cf-model-cache\") pod \"sub-test-model-7f57a3-kserve-75c5c97d6f-w6xnk\" (UID: \"92500c82-4cbb-43d5-a891-7c865b3ad1cf\") " pod="ai-tenant-e2e-shared-a-7f57a3/sub-test-model-7f57a3-kserve-75c5c97d6f-w6xnk"
Jul 20 13:26:20.704455 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:20.704385    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92500c82-4cbb-43d5-a891-7c865b3ad1cf-tmp-dir\") pod \"sub-test-model-7f57a3-kserve-75c5c97d6f-w6xnk\" (UID: \"92500c82-4cbb-43d5-a891-7c865b3ad1cf\") " pod="ai-tenant-e2e-shared-a-7f57a3/sub-test-model-7f57a3-kserve-75c5c97d6f-w6xnk"
Jul 20 13:26:20.706161 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:20.706142    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92500c82-4cbb-43d5-a891-7c865b3ad1cf-dshm\") pod \"sub-test-model-7f57a3-kserve-75c5c97d6f-w6xnk\" (UID: \"92500c82-4cbb-43d5-a891-7c865b3ad1cf\") " pod="ai-tenant-e2e-shared-a-7f57a3/sub-test-model-7f57a3-kserve-75c5c97d6f-w6xnk"
Jul 20 13:26:20.706347 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:20.706331    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92500c82-4cbb-43d5-a891-7c865b3ad1cf-tls-certs\") pod \"sub-test-model-7f57a3-kserve-75c5c97d6f-w6xnk\" (UID: \"92500c82-4cbb-43d5-a891-7c865b3ad1cf\") " pod="ai-tenant-e2e-shared-a-7f57a3/sub-test-model-7f57a3-kserve-75c5c97d6f-w6xnk"
Jul 20 13:26:20.713932 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:20.713910    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bwgd\" (UniqueName: \"kubernetes.io/projected/92500c82-4cbb-43d5-a891-7c865b3ad1cf-kube-api-access-6bwgd\") pod \"sub-test-model-7f57a3-kserve-75c5c97d6f-w6xnk\" (UID: \"92500c82-4cbb-43d5-a891-7c865b3ad1cf\") " pod="ai-tenant-e2e-shared-a-7f57a3/sub-test-model-7f57a3-kserve-75c5c97d6f-w6xnk"
Jul 20 13:26:20.800613 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:20.800508    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7f57a3/sub-test-model-7f57a3-kserve-75c5c97d6f-w6xnk"
Jul 20 13:26:20.939973 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:20.939945    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-7f57a3/sub-test-model-7f57a3-kserve-75c5c97d6f-w6xnk"]
Jul 20 13:26:20.941827 ip-10-0-139-1 kubenswrapper[2570]: W0720 13:26:20.941799    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod92500c82_4cbb_43d5_a891_7c865b3ad1cf.slice/crio-27a7b6489e4218c5495eb2559eaaa9f4d2a1df74e0bff045af24a20f1c01e498 WatchSource:0}: Error finding container 27a7b6489e4218c5495eb2559eaaa9f4d2a1df74e0bff045af24a20f1c01e498: Status 404 returned error can't find the container with id 27a7b6489e4218c5495eb2559eaaa9f4d2a1df74e0bff045af24a20f1c01e498
Jul 20 13:26:21.398558 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:21.398524    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7f57a3/sub-test-model-7f57a3-kserve-75c5c97d6f-w6xnk" event={"ID":"92500c82-4cbb-43d5-a891-7c865b3ad1cf","Type":"ContainerStarted","Data":"aa919ca96c2710704953fb0bb76148d14047847b211396d23c53ac53197e1d45"}
Jul 20 13:26:21.398558 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:21.398572    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7f57a3/sub-test-model-7f57a3-kserve-75c5c97d6f-w6xnk" event={"ID":"92500c82-4cbb-43d5-a891-7c865b3ad1cf","Type":"ContainerStarted","Data":"27a7b6489e4218c5495eb2559eaaa9f4d2a1df74e0bff045af24a20f1c01e498"}
Jul 20 13:26:21.425491 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:21.425429    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-7f57a3/sub-test-model-7f57a3-kserve-75c5c97d6f-w6xnk" podStartSLOduration=1.425410677 podStartE2EDuration="1.425410677s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:26:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:26:21.425328815 +0000 UTC m=+2494.180378189" watchObservedRunningTime="2026-07-20 13:26:21.425410677 +0000 UTC m=+2494.180460053"
Jul 20 13:26:30.801681 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:30.801623    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-7f57a3/sub-test-model-7f57a3-kserve-75c5c97d6f-w6xnk"
Jul 20 13:26:30.801681 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:30.801690    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-7f57a3/sub-test-model-7f57a3-kserve-75c5c97d6f-w6xnk"
Jul 20 13:26:30.814499 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:30.814469    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-7f57a3/sub-test-model-7f57a3-kserve-75c5c97d6f-w6xnk"
Jul 20 13:26:31.463270 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:26:31.463234    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-7f57a3/sub-test-model-7f57a3-kserve-75c5c97d6f-w6xnk"
Jul 20 13:27:26.195761 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:26.195718    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-7f57a3/sub-test-model-7f57a3-kserve-75c5c97d6f-w6xnk"]
Jul 20 13:27:40.997700 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:40.997667    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-7f57a3/rate-test-model-7f57a3-kserve-868bc74459-x47vb"]
Jul 20 13:27:41.001305 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:41.001283    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7f57a3/rate-test-model-7f57a3-kserve-868bc74459-x47vb"
Jul 20 13:27:41.004857 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:41.004834    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-7f57a3\"/\"rate-test-model-7f57a3-kserve-self-signed-certs\""
Jul 20 13:27:41.015203 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:41.015168    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-7f57a3/rate-test-model-7f57a3-kserve-868bc74459-x47vb"]
Jul 20 13:27:41.069756 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:41.069720    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7295cf14-325c-4c8b-ad5e-6f50921a9848-dshm\") pod \"rate-test-model-7f57a3-kserve-868bc74459-x47vb\" (UID: \"7295cf14-325c-4c8b-ad5e-6f50921a9848\") " pod="ai-tenant-e2e-shared-a-7f57a3/rate-test-model-7f57a3-kserve-868bc74459-x47vb"
Jul 20 13:27:41.069931 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:41.069771    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7295cf14-325c-4c8b-ad5e-6f50921a9848-model-cache\") pod \"rate-test-model-7f57a3-kserve-868bc74459-x47vb\" (UID: \"7295cf14-325c-4c8b-ad5e-6f50921a9848\") " pod="ai-tenant-e2e-shared-a-7f57a3/rate-test-model-7f57a3-kserve-868bc74459-x47vb"
Jul 20 13:27:41.069931 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:41.069793    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7295cf14-325c-4c8b-ad5e-6f50921a9848-tmp-dir\") pod \"rate-test-model-7f57a3-kserve-868bc74459-x47vb\" (UID: \"7295cf14-325c-4c8b-ad5e-6f50921a9848\") " pod="ai-tenant-e2e-shared-a-7f57a3/rate-test-model-7f57a3-kserve-868bc74459-x47vb"
Jul 20 13:27:41.069931 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:41.069827    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82r6q\" (UniqueName: \"kubernetes.io/projected/7295cf14-325c-4c8b-ad5e-6f50921a9848-kube-api-access-82r6q\") pod \"rate-test-model-7f57a3-kserve-868bc74459-x47vb\" (UID: \"7295cf14-325c-4c8b-ad5e-6f50921a9848\") " pod="ai-tenant-e2e-shared-a-7f57a3/rate-test-model-7f57a3-kserve-868bc74459-x47vb"
Jul 20 13:27:41.069931 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:41.069859    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7295cf14-325c-4c8b-ad5e-6f50921a9848-home\") pod \"rate-test-model-7f57a3-kserve-868bc74459-x47vb\" (UID: \"7295cf14-325c-4c8b-ad5e-6f50921a9848\") " pod="ai-tenant-e2e-shared-a-7f57a3/rate-test-model-7f57a3-kserve-868bc74459-x47vb"
Jul 20 13:27:41.069931 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:41.069886    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7295cf14-325c-4c8b-ad5e-6f50921a9848-tls-certs\") pod \"rate-test-model-7f57a3-kserve-868bc74459-x47vb\" (UID: \"7295cf14-325c-4c8b-ad5e-6f50921a9848\") " pod="ai-tenant-e2e-shared-a-7f57a3/rate-test-model-7f57a3-kserve-868bc74459-x47vb"
Jul 20 13:27:41.171256 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:41.171215    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7295cf14-325c-4c8b-ad5e-6f50921a9848-dshm\") pod \"rate-test-model-7f57a3-kserve-868bc74459-x47vb\" (UID: \"7295cf14-325c-4c8b-ad5e-6f50921a9848\") " pod="ai-tenant-e2e-shared-a-7f57a3/rate-test-model-7f57a3-kserve-868bc74459-x47vb"
Jul 20 13:27:41.171428 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:41.171305    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7295cf14-325c-4c8b-ad5e-6f50921a9848-model-cache\") pod \"rate-test-model-7f57a3-kserve-868bc74459-x47vb\" (UID: \"7295cf14-325c-4c8b-ad5e-6f50921a9848\") " pod="ai-tenant-e2e-shared-a-7f57a3/rate-test-model-7f57a3-kserve-868bc74459-x47vb"
Jul 20 13:27:41.171428 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:41.171336    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7295cf14-325c-4c8b-ad5e-6f50921a9848-tmp-dir\") pod \"rate-test-model-7f57a3-kserve-868bc74459-x47vb\" (UID: \"7295cf14-325c-4c8b-ad5e-6f50921a9848\") " pod="ai-tenant-e2e-shared-a-7f57a3/rate-test-model-7f57a3-kserve-868bc74459-x47vb"
Jul 20 13:27:41.171428 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:41.171363    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82r6q\" (UniqueName: \"kubernetes.io/projected/7295cf14-325c-4c8b-ad5e-6f50921a9848-kube-api-access-82r6q\") pod \"rate-test-model-7f57a3-kserve-868bc74459-x47vb\" (UID: \"7295cf14-325c-4c8b-ad5e-6f50921a9848\") " pod="ai-tenant-e2e-shared-a-7f57a3/rate-test-model-7f57a3-kserve-868bc74459-x47vb"
Jul 20 13:27:41.171428 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:41.171397    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7295cf14-325c-4c8b-ad5e-6f50921a9848-home\") pod \"rate-test-model-7f57a3-kserve-868bc74459-x47vb\" (UID: \"7295cf14-325c-4c8b-ad5e-6f50921a9848\") " pod="ai-tenant-e2e-shared-a-7f57a3/rate-test-model-7f57a3-kserve-868bc74459-x47vb"
Jul 20 13:27:41.171624 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:41.171429    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7295cf14-325c-4c8b-ad5e-6f50921a9848-tls-certs\") pod \"rate-test-model-7f57a3-kserve-868bc74459-x47vb\" (UID: \"7295cf14-325c-4c8b-ad5e-6f50921a9848\") " pod="ai-tenant-e2e-shared-a-7f57a3/rate-test-model-7f57a3-kserve-868bc74459-x47vb"
Jul 20 13:27:41.171759 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:41.171734    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7295cf14-325c-4c8b-ad5e-6f50921a9848-tmp-dir\") pod \"rate-test-model-7f57a3-kserve-868bc74459-x47vb\" (UID: \"7295cf14-325c-4c8b-ad5e-6f50921a9848\") " pod="ai-tenant-e2e-shared-a-7f57a3/rate-test-model-7f57a3-kserve-868bc74459-x47vb"
Jul 20 13:27:41.171839 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:41.171742    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7295cf14-325c-4c8b-ad5e-6f50921a9848-model-cache\") pod \"rate-test-model-7f57a3-kserve-868bc74459-x47vb\" (UID: \"7295cf14-325c-4c8b-ad5e-6f50921a9848\") " pod="ai-tenant-e2e-shared-a-7f57a3/rate-test-model-7f57a3-kserve-868bc74459-x47vb"
Jul 20 13:27:41.171839 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:41.171788    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7295cf14-325c-4c8b-ad5e-6f50921a9848-home\") pod \"rate-test-model-7f57a3-kserve-868bc74459-x47vb\" (UID: \"7295cf14-325c-4c8b-ad5e-6f50921a9848\") " pod="ai-tenant-e2e-shared-a-7f57a3/rate-test-model-7f57a3-kserve-868bc74459-x47vb"
Jul 20 13:27:41.173451 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:41.173434    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7295cf14-325c-4c8b-ad5e-6f50921a9848-dshm\") pod \"rate-test-model-7f57a3-kserve-868bc74459-x47vb\" (UID: \"7295cf14-325c-4c8b-ad5e-6f50921a9848\") " pod="ai-tenant-e2e-shared-a-7f57a3/rate-test-model-7f57a3-kserve-868bc74459-x47vb"
Jul 20 13:27:41.173775 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:41.173757    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7295cf14-325c-4c8b-ad5e-6f50921a9848-tls-certs\") pod \"rate-test-model-7f57a3-kserve-868bc74459-x47vb\" (UID: \"7295cf14-325c-4c8b-ad5e-6f50921a9848\") " pod="ai-tenant-e2e-shared-a-7f57a3/rate-test-model-7f57a3-kserve-868bc74459-x47vb"
Jul 20 13:27:41.181279 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:41.181257    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82r6q\" (UniqueName: \"kubernetes.io/projected/7295cf14-325c-4c8b-ad5e-6f50921a9848-kube-api-access-82r6q\") pod \"rate-test-model-7f57a3-kserve-868bc74459-x47vb\" (UID: \"7295cf14-325c-4c8b-ad5e-6f50921a9848\") " pod="ai-tenant-e2e-shared-a-7f57a3/rate-test-model-7f57a3-kserve-868bc74459-x47vb"
Jul 20 13:27:41.216182 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:41.216117    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-7f57a3/sub-test-model-7f57a3-kserve-75c5c97d6f-w6xnk" podUID="92500c82-4cbb-43d5-a891-7c865b3ad1cf" containerName="main" containerID="cri-o://aa919ca96c2710704953fb0bb76148d14047847b211396d23c53ac53197e1d45" gracePeriod=45
Jul 20 13:27:41.310420 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:41.310333    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7f57a3/rate-test-model-7f57a3-kserve-868bc74459-x47vb"
Jul 20 13:27:41.467270 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:41.467243    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-7f57a3/rate-test-model-7f57a3-kserve-868bc74459-x47vb"]
Jul 20 13:27:41.468026 ip-10-0-139-1 kubenswrapper[2570]: W0720 13:27:41.467998    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7295cf14_325c_4c8b_ad5e_6f50921a9848.slice/crio-0502cacd45b7dc9ab06e043f550162243a31bbccb514eccbc190c4e9b664ddf4 WatchSource:0}: Error finding container 0502cacd45b7dc9ab06e043f550162243a31bbccb514eccbc190c4e9b664ddf4: Status 404 returned error can't find the container with id 0502cacd45b7dc9ab06e043f550162243a31bbccb514eccbc190c4e9b664ddf4
Jul 20 13:27:41.469750 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:41.469730    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7f57a3/sub-test-model-7f57a3-kserve-75c5c97d6f-w6xnk"
Jul 20 13:27:41.575683 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:41.575652    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6bwgd\" (UniqueName: \"kubernetes.io/projected/92500c82-4cbb-43d5-a891-7c865b3ad1cf-kube-api-access-6bwgd\") pod \"92500c82-4cbb-43d5-a891-7c865b3ad1cf\" (UID: \"92500c82-4cbb-43d5-a891-7c865b3ad1cf\") "
Jul 20 13:27:41.575854 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:41.575698    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92500c82-4cbb-43d5-a891-7c865b3ad1cf-tmp-dir\") pod \"92500c82-4cbb-43d5-a891-7c865b3ad1cf\" (UID: \"92500c82-4cbb-43d5-a891-7c865b3ad1cf\") "
Jul 20 13:27:41.575854 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:41.575736    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92500c82-4cbb-43d5-a891-7c865b3ad1cf-tls-certs\") pod \"92500c82-4cbb-43d5-a891-7c865b3ad1cf\" (UID: \"92500c82-4cbb-43d5-a891-7c865b3ad1cf\") "
Jul 20 13:27:41.575854 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:41.575784    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92500c82-4cbb-43d5-a891-7c865b3ad1cf-dshm\") pod \"92500c82-4cbb-43d5-a891-7c865b3ad1cf\" (UID: \"92500c82-4cbb-43d5-a891-7c865b3ad1cf\") "
Jul 20 13:27:41.575854 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:41.575835    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92500c82-4cbb-43d5-a891-7c865b3ad1cf-home\") pod \"92500c82-4cbb-43d5-a891-7c865b3ad1cf\" (UID: \"92500c82-4cbb-43d5-a891-7c865b3ad1cf\") "
Jul 20 13:27:41.576097 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:41.575876    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92500c82-4cbb-43d5-a891-7c865b3ad1cf-model-cache\") pod \"92500c82-4cbb-43d5-a891-7c865b3ad1cf\" (UID: \"92500c82-4cbb-43d5-a891-7c865b3ad1cf\") "
Jul 20 13:27:41.576097 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:41.575981    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92500c82-4cbb-43d5-a891-7c865b3ad1cf-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "92500c82-4cbb-43d5-a891-7c865b3ad1cf" (UID: "92500c82-4cbb-43d5-a891-7c865b3ad1cf"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:27:41.576219 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:41.576177    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92500c82-4cbb-43d5-a891-7c865b3ad1cf-home" (OuterVolumeSpecName: "home") pod "92500c82-4cbb-43d5-a891-7c865b3ad1cf" (UID: "92500c82-4cbb-43d5-a891-7c865b3ad1cf"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:27:41.576219 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:41.576209    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92500c82-4cbb-43d5-a891-7c865b3ad1cf-tmp-dir\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:27:41.576219 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:41.576187    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92500c82-4cbb-43d5-a891-7c865b3ad1cf-model-cache" (OuterVolumeSpecName: "model-cache") pod "92500c82-4cbb-43d5-a891-7c865b3ad1cf" (UID: "92500c82-4cbb-43d5-a891-7c865b3ad1cf"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:27:41.577921 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:41.577896    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92500c82-4cbb-43d5-a891-7c865b3ad1cf-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "92500c82-4cbb-43d5-a891-7c865b3ad1cf" (UID: "92500c82-4cbb-43d5-a891-7c865b3ad1cf"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:27:41.577921 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:41.577913    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92500c82-4cbb-43d5-a891-7c865b3ad1cf-kube-api-access-6bwgd" (OuterVolumeSpecName: "kube-api-access-6bwgd") pod "92500c82-4cbb-43d5-a891-7c865b3ad1cf" (UID: "92500c82-4cbb-43d5-a891-7c865b3ad1cf"). InnerVolumeSpecName "kube-api-access-6bwgd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:27:41.578059 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:41.577938    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92500c82-4cbb-43d5-a891-7c865b3ad1cf-dshm" (OuterVolumeSpecName: "dshm") pod "92500c82-4cbb-43d5-a891-7c865b3ad1cf" (UID: "92500c82-4cbb-43d5-a891-7c865b3ad1cf"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:27:41.677080 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:41.677047    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92500c82-4cbb-43d5-a891-7c865b3ad1cf-home\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:27:41.677080 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:41.677074    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92500c82-4cbb-43d5-a891-7c865b3ad1cf-model-cache\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:27:41.677080 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:41.677099    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6bwgd\" (UniqueName: \"kubernetes.io/projected/92500c82-4cbb-43d5-a891-7c865b3ad1cf-kube-api-access-6bwgd\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:27:41.677080 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:41.677109    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92500c82-4cbb-43d5-a891-7c865b3ad1cf-tls-certs\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:27:41.677080 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:41.677117    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92500c82-4cbb-43d5-a891-7c865b3ad1cf-dshm\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:27:41.843880 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:41.843776    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7f57a3/rate-test-model-7f57a3-kserve-868bc74459-x47vb" event={"ID":"7295cf14-325c-4c8b-ad5e-6f50921a9848","Type":"ContainerStarted","Data":"e9594ec4ba2f62e15b00691d4ac57efe8dacd7d99fc7acc4cc9bcb826ec581bc"}
Jul 20 13:27:41.843880 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:41.843833    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7f57a3/rate-test-model-7f57a3-kserve-868bc74459-x47vb" event={"ID":"7295cf14-325c-4c8b-ad5e-6f50921a9848","Type":"ContainerStarted","Data":"0502cacd45b7dc9ab06e043f550162243a31bbccb514eccbc190c4e9b664ddf4"}
Jul 20 13:27:41.845015 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:41.844989    2570 generic.go:356] "Generic (PLEG): container finished" podID="92500c82-4cbb-43d5-a891-7c865b3ad1cf" containerID="aa919ca96c2710704953fb0bb76148d14047847b211396d23c53ac53197e1d45" exitCode=0
Jul 20 13:27:41.845145 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:41.845024    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7f57a3/sub-test-model-7f57a3-kserve-75c5c97d6f-w6xnk"
Jul 20 13:27:41.845145 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:41.845026    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7f57a3/sub-test-model-7f57a3-kserve-75c5c97d6f-w6xnk" event={"ID":"92500c82-4cbb-43d5-a891-7c865b3ad1cf","Type":"ContainerDied","Data":"aa919ca96c2710704953fb0bb76148d14047847b211396d23c53ac53197e1d45"}
Jul 20 13:27:41.845241 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:41.845143    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7f57a3/sub-test-model-7f57a3-kserve-75c5c97d6f-w6xnk" event={"ID":"92500c82-4cbb-43d5-a891-7c865b3ad1cf","Type":"ContainerDied","Data":"27a7b6489e4218c5495eb2559eaaa9f4d2a1df74e0bff045af24a20f1c01e498"}
Jul 20 13:27:41.845241 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:41.845167    2570 scope.go:117] "RemoveContainer" containerID="aa919ca96c2710704953fb0bb76148d14047847b211396d23c53ac53197e1d45"
Jul 20 13:27:41.854256 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:41.854239    2570 scope.go:117] "RemoveContainer" containerID="aa919ca96c2710704953fb0bb76148d14047847b211396d23c53ac53197e1d45"
Jul 20 13:27:41.854551 ip-10-0-139-1 kubenswrapper[2570]: E0720 13:27:41.854532    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa919ca96c2710704953fb0bb76148d14047847b211396d23c53ac53197e1d45\": container with ID starting with aa919ca96c2710704953fb0bb76148d14047847b211396d23c53ac53197e1d45 not found: ID does not exist" containerID="aa919ca96c2710704953fb0bb76148d14047847b211396d23c53ac53197e1d45"
Jul 20 13:27:41.854612 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:41.854561    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa919ca96c2710704953fb0bb76148d14047847b211396d23c53ac53197e1d45"} err="failed to get container status \"aa919ca96c2710704953fb0bb76148d14047847b211396d23c53ac53197e1d45\": rpc error: code = NotFound desc = could not find container \"aa919ca96c2710704953fb0bb76148d14047847b211396d23c53ac53197e1d45\": container with ID starting with aa919ca96c2710704953fb0bb76148d14047847b211396d23c53ac53197e1d45 not found: ID does not exist"
Jul 20 13:27:41.869202 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:41.869151    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-7f57a3/rate-test-model-7f57a3-kserve-868bc74459-x47vb" podStartSLOduration=1.869135156 podStartE2EDuration="1.869135156s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:27:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:27:41.86695534 +0000 UTC m=+2574.622004715" watchObservedRunningTime="2026-07-20 13:27:41.869135156 +0000 UTC m=+2574.624184589"
Jul 20 13:27:41.892586 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:41.892542    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-7f57a3/sub-test-model-7f57a3-kserve-75c5c97d6f-w6xnk"]
Jul 20 13:27:41.896007 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:41.895982    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-7f57a3/sub-test-model-7f57a3-kserve-75c5c97d6f-w6xnk"]
Jul 20 13:27:43.807809 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:43.807771    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92500c82-4cbb-43d5-a891-7c865b3ad1cf" path="/var/lib/kubelet/pods/92500c82-4cbb-43d5-a891-7c865b3ad1cf/volumes"
Jul 20 13:27:46.453517 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:46.453451    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-shared-a-7f57a3/sub-test-model-7f57a3-kserve-75c5c97d6f-w6xnk" podUID="92500c82-4cbb-43d5-a891-7c865b3ad1cf" containerName="main" probeResult="failure" output="Get \"https://10.134.0.66:8000/ready\": context deadline exceeded"
Jul 20 13:27:51.311111 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:51.311047    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-7f57a3/rate-test-model-7f57a3-kserve-868bc74459-x47vb"
Jul 20 13:27:51.311519 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:51.311131    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-7f57a3/rate-test-model-7f57a3-kserve-868bc74459-x47vb"
Jul 20 13:27:51.323609 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:51.323578    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-7f57a3/rate-test-model-7f57a3-kserve-868bc74459-x47vb"
Jul 20 13:27:51.913774 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:27:51.913739    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-7f57a3/rate-test-model-7f57a3-kserve-868bc74459-x47vb"
Jul 20 13:28:02.228239 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:28:02.228198    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-b8383c/rate-test-model-b8383c-kserve-f94d9f67f-slr22"]
Jul 20 13:28:02.228743 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:28:02.228637    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92500c82-4cbb-43d5-a891-7c865b3ad1cf" containerName="main"
Jul 20 13:28:02.228743 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:28:02.228649    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="92500c82-4cbb-43d5-a891-7c865b3ad1cf" containerName="main"
Jul 20 13:28:02.228743 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:28:02.228722    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="92500c82-4cbb-43d5-a891-7c865b3ad1cf" containerName="main"
Jul 20 13:28:02.231862 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:28:02.231844    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b8383c/rate-test-model-b8383c-kserve-f94d9f67f-slr22"
Jul 20 13:28:02.239748 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:28:02.239570    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b8383c\"/\"kube-root-ca.crt\""
Jul 20 13:28:02.241363 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:28:02.241327    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b8383c\"/\"openshift-service-ca.crt\""
Jul 20 13:28:02.241504 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:28:02.241371    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b8383c\"/\"default-dockercfg-c88sc\""
Jul 20 13:28:02.241504 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:28:02.241432    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b8383c\"/\"rate-test-model-b8383c-kserve-self-signed-certs\""
Jul 20 13:28:02.253611 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:28:02.253580    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b8383c/rate-test-model-b8383c-kserve-f94d9f67f-slr22"]
Jul 20 13:28:02.273665 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:28:02.273628    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b58e9da7-8132-4fe6-b75b-01cec744facb-tmp-dir\") pod \"rate-test-model-b8383c-kserve-f94d9f67f-slr22\" (UID: \"b58e9da7-8132-4fe6-b75b-01cec744facb\") " pod="ai-tenant-e2e-shared-b-b8383c/rate-test-model-b8383c-kserve-f94d9f67f-slr22"
Jul 20 13:28:02.273665 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:28:02.273662    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b58e9da7-8132-4fe6-b75b-01cec744facb-home\") pod \"rate-test-model-b8383c-kserve-f94d9f67f-slr22\" (UID: \"b58e9da7-8132-4fe6-b75b-01cec744facb\") " pod="ai-tenant-e2e-shared-b-b8383c/rate-test-model-b8383c-kserve-f94d9f67f-slr22"
Jul 20 13:28:02.273922 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:28:02.273685    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b58e9da7-8132-4fe6-b75b-01cec744facb-tls-certs\") pod \"rate-test-model-b8383c-kserve-f94d9f67f-slr22\" (UID: \"b58e9da7-8132-4fe6-b75b-01cec744facb\") " pod="ai-tenant-e2e-shared-b-b8383c/rate-test-model-b8383c-kserve-f94d9f67f-slr22"
Jul 20 13:28:02.273922 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:28:02.273790    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b58e9da7-8132-4fe6-b75b-01cec744facb-model-cache\") pod \"rate-test-model-b8383c-kserve-f94d9f67f-slr22\" (UID: \"b58e9da7-8132-4fe6-b75b-01cec744facb\") " pod="ai-tenant-e2e-shared-b-b8383c/rate-test-model-b8383c-kserve-f94d9f67f-slr22"
Jul 20 13:28:02.273922 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:28:02.273877    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6l7fg\" (UniqueName: \"kubernetes.io/projected/b58e9da7-8132-4fe6-b75b-01cec744facb-kube-api-access-6l7fg\") pod \"rate-test-model-b8383c-kserve-f94d9f67f-slr22\" (UID: \"b58e9da7-8132-4fe6-b75b-01cec744facb\") " pod="ai-tenant-e2e-shared-b-b8383c/rate-test-model-b8383c-kserve-f94d9f67f-slr22"
Jul 20 13:28:02.273922 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:28:02.273919    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b58e9da7-8132-4fe6-b75b-01cec744facb-dshm\") pod \"rate-test-model-b8383c-kserve-f94d9f67f-slr22\" (UID: \"b58e9da7-8132-4fe6-b75b-01cec744facb\") " pod="ai-tenant-e2e-shared-b-b8383c/rate-test-model-b8383c-kserve-f94d9f67f-slr22"
Jul 20 13:28:02.374679 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:28:02.374627    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b58e9da7-8132-4fe6-b75b-01cec744facb-tmp-dir\") pod \"rate-test-model-b8383c-kserve-f94d9f67f-slr22\" (UID: \"b58e9da7-8132-4fe6-b75b-01cec744facb\") " pod="ai-tenant-e2e-shared-b-b8383c/rate-test-model-b8383c-kserve-f94d9f67f-slr22"
Jul 20 13:28:02.374679 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:28:02.374680    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b58e9da7-8132-4fe6-b75b-01cec744facb-home\") pod \"rate-test-model-b8383c-kserve-f94d9f67f-slr22\" (UID: \"b58e9da7-8132-4fe6-b75b-01cec744facb\") " pod="ai-tenant-e2e-shared-b-b8383c/rate-test-model-b8383c-kserve-f94d9f67f-slr22"
Jul 20 13:28:02.374949 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:28:02.374708    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b58e9da7-8132-4fe6-b75b-01cec744facb-tls-certs\") pod \"rate-test-model-b8383c-kserve-f94d9f67f-slr22\" (UID: \"b58e9da7-8132-4fe6-b75b-01cec744facb\") " pod="ai-tenant-e2e-shared-b-b8383c/rate-test-model-b8383c-kserve-f94d9f67f-slr22"
Jul 20 13:28:02.374949 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:28:02.374753    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b58e9da7-8132-4fe6-b75b-01cec744facb-model-cache\") pod \"rate-test-model-b8383c-kserve-f94d9f67f-slr22\" (UID: \"b58e9da7-8132-4fe6-b75b-01cec744facb\") " pod="ai-tenant-e2e-shared-b-b8383c/rate-test-model-b8383c-kserve-f94d9f67f-slr22"
Jul 20 13:28:02.374949 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:28:02.374787    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6l7fg\" (UniqueName: \"kubernetes.io/projected/b58e9da7-8132-4fe6-b75b-01cec744facb-kube-api-access-6l7fg\") pod \"rate-test-model-b8383c-kserve-f94d9f67f-slr22\" (UID: \"b58e9da7-8132-4fe6-b75b-01cec744facb\") " pod="ai-tenant-e2e-shared-b-b8383c/rate-test-model-b8383c-kserve-f94d9f67f-slr22"
Jul 20 13:28:02.374949 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:28:02.374823    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b58e9da7-8132-4fe6-b75b-01cec744facb-dshm\") pod \"rate-test-model-b8383c-kserve-f94d9f67f-slr22\" (UID: \"b58e9da7-8132-4fe6-b75b-01cec744facb\") " pod="ai-tenant-e2e-shared-b-b8383c/rate-test-model-b8383c-kserve-f94d9f67f-slr22"
Jul 20 13:28:02.375235 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:28:02.375135    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b58e9da7-8132-4fe6-b75b-01cec744facb-tmp-dir\") pod \"rate-test-model-b8383c-kserve-f94d9f67f-slr22\" (UID: \"b58e9da7-8132-4fe6-b75b-01cec744facb\") " pod="ai-tenant-e2e-shared-b-b8383c/rate-test-model-b8383c-kserve-f94d9f67f-slr22"
Jul 20 13:28:02.375235 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:28:02.375170    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b58e9da7-8132-4fe6-b75b-01cec744facb-home\") pod \"rate-test-model-b8383c-kserve-f94d9f67f-slr22\" (UID: \"b58e9da7-8132-4fe6-b75b-01cec744facb\") " pod="ai-tenant-e2e-shared-b-b8383c/rate-test-model-b8383c-kserve-f94d9f67f-slr22"
Jul 20 13:28:02.375235 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:28:02.375228    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b58e9da7-8132-4fe6-b75b-01cec744facb-model-cache\") pod \"rate-test-model-b8383c-kserve-f94d9f67f-slr22\" (UID: \"b58e9da7-8132-4fe6-b75b-01cec744facb\") " pod="ai-tenant-e2e-shared-b-b8383c/rate-test-model-b8383c-kserve-f94d9f67f-slr22"
Jul 20 13:28:02.377249 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:28:02.377225    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b58e9da7-8132-4fe6-b75b-01cec744facb-dshm\") pod \"rate-test-model-b8383c-kserve-f94d9f67f-slr22\" (UID: \"b58e9da7-8132-4fe6-b75b-01cec744facb\") " pod="ai-tenant-e2e-shared-b-b8383c/rate-test-model-b8383c-kserve-f94d9f67f-slr22"
Jul 20 13:28:02.377352 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:28:02.377337    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b58e9da7-8132-4fe6-b75b-01cec744facb-tls-certs\") pod \"rate-test-model-b8383c-kserve-f94d9f67f-slr22\" (UID: \"b58e9da7-8132-4fe6-b75b-01cec744facb\") " pod="ai-tenant-e2e-shared-b-b8383c/rate-test-model-b8383c-kserve-f94d9f67f-slr22"
Jul 20 13:28:02.388158 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:28:02.388126    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l7fg\" (UniqueName: \"kubernetes.io/projected/b58e9da7-8132-4fe6-b75b-01cec744facb-kube-api-access-6l7fg\") pod \"rate-test-model-b8383c-kserve-f94d9f67f-slr22\" (UID: \"b58e9da7-8132-4fe6-b75b-01cec744facb\") " pod="ai-tenant-e2e-shared-b-b8383c/rate-test-model-b8383c-kserve-f94d9f67f-slr22"
Jul 20 13:28:02.542472 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:28:02.542381    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b8383c/rate-test-model-b8383c-kserve-f94d9f67f-slr22"
Jul 20 13:28:02.681070 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:28:02.680903    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b8383c/rate-test-model-b8383c-kserve-f94d9f67f-slr22"]
Jul 20 13:28:02.967429 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:28:02.967391    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b8383c/rate-test-model-b8383c-kserve-f94d9f67f-slr22" event={"ID":"b58e9da7-8132-4fe6-b75b-01cec744facb","Type":"ContainerStarted","Data":"96807706324c211bdd44d90c9cacb44dda0755f17f252ae3305ff3ef713f9c48"}
Jul 20 13:28:02.967429 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:28:02.967435    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b8383c/rate-test-model-b8383c-kserve-f94d9f67f-slr22" event={"ID":"b58e9da7-8132-4fe6-b75b-01cec744facb","Type":"ContainerStarted","Data":"8018b82337f830b0584f7ebd05c80d99a42b05ce2096f0ef12b449310d95c02e"}
Jul 20 13:28:02.993605 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:28:02.993552    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-b8383c/rate-test-model-b8383c-kserve-f94d9f67f-slr22" podStartSLOduration=0.993536023 podStartE2EDuration="993.536023ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:28:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:28:02.993481476 +0000 UTC m=+2595.748530850" watchObservedRunningTime="2026-07-20 13:28:02.993536023 +0000 UTC m=+2595.748585399"
Jul 20 13:28:12.542635 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:28:12.542536    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-b8383c/rate-test-model-b8383c-kserve-f94d9f67f-slr22"
Jul 20 13:28:12.542635 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:28:12.542612    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-b8383c/rate-test-model-b8383c-kserve-f94d9f67f-slr22"
Jul 20 13:28:12.555592 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:28:12.555557    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-b8383c/rate-test-model-b8383c-kserve-f94d9f67f-slr22"
Jul 20 13:28:13.034999 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:28:13.034971    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-b8383c/rate-test-model-b8383c-kserve-f94d9f67f-slr22"
Jul 20 13:28:46.705530 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:28:46.705494    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-7f57a3/rate-test-model-7f57a3-kserve-868bc74459-x47vb"]
Jul 20 13:28:47.513267 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:28:47.513229    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b8383c/rate-test-model-b8383c-kserve-f94d9f67f-slr22"]
Jul 20 13:29:01.725315 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:01.725269    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-7f57a3/rate-test-model-7f57a3-kserve-868bc74459-x47vb" podUID="7295cf14-325c-4c8b-ad5e-6f50921a9848" containerName="main" containerID="cri-o://e9594ec4ba2f62e15b00691d4ac57efe8dacd7d99fc7acc4cc9bcb826ec581bc" gracePeriod=45
Jul 20 13:29:01.983209 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:01.983144    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7f57a3/rate-test-model-7f57a3-kserve-868bc74459-x47vb"
Jul 20 13:29:02.056685 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:02.056647    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7295cf14-325c-4c8b-ad5e-6f50921a9848-home\") pod \"7295cf14-325c-4c8b-ad5e-6f50921a9848\" (UID: \"7295cf14-325c-4c8b-ad5e-6f50921a9848\") "
Jul 20 13:29:02.056872 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:02.056744    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7295cf14-325c-4c8b-ad5e-6f50921a9848-tls-certs\") pod \"7295cf14-325c-4c8b-ad5e-6f50921a9848\" (UID: \"7295cf14-325c-4c8b-ad5e-6f50921a9848\") "
Jul 20 13:29:02.056872 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:02.056809    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7295cf14-325c-4c8b-ad5e-6f50921a9848-dshm\") pod \"7295cf14-325c-4c8b-ad5e-6f50921a9848\" (UID: \"7295cf14-325c-4c8b-ad5e-6f50921a9848\") "
Jul 20 13:29:02.056872 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:02.056856    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7295cf14-325c-4c8b-ad5e-6f50921a9848-tmp-dir\") pod \"7295cf14-325c-4c8b-ad5e-6f50921a9848\" (UID: \"7295cf14-325c-4c8b-ad5e-6f50921a9848\") "
Jul 20 13:29:02.057043 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:02.056885    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7295cf14-325c-4c8b-ad5e-6f50921a9848-model-cache\") pod \"7295cf14-325c-4c8b-ad5e-6f50921a9848\" (UID: \"7295cf14-325c-4c8b-ad5e-6f50921a9848\") "
Jul 20 13:29:02.057043 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:02.056929    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-82r6q\" (UniqueName: \"kubernetes.io/projected/7295cf14-325c-4c8b-ad5e-6f50921a9848-kube-api-access-82r6q\") pod \"7295cf14-325c-4c8b-ad5e-6f50921a9848\" (UID: \"7295cf14-325c-4c8b-ad5e-6f50921a9848\") "
Jul 20 13:29:02.057043 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:02.056995    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7295cf14-325c-4c8b-ad5e-6f50921a9848-home" (OuterVolumeSpecName: "home") pod "7295cf14-325c-4c8b-ad5e-6f50921a9848" (UID: "7295cf14-325c-4c8b-ad5e-6f50921a9848"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:29:02.057242 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:02.057216    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7295cf14-325c-4c8b-ad5e-6f50921a9848-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7295cf14-325c-4c8b-ad5e-6f50921a9848" (UID: "7295cf14-325c-4c8b-ad5e-6f50921a9848"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:29:02.057302 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:02.057220    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7295cf14-325c-4c8b-ad5e-6f50921a9848-model-cache" (OuterVolumeSpecName: "model-cache") pod "7295cf14-325c-4c8b-ad5e-6f50921a9848" (UID: "7295cf14-325c-4c8b-ad5e-6f50921a9848"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:29:02.057357 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:02.057325    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7295cf14-325c-4c8b-ad5e-6f50921a9848-tmp-dir\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:29:02.057357 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:02.057339    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7295cf14-325c-4c8b-ad5e-6f50921a9848-model-cache\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:29:02.057357 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:02.057349    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7295cf14-325c-4c8b-ad5e-6f50921a9848-home\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:29:02.059043 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:02.059018    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7295cf14-325c-4c8b-ad5e-6f50921a9848-dshm" (OuterVolumeSpecName: "dshm") pod "7295cf14-325c-4c8b-ad5e-6f50921a9848" (UID: "7295cf14-325c-4c8b-ad5e-6f50921a9848"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:29:02.059174 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:02.059069    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7295cf14-325c-4c8b-ad5e-6f50921a9848-kube-api-access-82r6q" (OuterVolumeSpecName: "kube-api-access-82r6q") pod "7295cf14-325c-4c8b-ad5e-6f50921a9848" (UID: "7295cf14-325c-4c8b-ad5e-6f50921a9848"). InnerVolumeSpecName "kube-api-access-82r6q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:29:02.059174 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:02.059162    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7295cf14-325c-4c8b-ad5e-6f50921a9848-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7295cf14-325c-4c8b-ad5e-6f50921a9848" (UID: "7295cf14-325c-4c8b-ad5e-6f50921a9848"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:29:02.158269 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:02.158232    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-82r6q\" (UniqueName: \"kubernetes.io/projected/7295cf14-325c-4c8b-ad5e-6f50921a9848-kube-api-access-82r6q\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:29:02.158269 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:02.158263    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7295cf14-325c-4c8b-ad5e-6f50921a9848-tls-certs\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:29:02.158269 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:02.158274    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7295cf14-325c-4c8b-ad5e-6f50921a9848-dshm\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:29:02.313824 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:02.313732    2570 generic.go:356] "Generic (PLEG): container finished" podID="7295cf14-325c-4c8b-ad5e-6f50921a9848" containerID="e9594ec4ba2f62e15b00691d4ac57efe8dacd7d99fc7acc4cc9bcb826ec581bc" exitCode=0
Jul 20 13:29:02.313824 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:02.313780    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7f57a3/rate-test-model-7f57a3-kserve-868bc74459-x47vb"
Jul 20 13:29:02.313824 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:02.313806    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7f57a3/rate-test-model-7f57a3-kserve-868bc74459-x47vb" event={"ID":"7295cf14-325c-4c8b-ad5e-6f50921a9848","Type":"ContainerDied","Data":"e9594ec4ba2f62e15b00691d4ac57efe8dacd7d99fc7acc4cc9bcb826ec581bc"}
Jul 20 13:29:02.314130 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:02.313845    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7f57a3/rate-test-model-7f57a3-kserve-868bc74459-x47vb" event={"ID":"7295cf14-325c-4c8b-ad5e-6f50921a9848","Type":"ContainerDied","Data":"0502cacd45b7dc9ab06e043f550162243a31bbccb514eccbc190c4e9b664ddf4"}
Jul 20 13:29:02.314130 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:02.313881    2570 scope.go:117] "RemoveContainer" containerID="e9594ec4ba2f62e15b00691d4ac57efe8dacd7d99fc7acc4cc9bcb826ec581bc"
Jul 20 13:29:02.323512 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:02.323491    2570 scope.go:117] "RemoveContainer" containerID="e9594ec4ba2f62e15b00691d4ac57efe8dacd7d99fc7acc4cc9bcb826ec581bc"
Jul 20 13:29:02.323779 ip-10-0-139-1 kubenswrapper[2570]: E0720 13:29:02.323755    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9594ec4ba2f62e15b00691d4ac57efe8dacd7d99fc7acc4cc9bcb826ec581bc\": container with ID starting with e9594ec4ba2f62e15b00691d4ac57efe8dacd7d99fc7acc4cc9bcb826ec581bc not found: ID does not exist" containerID="e9594ec4ba2f62e15b00691d4ac57efe8dacd7d99fc7acc4cc9bcb826ec581bc"
Jul 20 13:29:02.323832 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:02.323789    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9594ec4ba2f62e15b00691d4ac57efe8dacd7d99fc7acc4cc9bcb826ec581bc"} err="failed to get container status \"e9594ec4ba2f62e15b00691d4ac57efe8dacd7d99fc7acc4cc9bcb826ec581bc\": rpc error: code = NotFound desc = could not find container \"e9594ec4ba2f62e15b00691d4ac57efe8dacd7d99fc7acc4cc9bcb826ec581bc\": container with ID starting with e9594ec4ba2f62e15b00691d4ac57efe8dacd7d99fc7acc4cc9bcb826ec581bc not found: ID does not exist"
Jul 20 13:29:02.338850 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:02.338820    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-7f57a3/rate-test-model-7f57a3-kserve-868bc74459-x47vb"]
Jul 20 13:29:02.343389 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:02.343365    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-7f57a3/rate-test-model-7f57a3-kserve-868bc74459-x47vb"]
Jul 20 13:29:02.533274 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:02.533234    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-b8383c/rate-test-model-b8383c-kserve-f94d9f67f-slr22" podUID="b58e9da7-8132-4fe6-b75b-01cec744facb" containerName="main" containerID="cri-o://96807706324c211bdd44d90c9cacb44dda0755f17f252ae3305ff3ef713f9c48" gracePeriod=45
Jul 20 13:29:02.791258 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:02.791229    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b8383c/rate-test-model-b8383c-kserve-f94d9f67f-slr22"
Jul 20 13:29:02.866354 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:02.866323    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6l7fg\" (UniqueName: \"kubernetes.io/projected/b58e9da7-8132-4fe6-b75b-01cec744facb-kube-api-access-6l7fg\") pod \"b58e9da7-8132-4fe6-b75b-01cec744facb\" (UID: \"b58e9da7-8132-4fe6-b75b-01cec744facb\") "
Jul 20 13:29:02.866520 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:02.866370    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b58e9da7-8132-4fe6-b75b-01cec744facb-tmp-dir\") pod \"b58e9da7-8132-4fe6-b75b-01cec744facb\" (UID: \"b58e9da7-8132-4fe6-b75b-01cec744facb\") "
Jul 20 13:29:02.866520 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:02.866412    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b58e9da7-8132-4fe6-b75b-01cec744facb-home\") pod \"b58e9da7-8132-4fe6-b75b-01cec744facb\" (UID: \"b58e9da7-8132-4fe6-b75b-01cec744facb\") "
Jul 20 13:29:02.866618 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:02.866516    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b58e9da7-8132-4fe6-b75b-01cec744facb-dshm\") pod \"b58e9da7-8132-4fe6-b75b-01cec744facb\" (UID: \"b58e9da7-8132-4fe6-b75b-01cec744facb\") "
Jul 20 13:29:02.866618 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:02.866598    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b58e9da7-8132-4fe6-b75b-01cec744facb-tls-certs\") pod \"b58e9da7-8132-4fe6-b75b-01cec744facb\" (UID: \"b58e9da7-8132-4fe6-b75b-01cec744facb\") "
Jul 20 13:29:02.866709 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:02.866654    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b58e9da7-8132-4fe6-b75b-01cec744facb-home" (OuterVolumeSpecName: "home") pod "b58e9da7-8132-4fe6-b75b-01cec744facb" (UID: "b58e9da7-8132-4fe6-b75b-01cec744facb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:29:02.866709 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:02.866665    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b58e9da7-8132-4fe6-b75b-01cec744facb-model-cache\") pod \"b58e9da7-8132-4fe6-b75b-01cec744facb\" (UID: \"b58e9da7-8132-4fe6-b75b-01cec744facb\") "
Jul 20 13:29:02.866709 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:02.866695    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b58e9da7-8132-4fe6-b75b-01cec744facb-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b58e9da7-8132-4fe6-b75b-01cec744facb" (UID: "b58e9da7-8132-4fe6-b75b-01cec744facb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:29:02.866899 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:02.866877    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b58e9da7-8132-4fe6-b75b-01cec744facb-model-cache" (OuterVolumeSpecName: "model-cache") pod "b58e9da7-8132-4fe6-b75b-01cec744facb" (UID: "b58e9da7-8132-4fe6-b75b-01cec744facb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:29:02.867308 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:02.867283    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b58e9da7-8132-4fe6-b75b-01cec744facb-home\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:29:02.867449 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:02.867313    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b58e9da7-8132-4fe6-b75b-01cec744facb-model-cache\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:29:02.867449 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:02.867330    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b58e9da7-8132-4fe6-b75b-01cec744facb-tmp-dir\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:29:02.868676 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:02.868652    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b58e9da7-8132-4fe6-b75b-01cec744facb-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b58e9da7-8132-4fe6-b75b-01cec744facb" (UID: "b58e9da7-8132-4fe6-b75b-01cec744facb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:29:02.868676 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:02.868665    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b58e9da7-8132-4fe6-b75b-01cec744facb-dshm" (OuterVolumeSpecName: "dshm") pod "b58e9da7-8132-4fe6-b75b-01cec744facb" (UID: "b58e9da7-8132-4fe6-b75b-01cec744facb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:29:02.868799 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:02.868720    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b58e9da7-8132-4fe6-b75b-01cec744facb-kube-api-access-6l7fg" (OuterVolumeSpecName: "kube-api-access-6l7fg") pod "b58e9da7-8132-4fe6-b75b-01cec744facb" (UID: "b58e9da7-8132-4fe6-b75b-01cec744facb"). InnerVolumeSpecName "kube-api-access-6l7fg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:29:02.968476 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:02.968391    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b58e9da7-8132-4fe6-b75b-01cec744facb-dshm\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:29:02.968476 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:02.968420    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b58e9da7-8132-4fe6-b75b-01cec744facb-tls-certs\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:29:02.968476 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:02.968430    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6l7fg\" (UniqueName: \"kubernetes.io/projected/b58e9da7-8132-4fe6-b75b-01cec744facb-kube-api-access-6l7fg\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:29:03.322071 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:03.322042    2570 generic.go:356] "Generic (PLEG): container finished" podID="b58e9da7-8132-4fe6-b75b-01cec744facb" containerID="96807706324c211bdd44d90c9cacb44dda0755f17f252ae3305ff3ef713f9c48" exitCode=0
Jul 20 13:29:03.322257 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:03.322078    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b8383c/rate-test-model-b8383c-kserve-f94d9f67f-slr22" event={"ID":"b58e9da7-8132-4fe6-b75b-01cec744facb","Type":"ContainerDied","Data":"96807706324c211bdd44d90c9cacb44dda0755f17f252ae3305ff3ef713f9c48"}
Jul 20 13:29:03.322257 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:03.322103    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b8383c/rate-test-model-b8383c-kserve-f94d9f67f-slr22"
Jul 20 13:29:03.322257 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:03.322128    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b8383c/rate-test-model-b8383c-kserve-f94d9f67f-slr22" event={"ID":"b58e9da7-8132-4fe6-b75b-01cec744facb","Type":"ContainerDied","Data":"8018b82337f830b0584f7ebd05c80d99a42b05ce2096f0ef12b449310d95c02e"}
Jul 20 13:29:03.322257 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:03.322145    2570 scope.go:117] "RemoveContainer" containerID="96807706324c211bdd44d90c9cacb44dda0755f17f252ae3305ff3ef713f9c48"
Jul 20 13:29:03.331599 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:03.331577    2570 scope.go:117] "RemoveContainer" containerID="96807706324c211bdd44d90c9cacb44dda0755f17f252ae3305ff3ef713f9c48"
Jul 20 13:29:03.331883 ip-10-0-139-1 kubenswrapper[2570]: E0720 13:29:03.331861    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96807706324c211bdd44d90c9cacb44dda0755f17f252ae3305ff3ef713f9c48\": container with ID starting with 96807706324c211bdd44d90c9cacb44dda0755f17f252ae3305ff3ef713f9c48 not found: ID does not exist" containerID="96807706324c211bdd44d90c9cacb44dda0755f17f252ae3305ff3ef713f9c48"
Jul 20 13:29:03.331940 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:03.331891    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96807706324c211bdd44d90c9cacb44dda0755f17f252ae3305ff3ef713f9c48"} err="failed to get container status \"96807706324c211bdd44d90c9cacb44dda0755f17f252ae3305ff3ef713f9c48\": rpc error: code = NotFound desc = could not find container \"96807706324c211bdd44d90c9cacb44dda0755f17f252ae3305ff3ef713f9c48\": container with ID starting with 96807706324c211bdd44d90c9cacb44dda0755f17f252ae3305ff3ef713f9c48 not found: ID does not exist"
Jul 20 13:29:03.345857 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:03.345826    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b8383c/rate-test-model-b8383c-kserve-f94d9f67f-slr22"]
Jul 20 13:29:03.350021 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:03.350001    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-b8383c/rate-test-model-b8383c-kserve-f94d9f67f-slr22"]
Jul 20 13:29:03.650286 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:03.650209    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7675-140232302213712"]
Jul 20 13:29:03.650595 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:03.650583    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7295cf14-325c-4c8b-ad5e-6f50921a9848" containerName="main"
Jul 20 13:29:03.650647 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:03.650597    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="7295cf14-325c-4c8b-ad5e-6f50921a9848" containerName="main"
Jul 20 13:29:03.650647 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:03.650625    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b58e9da7-8132-4fe6-b75b-01cec744facb" containerName="main"
Jul 20 13:29:03.650647 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:03.650631    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b58e9da7-8132-4fe6-b75b-01cec744facb" containerName="main"
Jul 20 13:29:03.650742 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:03.650701    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="7295cf14-325c-4c8b-ad5e-6f50921a9848" containerName="main"
Jul 20 13:29:03.650742 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:03.650708    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="b58e9da7-8132-4fe6-b75b-01cec744facb" containerName="main"
Jul 20 13:29:03.655134 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:03.655116    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7675-140232302213712"
Jul 20 13:29:03.658426 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:03.658401    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-j6xxs\""
Jul 20 13:29:03.659946 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:03.659921    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7675-140232302213712"]
Jul 20 13:29:03.775119 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:03.775052    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gtx4\" (UniqueName: \"kubernetes.io/projected/93ca3997-459d-4d63-bbd2-777ba45811fd-kube-api-access-5gtx4\") pod \"test-curl-7675-140232302213712\" (UID: \"93ca3997-459d-4d63-bbd2-777ba45811fd\") " pod="opendatahub/test-curl-7675-140232302213712"
Jul 20 13:29:03.808218 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:03.808187    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7295cf14-325c-4c8b-ad5e-6f50921a9848" path="/var/lib/kubelet/pods/7295cf14-325c-4c8b-ad5e-6f50921a9848/volumes"
Jul 20 13:29:03.808579 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:03.808561    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b58e9da7-8132-4fe6-b75b-01cec744facb" path="/var/lib/kubelet/pods/b58e9da7-8132-4fe6-b75b-01cec744facb/volumes"
Jul 20 13:29:03.875996 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:03.875961    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gtx4\" (UniqueName: \"kubernetes.io/projected/93ca3997-459d-4d63-bbd2-777ba45811fd-kube-api-access-5gtx4\") pod \"test-curl-7675-140232302213712\" (UID: \"93ca3997-459d-4d63-bbd2-777ba45811fd\") " pod="opendatahub/test-curl-7675-140232302213712"
Jul 20 13:29:03.884759 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:03.884735    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gtx4\" (UniqueName: \"kubernetes.io/projected/93ca3997-459d-4d63-bbd2-777ba45811fd-kube-api-access-5gtx4\") pod \"test-curl-7675-140232302213712\" (UID: \"93ca3997-459d-4d63-bbd2-777ba45811fd\") " pod="opendatahub/test-curl-7675-140232302213712"
Jul 20 13:29:03.967409 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:03.967320    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7675-140232302213712"
Jul 20 13:29:04.100367 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:04.100344    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7675-140232302213712"]
Jul 20 13:29:04.101692 ip-10-0-139-1 kubenswrapper[2570]: W0720 13:29:04.101668    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod93ca3997_459d_4d63_bbd2_777ba45811fd.slice/crio-689efbf24bfea123b8627ff3022177522d653b230ccbf159ed06b8b7c8a03219 WatchSource:0}: Error finding container 689efbf24bfea123b8627ff3022177522d653b230ccbf159ed06b8b7c8a03219: Status 404 returned error can't find the container with id 689efbf24bfea123b8627ff3022177522d653b230ccbf159ed06b8b7c8a03219
Jul 20 13:29:04.103068 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:04.103050    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 13:29:04.328625 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:04.328587    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7675-140232302213712" event={"ID":"93ca3997-459d-4d63-bbd2-777ba45811fd","Type":"ContainerStarted","Data":"689efbf24bfea123b8627ff3022177522d653b230ccbf159ed06b8b7c8a03219"}
Jul 20 13:29:05.337882 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:05.337848    2570 generic.go:356] "Generic (PLEG): container finished" podID="93ca3997-459d-4d63-bbd2-777ba45811fd" containerID="bd55e9ac866962949b29878fe58939f0ad6870dbf277b925e9c14e835bf98711" exitCode=0
Jul 20 13:29:05.338303 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:05.337936    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7675-140232302213712" event={"ID":"93ca3997-459d-4d63-bbd2-777ba45811fd","Type":"ContainerDied","Data":"bd55e9ac866962949b29878fe58939f0ad6870dbf277b925e9c14e835bf98711"}
Jul 20 13:29:06.474796 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:06.474772    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7675-140232302213712"
Jul 20 13:29:06.514873 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:06.514848    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7675-140232302213712_93ca3997-459d-4d63-bbd2-777ba45811fd/test-curl-7675-140232302213712/0.log"
Jul 20 13:29:06.538285 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:06.538250    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7675-140232302213712"]
Jul 20 13:29:06.542225 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:06.542202    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7675-140232302213712"]
Jul 20 13:29:06.602442 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:06.602358    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5gtx4\" (UniqueName: \"kubernetes.io/projected/93ca3997-459d-4d63-bbd2-777ba45811fd-kube-api-access-5gtx4\") pod \"93ca3997-459d-4d63-bbd2-777ba45811fd\" (UID: \"93ca3997-459d-4d63-bbd2-777ba45811fd\") "
Jul 20 13:29:06.604477 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:06.604455    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93ca3997-459d-4d63-bbd2-777ba45811fd-kube-api-access-5gtx4" (OuterVolumeSpecName: "kube-api-access-5gtx4") pod "93ca3997-459d-4d63-bbd2-777ba45811fd" (UID: "93ca3997-459d-4d63-bbd2-777ba45811fd"). InnerVolumeSpecName "kube-api-access-5gtx4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:29:06.703319 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:06.703278    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5gtx4\" (UniqueName: \"kubernetes.io/projected/93ca3997-459d-4d63-bbd2-777ba45811fd-kube-api-access-5gtx4\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:29:06.904067 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:06.903959    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-shared-a-7f57a3/rate-test-model-7f57a3-kserve-868bc74459-x47vb" podUID="7295cf14-325c-4c8b-ad5e-6f50921a9848" containerName="main" probeResult="failure" output="Get \"https://10.134.0.67:8000/ready\": context deadline exceeded"
Jul 20 13:29:07.351560 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:07.351537    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7675-140232302213712"
Jul 20 13:29:07.351738 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:07.351539    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="689efbf24bfea123b8627ff3022177522d653b230ccbf159ed06b8b7c8a03219"
Jul 20 13:29:07.362183 ip-10-0-139-1 kubenswrapper[2570]: E0720 13:29:07.362156    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7675-140232302213712\" is forbidden: User \"system:node:ip-10-0-139-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-1.ec2.internal' and this object" podUID="93ca3997-459d-4d63-bbd2-777ba45811fd" pod="opendatahub/test-curl-7675-140232302213712"
Jul 20 13:29:07.807956 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:07.807861    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93ca3997-459d-4d63-bbd2-777ba45811fd" path="/var/lib/kubelet/pods/93ca3997-459d-4d63-bbd2-777ba45811fd/volumes"
Jul 20 13:29:07.808427 ip-10-0-139-1 kubenswrapper[2570]: E0720 13:29:07.808181    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7675-140232302213712\" is forbidden: User \"system:node:ip-10-0-139-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-1.ec2.internal' and this object" podUID="93ca3997-459d-4d63-bbd2-777ba45811fd" pod="opendatahub/test-curl-7675-140232302213712"
Jul 20 13:29:17.391915 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:17.391869    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-7f57a3-69c7f5957-c654j"]
Jul 20 13:29:17.392434 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:17.392063    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7f57a3-69c7f5957-c654j" podUID="9c5b45b6-8290-4db3-b2a3-ffeb3ce11c8e" containerName="maas-api" containerID="cri-o://81c5b362c31b6a370275a162ceb14f095b58904dbf04083d9d73a070fda38756" gracePeriod=30
Jul 20 13:29:17.639416 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:17.639391    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7f57a3-69c7f5957-c654j"
Jul 20 13:29:17.698938 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:17.698865    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6l2n5\" (UniqueName: \"kubernetes.io/projected/9c5b45b6-8290-4db3-b2a3-ffeb3ce11c8e-kube-api-access-6l2n5\") pod \"9c5b45b6-8290-4db3-b2a3-ffeb3ce11c8e\" (UID: \"9c5b45b6-8290-4db3-b2a3-ffeb3ce11c8e\") "
Jul 20 13:29:17.699123 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:17.698976    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c5b45b6-8290-4db3-b2a3-ffeb3ce11c8e-openshift-service-ca\") pod \"9c5b45b6-8290-4db3-b2a3-ffeb3ce11c8e\" (UID: \"9c5b45b6-8290-4db3-b2a3-ffeb3ce11c8e\") "
Jul 20 13:29:17.699123 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:17.699006    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c5b45b6-8290-4db3-b2a3-ffeb3ce11c8e-maas-api-tls\") pod \"9c5b45b6-8290-4db3-b2a3-ffeb3ce11c8e\" (UID: \"9c5b45b6-8290-4db3-b2a3-ffeb3ce11c8e\") "
Jul 20 13:29:17.699408 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:17.699380    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c5b45b6-8290-4db3-b2a3-ffeb3ce11c8e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9c5b45b6-8290-4db3-b2a3-ffeb3ce11c8e" (UID: "9c5b45b6-8290-4db3-b2a3-ffeb3ce11c8e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:29:17.700988 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:17.700959    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c5b45b6-8290-4db3-b2a3-ffeb3ce11c8e-kube-api-access-6l2n5" (OuterVolumeSpecName: "kube-api-access-6l2n5") pod "9c5b45b6-8290-4db3-b2a3-ffeb3ce11c8e" (UID: "9c5b45b6-8290-4db3-b2a3-ffeb3ce11c8e"). InnerVolumeSpecName "kube-api-access-6l2n5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:29:17.701063 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:17.701049    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c5b45b6-8290-4db3-b2a3-ffeb3ce11c8e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9c5b45b6-8290-4db3-b2a3-ffeb3ce11c8e" (UID: "9c5b45b6-8290-4db3-b2a3-ffeb3ce11c8e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:29:17.799657 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:17.799630    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c5b45b6-8290-4db3-b2a3-ffeb3ce11c8e-openshift-service-ca\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:29:17.799657 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:17.799654    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c5b45b6-8290-4db3-b2a3-ffeb3ce11c8e-maas-api-tls\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:29:17.799817 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:17.799663    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6l2n5\" (UniqueName: \"kubernetes.io/projected/9c5b45b6-8290-4db3-b2a3-ffeb3ce11c8e-kube-api-access-6l2n5\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:29:18.412901 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:18.412866    2570 generic.go:356] "Generic (PLEG): container finished" podID="9c5b45b6-8290-4db3-b2a3-ffeb3ce11c8e" containerID="81c5b362c31b6a370275a162ceb14f095b58904dbf04083d9d73a070fda38756" exitCode=0
Jul 20 13:29:18.413335 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:18.412910    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7f57a3-69c7f5957-c654j"
Jul 20 13:29:18.413335 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:18.412947    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7f57a3-69c7f5957-c654j" event={"ID":"9c5b45b6-8290-4db3-b2a3-ffeb3ce11c8e","Type":"ContainerDied","Data":"81c5b362c31b6a370275a162ceb14f095b58904dbf04083d9d73a070fda38756"}
Jul 20 13:29:18.413335 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:18.412997    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7f57a3-69c7f5957-c654j" event={"ID":"9c5b45b6-8290-4db3-b2a3-ffeb3ce11c8e","Type":"ContainerDied","Data":"cbdaf4bbd8e163ee0fc1f50a41ceae0980c747f12eb10a69eaf559259c930afc"}
Jul 20 13:29:18.413335 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:18.413019    2570 scope.go:117] "RemoveContainer" containerID="81c5b362c31b6a370275a162ceb14f095b58904dbf04083d9d73a070fda38756"
Jul 20 13:29:18.424594 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:18.424578    2570 scope.go:117] "RemoveContainer" containerID="81c5b362c31b6a370275a162ceb14f095b58904dbf04083d9d73a070fda38756"
Jul 20 13:29:18.424857 ip-10-0-139-1 kubenswrapper[2570]: E0720 13:29:18.424836    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81c5b362c31b6a370275a162ceb14f095b58904dbf04083d9d73a070fda38756\": container with ID starting with 81c5b362c31b6a370275a162ceb14f095b58904dbf04083d9d73a070fda38756 not found: ID does not exist" containerID="81c5b362c31b6a370275a162ceb14f095b58904dbf04083d9d73a070fda38756"
Jul 20 13:29:18.424920 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:18.424864    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81c5b362c31b6a370275a162ceb14f095b58904dbf04083d9d73a070fda38756"} err="failed to get container status \"81c5b362c31b6a370275a162ceb14f095b58904dbf04083d9d73a070fda38756\": rpc error: code = NotFound desc = could not find container \"81c5b362c31b6a370275a162ceb14f095b58904dbf04083d9d73a070fda38756\": container with ID starting with 81c5b362c31b6a370275a162ceb14f095b58904dbf04083d9d73a070fda38756 not found: ID does not exist"
Jul 20 13:29:18.435254 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:18.435230    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-7f57a3-69c7f5957-c654j"]
Jul 20 13:29:18.439770 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:18.439748    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-7f57a3-69c7f5957-c654j"]
Jul 20 13:29:19.807776 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:19.807737    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c5b45b6-8290-4db3-b2a3-ffeb3ce11c8e" path="/var/lib/kubelet/pods/9c5b45b6-8290-4db3-b2a3-ffeb3ce11c8e/volumes"
Jul 20 13:29:39.314536 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:39.314438    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b8383c-579968ddf6-qh74m"]
Jul 20 13:29:39.315029 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:39.314698    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b8383c-579968ddf6-qh74m" podUID="969dfcc8-46f1-46ce-bba6-fc7b76aad3d2" containerName="maas-api" containerID="cri-o://9a2b7c5d47449de57b5f7d569c2cb8df12f398df720b312bfefb4cf4d33df223" gracePeriod=30
Jul 20 13:29:39.538692 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:39.538653    2570 generic.go:356] "Generic (PLEG): container finished" podID="969dfcc8-46f1-46ce-bba6-fc7b76aad3d2" containerID="9a2b7c5d47449de57b5f7d569c2cb8df12f398df720b312bfefb4cf4d33df223" exitCode=0
Jul 20 13:29:39.538868 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:39.538725    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b8383c-579968ddf6-qh74m" event={"ID":"969dfcc8-46f1-46ce-bba6-fc7b76aad3d2","Type":"ContainerDied","Data":"9a2b7c5d47449de57b5f7d569c2cb8df12f398df720b312bfefb4cf4d33df223"}
Jul 20 13:29:39.571188 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:39.571160    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b8383c-579968ddf6-qh74m"
Jul 20 13:29:39.707046 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:39.707008    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dz5kt\" (UniqueName: \"kubernetes.io/projected/969dfcc8-46f1-46ce-bba6-fc7b76aad3d2-kube-api-access-dz5kt\") pod \"969dfcc8-46f1-46ce-bba6-fc7b76aad3d2\" (UID: \"969dfcc8-46f1-46ce-bba6-fc7b76aad3d2\") "
Jul 20 13:29:39.707273 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:39.707074    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/969dfcc8-46f1-46ce-bba6-fc7b76aad3d2-openshift-service-ca\") pod \"969dfcc8-46f1-46ce-bba6-fc7b76aad3d2\" (UID: \"969dfcc8-46f1-46ce-bba6-fc7b76aad3d2\") "
Jul 20 13:29:39.707353 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:39.707275    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/969dfcc8-46f1-46ce-bba6-fc7b76aad3d2-maas-api-tls\") pod \"969dfcc8-46f1-46ce-bba6-fc7b76aad3d2\" (UID: \"969dfcc8-46f1-46ce-bba6-fc7b76aad3d2\") "
Jul 20 13:29:39.707437 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:39.707411    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/969dfcc8-46f1-46ce-bba6-fc7b76aad3d2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "969dfcc8-46f1-46ce-bba6-fc7b76aad3d2" (UID: "969dfcc8-46f1-46ce-bba6-fc7b76aad3d2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:29:39.707662 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:39.707643    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/969dfcc8-46f1-46ce-bba6-fc7b76aad3d2-openshift-service-ca\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:29:39.709278 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:39.709251    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/969dfcc8-46f1-46ce-bba6-fc7b76aad3d2-kube-api-access-dz5kt" (OuterVolumeSpecName: "kube-api-access-dz5kt") pod "969dfcc8-46f1-46ce-bba6-fc7b76aad3d2" (UID: "969dfcc8-46f1-46ce-bba6-fc7b76aad3d2"). InnerVolumeSpecName "kube-api-access-dz5kt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:29:39.709367 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:39.709276    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/969dfcc8-46f1-46ce-bba6-fc7b76aad3d2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "969dfcc8-46f1-46ce-bba6-fc7b76aad3d2" (UID: "969dfcc8-46f1-46ce-bba6-fc7b76aad3d2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:29:39.808283 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:39.808248    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/969dfcc8-46f1-46ce-bba6-fc7b76aad3d2-maas-api-tls\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:29:39.808283 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:39.808280    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dz5kt\" (UniqueName: \"kubernetes.io/projected/969dfcc8-46f1-46ce-bba6-fc7b76aad3d2-kube-api-access-dz5kt\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 20 13:29:40.545593 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:40.545561    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b8383c-579968ddf6-qh74m"
Jul 20 13:29:40.545593 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:40.545587    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b8383c-579968ddf6-qh74m" event={"ID":"969dfcc8-46f1-46ce-bba6-fc7b76aad3d2","Type":"ContainerDied","Data":"70be63fa4acbc575f122a27f1580b5845c6bd7b85a2a5aa7d9c54bc169ad6a74"}
Jul 20 13:29:40.546214 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:40.545647    2570 scope.go:117] "RemoveContainer" containerID="9a2b7c5d47449de57b5f7d569c2cb8df12f398df720b312bfefb4cf4d33df223"
Jul 20 13:29:40.586709 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:40.586665    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b8383c-579968ddf6-qh74m"]
Jul 20 13:29:40.592464 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:40.592430    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b8383c-579968ddf6-qh74m"]
Jul 20 13:29:41.807318 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:41.807283    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="969dfcc8-46f1-46ce-bba6-fc7b76aad3d2" path="/var/lib/kubelet/pods/969dfcc8-46f1-46ce-bba6-fc7b76aad3d2/volumes"
Jul 20 13:29:48.031253 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:48.031224    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rhdn8_5efe9094-763c-4689-85b7-83e0ccb19811/ovn-acl-logging/0.log"
Jul 20 13:29:48.041957 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:48.041932    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rhdn8_5efe9094-763c-4689-85b7-83e0ccb19811/ovn-acl-logging/0.log"
Jul 20 13:29:51.088833 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:51.088792    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-57c99db69b-2nsd5_0d1869d9-5ed5-4613-84cf-6e55baf96c75/authorino/0.log"
Jul 20 13:29:57.525205 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:57.525174    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-749978ccd7-6pbjc_8d136b15-3a4c-4cd5-a6e4-4eaade21228f/copy-manifests/0.log"
Jul 20 13:29:57.542438 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:57.542406    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-749978ccd7-6pbjc_8d136b15-3a4c-4cd5-a6e4-4eaade21228f/manager/0.log"
Jul 20 13:29:58.291700 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:58.291637    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29742540-zllmk_5a466450-abb8-4eea-b281-c93b294a0086/cleanup/0.log"
Jul 20 13:29:59.285776 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:59.285740    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759chl99_fee12997-021f-4fd9-96a4-4632a0f07969/util/0.log"
Jul 20 13:29:59.292673 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:59.292646    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759chl99_fee12997-021f-4fd9-96a4-4632a0f07969/pull/0.log"
Jul 20 13:29:59.298809 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:59.298790    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759chl99_fee12997-021f-4fd9-96a4-4632a0f07969/extract/0.log"
Jul 20 13:29:59.403855 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:59.403826    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dtpgc_9ef2af62-3e2b-4e88-ba17-8affdc9d2226/util/0.log"
Jul 20 13:29:59.410351 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:59.410327    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dtpgc_9ef2af62-3e2b-4e88-ba17-8affdc9d2226/pull/0.log"
Jul 20 13:29:59.416327 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:59.416307    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dtpgc_9ef2af62-3e2b-4e88-ba17-8affdc9d2226/extract/0.log"
Jul 20 13:29:59.526759 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:59.526727    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2fdg_5c1d6720-3bdc-4419-bb82-90117eceb44a/util/0.log"
Jul 20 13:29:59.532760 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:59.532736    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2fdg_5c1d6720-3bdc-4419-bb82-90117eceb44a/pull/0.log"
Jul 20 13:29:59.538689 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:59.538626    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2fdg_5c1d6720-3bdc-4419-bb82-90117eceb44a/extract/0.log"
Jul 20 13:29:59.650553 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:59.650527    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkf72_0b227a2c-e778-44ee-9edd-f2a9d8ca501e/util/0.log"
Jul 20 13:29:59.656696 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:59.656674    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkf72_0b227a2c-e778-44ee-9edd-f2a9d8ca501e/pull/0.log"
Jul 20 13:29:59.662824 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:59.662803    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkf72_0b227a2c-e778-44ee-9edd-f2a9d8ca501e/extract/0.log"
Jul 20 13:29:59.781830 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:29:59.781798    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-57c99db69b-2nsd5_0d1869d9-5ed5-4613-84cf-6e55baf96c75/authorino/0.log"
Jul 20 13:30:00.606634 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:00.606603    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-hhqng_53b7e07c-125f-4528-9d5e-0dbe45216d74/manager/0.log"
Jul 20 13:30:01.207561 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:01.207519    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f7c7fb896-pvwl4_488d8e8c-3ca2-4219-a5c0-49979811aca3/kube-auth-proxy/0.log"
Jul 20 13:30:02.294369 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:02.294341    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-224cq_c8ccf5c0-3f34-4cd7-8d2b-82f3a8a63794/main/0.log"
Jul 20 13:30:02.530020 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:02.529923    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9ljhz_ca588c8d-2c40-445b-a601-84e07f839031/main/0.log"
Jul 20 13:30:07.979843 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:07.979806    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-478p7/must-gather-vrbm4"]
Jul 20 13:30:07.980425 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:07.980376    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93ca3997-459d-4d63-bbd2-777ba45811fd" containerName="test-curl-7675-140232302213712"
Jul 20 13:30:07.980425 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:07.980394    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="93ca3997-459d-4d63-bbd2-777ba45811fd" containerName="test-curl-7675-140232302213712"
Jul 20 13:30:07.980425 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:07.980408    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c5b45b6-8290-4db3-b2a3-ffeb3ce11c8e" containerName="maas-api"
Jul 20 13:30:07.980425 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:07.980413    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c5b45b6-8290-4db3-b2a3-ffeb3ce11c8e" containerName="maas-api"
Jul 20 13:30:07.980636 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:07.980431    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="969dfcc8-46f1-46ce-bba6-fc7b76aad3d2" containerName="maas-api"
Jul 20 13:30:07.980636 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:07.980437    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="969dfcc8-46f1-46ce-bba6-fc7b76aad3d2" containerName="maas-api"
Jul 20 13:30:07.980636 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:07.980500    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c5b45b6-8290-4db3-b2a3-ffeb3ce11c8e" containerName="maas-api"
Jul 20 13:30:07.980636 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:07.980511    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="93ca3997-459d-4d63-bbd2-777ba45811fd" containerName="test-curl-7675-140232302213712"
Jul 20 13:30:07.980636 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:07.980517    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="969dfcc8-46f1-46ce-bba6-fc7b76aad3d2" containerName="maas-api"
Jul 20 13:30:07.983810 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:07.983792    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-478p7/must-gather-vrbm4"
Jul 20 13:30:07.986897 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:07.986873    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-478p7\"/\"openshift-service-ca.crt\""
Jul 20 13:30:07.987023 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:07.986923    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-478p7\"/\"default-dockercfg-dd2k8\""
Jul 20 13:30:07.988668 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:07.988646    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-478p7\"/\"kube-root-ca.crt\""
Jul 20 13:30:07.992013 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:07.991980    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-478p7/must-gather-vrbm4"]
Jul 20 13:30:08.066590 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:08.066553    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pbh6\" (UniqueName: \"kubernetes.io/projected/200fd47b-ff76-45b9-b66b-9360e7e91690-kube-api-access-4pbh6\") pod \"must-gather-vrbm4\" (UID: \"200fd47b-ff76-45b9-b66b-9360e7e91690\") " pod="openshift-must-gather-478p7/must-gather-vrbm4"
Jul 20 13:30:08.066756 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:08.066596    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/200fd47b-ff76-45b9-b66b-9360e7e91690-must-gather-output\") pod \"must-gather-vrbm4\" (UID: \"200fd47b-ff76-45b9-b66b-9360e7e91690\") " pod="openshift-must-gather-478p7/must-gather-vrbm4"
Jul 20 13:30:08.167255 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:08.167215    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pbh6\" (UniqueName: \"kubernetes.io/projected/200fd47b-ff76-45b9-b66b-9360e7e91690-kube-api-access-4pbh6\") pod \"must-gather-vrbm4\" (UID: \"200fd47b-ff76-45b9-b66b-9360e7e91690\") " pod="openshift-must-gather-478p7/must-gather-vrbm4"
Jul 20 13:30:08.167255 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:08.167258    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/200fd47b-ff76-45b9-b66b-9360e7e91690-must-gather-output\") pod \"must-gather-vrbm4\" (UID: \"200fd47b-ff76-45b9-b66b-9360e7e91690\") " pod="openshift-must-gather-478p7/must-gather-vrbm4"
Jul 20 13:30:08.167655 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:08.167634    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/200fd47b-ff76-45b9-b66b-9360e7e91690-must-gather-output\") pod \"must-gather-vrbm4\" (UID: \"200fd47b-ff76-45b9-b66b-9360e7e91690\") " pod="openshift-must-gather-478p7/must-gather-vrbm4"
Jul 20 13:30:08.176136 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:08.176112    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pbh6\" (UniqueName: \"kubernetes.io/projected/200fd47b-ff76-45b9-b66b-9360e7e91690-kube-api-access-4pbh6\") pod \"must-gather-vrbm4\" (UID: \"200fd47b-ff76-45b9-b66b-9360e7e91690\") " pod="openshift-must-gather-478p7/must-gather-vrbm4"
Jul 20 13:30:08.294433 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:08.294343    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-478p7/must-gather-vrbm4"
Jul 20 13:30:08.430156 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:08.430129    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-478p7/must-gather-vrbm4"]
Jul 20 13:30:08.432282 ip-10-0-139-1 kubenswrapper[2570]: W0720 13:30:08.432252    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod200fd47b_ff76_45b9_b66b_9360e7e91690.slice/crio-c18709dcffcc82477f39819135fef9dee2420fb044751a49cbe3403e8f8a6d9c WatchSource:0}: Error finding container c18709dcffcc82477f39819135fef9dee2420fb044751a49cbe3403e8f8a6d9c: Status 404 returned error can't find the container with id c18709dcffcc82477f39819135fef9dee2420fb044751a49cbe3403e8f8a6d9c
Jul 20 13:30:08.695520 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:08.695481    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-478p7/must-gather-vrbm4" event={"ID":"200fd47b-ff76-45b9-b66b-9360e7e91690","Type":"ContainerStarted","Data":"c18709dcffcc82477f39819135fef9dee2420fb044751a49cbe3403e8f8a6d9c"}
Jul 20 13:30:09.705392 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:09.705360    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-478p7/must-gather-vrbm4" event={"ID":"200fd47b-ff76-45b9-b66b-9360e7e91690","Type":"ContainerStarted","Data":"8a4c8674beaf9d8f198e1aaf896201980a2a0f6d911e98778b0dae72426b951c"}
Jul 20 13:30:09.723876 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:09.723801    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-478p7/must-gather-vrbm4" podStartSLOduration=1.653852783 podStartE2EDuration="2.723785949s" totalImagesPullingTime="1.069933166s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:30:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:30:09.723265231 +0000 UTC m=+2722.478314607" watchObservedRunningTime="2026-07-20 13:30:09.723785949 +0000 UTC m=+2722.478835324"
Jul 20 13:30:10.712104 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:10.712054    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-478p7/must-gather-vrbm4" event={"ID":"200fd47b-ff76-45b9-b66b-9360e7e91690","Type":"ContainerStarted","Data":"b7a9939e47e5c8c57d89c78cdd31d66c44bd3763dc6b4caaa11898d02e750c5c"}
Jul 20 13:30:10.985658 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:10.985582    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4dkkp_5fbafa93-14fa-41b3-a202-eb69336c381e/global-pull-secret-syncer/0.log"
Jul 20 13:30:11.178533 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:11.178495    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-w7hxf_1590374e-47ea-4c52-8ad0-c84873ec14c6/konnectivity-agent/0.log"
Jul 20 13:30:11.200391 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:11.200356    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-1.ec2.internal_4359bec0e352431350db386bdadf6398/haproxy/0.log"
Jul 20 13:30:15.695073 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:15.695036    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759chl99_fee12997-021f-4fd9-96a4-4632a0f07969/extract/0.log"
Jul 20 13:30:15.721197 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:15.721165    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759chl99_fee12997-021f-4fd9-96a4-4632a0f07969/util/0.log"
Jul 20 13:30:15.744475 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:15.744442    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759chl99_fee12997-021f-4fd9-96a4-4632a0f07969/pull/0.log"
Jul 20 13:30:15.767365 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:15.767318    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dtpgc_9ef2af62-3e2b-4e88-ba17-8affdc9d2226/extract/0.log"
Jul 20 13:30:15.786240 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:15.786209    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dtpgc_9ef2af62-3e2b-4e88-ba17-8affdc9d2226/util/0.log"
Jul 20 13:30:15.808266 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:15.808233    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dtpgc_9ef2af62-3e2b-4e88-ba17-8affdc9d2226/pull/0.log"
Jul 20 13:30:15.836912 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:15.836878    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2fdg_5c1d6720-3bdc-4419-bb82-90117eceb44a/extract/0.log"
Jul 20 13:30:15.854032 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:15.854000    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2fdg_5c1d6720-3bdc-4419-bb82-90117eceb44a/util/0.log"
Jul 20 13:30:15.878571 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:15.878540    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2fdg_5c1d6720-3bdc-4419-bb82-90117eceb44a/pull/0.log"
Jul 20 13:30:15.905545 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:15.905494    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkf72_0b227a2c-e778-44ee-9edd-f2a9d8ca501e/extract/0.log"
Jul 20 13:30:15.922517 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:15.922484    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkf72_0b227a2c-e778-44ee-9edd-f2a9d8ca501e/util/0.log"
Jul 20 13:30:15.941353 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:15.941308    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gkf72_0b227a2c-e778-44ee-9edd-f2a9d8ca501e/pull/0.log"
Jul 20 13:30:16.530352 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:16.530130    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-57c99db69b-2nsd5_0d1869d9-5ed5-4613-84cf-6e55baf96c75/authorino/0.log"
Jul 20 13:30:16.983527 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:16.983481    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-hhqng_53b7e07c-125f-4528-9d5e-0dbe45216d74/manager/0.log"
Jul 20 13:30:18.567120 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:18.567054    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5a6ac1d0-513c-467e-94f9-fa4730f7e5c3/alertmanager/0.log"
Jul 20 13:30:18.589105 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:18.588692    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5a6ac1d0-513c-467e-94f9-fa4730f7e5c3/config-reloader/0.log"
Jul 20 13:30:18.608497 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:18.608403    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5a6ac1d0-513c-467e-94f9-fa4730f7e5c3/kube-rbac-proxy-web/0.log"
Jul 20 13:30:18.631611 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:18.631569    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5a6ac1d0-513c-467e-94f9-fa4730f7e5c3/kube-rbac-proxy/0.log"
Jul 20 13:30:18.651701 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:18.651672    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5a6ac1d0-513c-467e-94f9-fa4730f7e5c3/kube-rbac-proxy-metric/0.log"
Jul 20 13:30:18.670986 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:18.670949    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5a6ac1d0-513c-467e-94f9-fa4730f7e5c3/prom-label-proxy/0.log"
Jul 20 13:30:18.690408 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:18.690383    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5a6ac1d0-513c-467e-94f9-fa4730f7e5c3/init-config-reloader/0.log"
Jul 20 13:30:18.772603 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:18.772567    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-swlsc_08dfd872-07ac-491c-b319-6e8da15c7389/kube-state-metrics/0.log"
Jul 20 13:30:18.789106 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:18.789064    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-swlsc_08dfd872-07ac-491c-b319-6e8da15c7389/kube-rbac-proxy-main/0.log"
Jul 20 13:30:18.809480 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:18.809449    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-swlsc_08dfd872-07ac-491c-b319-6e8da15c7389/kube-rbac-proxy-self/0.log"
Jul 20 13:30:18.840370 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:18.840340    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5cc85db8b5-6q5mm_25199219-4d87-4b02-aa1b-fa90bce96534/metrics-server/0.log"
Jul 20 13:30:18.864128 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:18.864034    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-kxx8r_31fbd371-0bef-4a1b-b1b3-ad2bc3326531/monitoring-plugin/0.log"
Jul 20 13:30:18.989186 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:18.989157    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hmvmr_6c299747-8d0e-4a67-a268-1e81740c43be/node-exporter/0.log"
Jul 20 13:30:19.010192 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:19.010160    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hmvmr_6c299747-8d0e-4a67-a268-1e81740c43be/kube-rbac-proxy/0.log"
Jul 20 13:30:19.028833 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:19.028630    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hmvmr_6c299747-8d0e-4a67-a268-1e81740c43be/init-textfile/0.log"
Jul 20 13:30:19.119470 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:19.119362    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-pnvnz_2e777b21-974d-41a0-ae44-143b5039300b/kube-rbac-proxy-main/0.log"
Jul 20 13:30:19.137138 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:19.137107    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-pnvnz_2e777b21-974d-41a0-ae44-143b5039300b/kube-rbac-proxy-self/0.log"
Jul 20 13:30:19.155566 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:19.155494    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-pnvnz_2e777b21-974d-41a0-ae44-143b5039300b/openshift-state-metrics/0.log"
Jul 20 13:30:19.367052 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:19.367018    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-ckq4q_9520cffc-4076-44fb-ac67-6ebf0bb879ca/prometheus-operator/0.log"
Jul 20 13:30:19.381843 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:19.381720    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-ckq4q_9520cffc-4076-44fb-ac67-6ebf0bb879ca/kube-rbac-proxy/0.log"
Jul 20 13:30:19.402351 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:19.402320    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-lx846_865e4acd-c06d-4d59-bbfa-8f10bf0d1115/prometheus-operator-admission-webhook/0.log"
Jul 20 13:30:19.429947 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:19.429916    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7887f4667d-pvnj4_61ae98cd-ecaa-4d2b-a9c5-bd0531eb143d/telemeter-client/0.log"
Jul 20 13:30:19.449034 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:19.449005    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7887f4667d-pvnj4_61ae98cd-ecaa-4d2b-a9c5-bd0531eb143d/reload/0.log"
Jul 20 13:30:19.466536 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:19.466505    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7887f4667d-pvnj4_61ae98cd-ecaa-4d2b-a9c5-bd0531eb143d/kube-rbac-proxy/0.log"
Jul 20 13:30:19.499247 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:19.499213    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67845f5c74-zgtqw_8becd856-1e60-4ce1-9390-2584e406f13e/thanos-query/0.log"
Jul 20 13:30:19.517585 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:19.517558    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67845f5c74-zgtqw_8becd856-1e60-4ce1-9390-2584e406f13e/kube-rbac-proxy-web/0.log"
Jul 20 13:30:19.543895 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:19.543859    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67845f5c74-zgtqw_8becd856-1e60-4ce1-9390-2584e406f13e/kube-rbac-proxy/0.log"
Jul 20 13:30:19.564501 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:19.564437    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67845f5c74-zgtqw_8becd856-1e60-4ce1-9390-2584e406f13e/prom-label-proxy/0.log"
Jul 20 13:30:19.587562 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:19.587533    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67845f5c74-zgtqw_8becd856-1e60-4ce1-9390-2584e406f13e/kube-rbac-proxy-rules/0.log"
Jul 20 13:30:19.608353 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:19.608316    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67845f5c74-zgtqw_8becd856-1e60-4ce1-9390-2584e406f13e/kube-rbac-proxy-metrics/0.log"
Jul 20 13:30:21.360859 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:21.360812    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-478p7/perf-node-gather-daemonset-gsg55"]
Jul 20 13:30:21.367004 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:21.366972    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-478p7/perf-node-gather-daemonset-gsg55"
Jul 20 13:30:21.375469 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:21.375440    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-478p7/perf-node-gather-daemonset-gsg55"]
Jul 20 13:30:21.528467 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:21.528430    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a576b02b-0cad-4aed-83de-a10bbf553828-lib-modules\") pod \"perf-node-gather-daemonset-gsg55\" (UID: \"a576b02b-0cad-4aed-83de-a10bbf553828\") " pod="openshift-must-gather-478p7/perf-node-gather-daemonset-gsg55"
Jul 20 13:30:21.528630 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:21.528489    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a576b02b-0cad-4aed-83de-a10bbf553828-sys\") pod \"perf-node-gather-daemonset-gsg55\" (UID: \"a576b02b-0cad-4aed-83de-a10bbf553828\") " pod="openshift-must-gather-478p7/perf-node-gather-daemonset-gsg55"
Jul 20 13:30:21.528630 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:21.528524    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t86bz\" (UniqueName: \"kubernetes.io/projected/a576b02b-0cad-4aed-83de-a10bbf553828-kube-api-access-t86bz\") pod \"perf-node-gather-daemonset-gsg55\" (UID: \"a576b02b-0cad-4aed-83de-a10bbf553828\") " pod="openshift-must-gather-478p7/perf-node-gather-daemonset-gsg55"
Jul 20 13:30:21.528630 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:21.528551    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a576b02b-0cad-4aed-83de-a10bbf553828-proc\") pod \"perf-node-gather-daemonset-gsg55\" (UID: \"a576b02b-0cad-4aed-83de-a10bbf553828\") " pod="openshift-must-gather-478p7/perf-node-gather-daemonset-gsg55"
Jul 20 13:30:21.528769 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:21.528727    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a576b02b-0cad-4aed-83de-a10bbf553828-podres\") pod \"perf-node-gather-daemonset-gsg55\" (UID: \"a576b02b-0cad-4aed-83de-a10bbf553828\") " pod="openshift-must-gather-478p7/perf-node-gather-daemonset-gsg55"
Jul 20 13:30:21.629550 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:21.629466    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a576b02b-0cad-4aed-83de-a10bbf553828-lib-modules\") pod \"perf-node-gather-daemonset-gsg55\" (UID: \"a576b02b-0cad-4aed-83de-a10bbf553828\") " pod="openshift-must-gather-478p7/perf-node-gather-daemonset-gsg55"
Jul 20 13:30:21.629550 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:21.629529    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a576b02b-0cad-4aed-83de-a10bbf553828-sys\") pod \"perf-node-gather-daemonset-gsg55\" (UID: \"a576b02b-0cad-4aed-83de-a10bbf553828\") " pod="openshift-must-gather-478p7/perf-node-gather-daemonset-gsg55"
Jul 20 13:30:21.629777 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:21.629564    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t86bz\" (UniqueName: \"kubernetes.io/projected/a576b02b-0cad-4aed-83de-a10bbf553828-kube-api-access-t86bz\") pod \"perf-node-gather-daemonset-gsg55\" (UID: \"a576b02b-0cad-4aed-83de-a10bbf553828\") " pod="openshift-must-gather-478p7/perf-node-gather-daemonset-gsg55"
Jul 20 13:30:21.629777 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:21.629591    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a576b02b-0cad-4aed-83de-a10bbf553828-proc\") pod \"perf-node-gather-daemonset-gsg55\" (UID: \"a576b02b-0cad-4aed-83de-a10bbf553828\") " pod="openshift-must-gather-478p7/perf-node-gather-daemonset-gsg55"
Jul 20 13:30:21.629777 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:21.629657    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a576b02b-0cad-4aed-83de-a10bbf553828-podres\") pod \"perf-node-gather-daemonset-gsg55\" (UID: \"a576b02b-0cad-4aed-83de-a10bbf553828\") " pod="openshift-must-gather-478p7/perf-node-gather-daemonset-gsg55"
Jul 20 13:30:21.629943 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:21.629852    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a576b02b-0cad-4aed-83de-a10bbf553828-podres\") pod \"perf-node-gather-daemonset-gsg55\" (UID: \"a576b02b-0cad-4aed-83de-a10bbf553828\") " pod="openshift-must-gather-478p7/perf-node-gather-daemonset-gsg55"
Jul 20 13:30:21.629999 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:21.629960    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a576b02b-0cad-4aed-83de-a10bbf553828-lib-modules\") pod \"perf-node-gather-daemonset-gsg55\" (UID: \"a576b02b-0cad-4aed-83de-a10bbf553828\") " pod="openshift-must-gather-478p7/perf-node-gather-daemonset-gsg55"
Jul 20 13:30:21.630056 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:21.630010    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a576b02b-0cad-4aed-83de-a10bbf553828-sys\") pod \"perf-node-gather-daemonset-gsg55\" (UID: \"a576b02b-0cad-4aed-83de-a10bbf553828\") " pod="openshift-must-gather-478p7/perf-node-gather-daemonset-gsg55"
Jul 20 13:30:21.630383 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:21.630356    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a576b02b-0cad-4aed-83de-a10bbf553828-proc\") pod \"perf-node-gather-daemonset-gsg55\" (UID: \"a576b02b-0cad-4aed-83de-a10bbf553828\") " pod="openshift-must-gather-478p7/perf-node-gather-daemonset-gsg55"
Jul 20 13:30:21.649754 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:21.649726    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t86bz\" (UniqueName: \"kubernetes.io/projected/a576b02b-0cad-4aed-83de-a10bbf553828-kube-api-access-t86bz\") pod \"perf-node-gather-daemonset-gsg55\" (UID: \"a576b02b-0cad-4aed-83de-a10bbf553828\") " pod="openshift-must-gather-478p7/perf-node-gather-daemonset-gsg55"
Jul 20 13:30:21.683748 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:21.683715    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-478p7/perf-node-gather-daemonset-gsg55"
Jul 20 13:30:21.879110 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:21.877545    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-478p7/perf-node-gather-daemonset-gsg55"]
Jul 20 13:30:21.948678 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:21.948651    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5cbf78c6c8-f6fg7_c8982f6d-fe40-4b9f-acb2-e0479edd1be2/console/0.log"
Jul 20 13:30:22.821651 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:22.821617    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-478p7/perf-node-gather-daemonset-gsg55" event={"ID":"a576b02b-0cad-4aed-83de-a10bbf553828","Type":"ContainerStarted","Data":"3a8d3e8087f93798377a323adb36e7faaaf08666d065e9e4375ba0ecc083658d"}
Jul 20 13:30:22.822352 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:22.822325    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-478p7/perf-node-gather-daemonset-gsg55" event={"ID":"a576b02b-0cad-4aed-83de-a10bbf553828","Type":"ContainerStarted","Data":"6278af8627788c8d03af551eeafc52955c04ea784f1efabeaede6286e65f3234"}
Jul 20 13:30:22.822564 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:22.822547    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-478p7/perf-node-gather-daemonset-gsg55"
Jul 20 13:30:22.842598 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:22.842525    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-478p7/perf-node-gather-daemonset-gsg55" podStartSLOduration=1.8425083199999999 podStartE2EDuration="1.84250832s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 13:30:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:30:22.839939263 +0000 UTC m=+2735.594988638" watchObservedRunningTime="2026-07-20 13:30:22.84250832 +0000 UTC m=+2735.597557696"
Jul 20 13:30:23.561694 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:23.561663    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4j5kp_8243bed4-dbd7-4ccc-8213-ffa3cc38186b/dns/0.log"
Jul 20 13:30:23.579003 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:23.578978    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4j5kp_8243bed4-dbd7-4ccc-8213-ffa3cc38186b/kube-rbac-proxy/0.log"
Jul 20 13:30:23.710135 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:23.710060    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qvfnf_591fe657-5268-4a39-b559-48e285b8e064/dns-node-resolver/0.log"
Jul 20 13:30:24.247234 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:24.247197    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bmw8t_6f1bf356-0007-494d-af6b-f42d5333291b/node-ca/0.log"
Jul 20 13:30:25.493020 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:25.492992    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f7c7fb896-pvwl4_488d8e8c-3ca2-4219-a5c0-49979811aca3/kube-auth-proxy/0.log"
Jul 20 13:30:26.419633 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:26.419603    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mfd9m_7c51dab3-18c7-4abf-88e9-15fbb2925c88/serve-healthcheck-canary/0.log"
Jul 20 13:30:27.026365 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:27.026313    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mvxsr_794df699-efc3-4d10-baf2-2ea2ee8e730e/kube-rbac-proxy/0.log"
Jul 20 13:30:27.046120 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:27.046073    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mvxsr_794df699-efc3-4d10-baf2-2ea2ee8e730e/exporter/0.log"
Jul 20 13:30:27.067114 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:27.067070    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mvxsr_794df699-efc3-4d10-baf2-2ea2ee8e730e/extractor/0.log"
Jul 20 13:30:29.798435 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:29.798401    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-749978ccd7-6pbjc_8d136b15-3a4c-4cd5-a6e4-4eaade21228f/manager/0.log"
Jul 20 13:30:29.812550 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:29.812527    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-749978ccd7-6pbjc_8d136b15-3a4c-4cd5-a6e4-4eaade21228f/copy-manifests/0.log"
Jul 20 13:30:29.851447 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:29.851422    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-478p7/perf-node-gather-daemonset-gsg55"
Jul 20 13:30:31.214827 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:31.214793    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-586f8df4c4-jd467_80c0c028-76ed-4205-9ed2-461e38af3501/manager/0.log"
Jul 20 13:30:31.272900 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:31.272872    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f7c7fb896-pvwl4_488d8e8c-3ca2-4219-a5c0-49979811aca3/kube-auth-proxy/0.log"
Jul 20 13:30:32.976708 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:32.976675    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f7c7fb896-pvwl4_488d8e8c-3ca2-4219-a5c0-49979811aca3/kube-auth-proxy/0.log"
Jul 20 13:30:37.582591 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:37.582555    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5fvsm_f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825/kube-multus-additional-cni-plugins/0.log"
Jul 20 13:30:37.601784 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:37.601756    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5fvsm_f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825/egress-router-binary-copy/0.log"
Jul 20 13:30:37.619319 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:37.619293    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5fvsm_f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825/cni-plugins/0.log"
Jul 20 13:30:37.638636 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:37.638614    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5fvsm_f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825/bond-cni-plugin/0.log"
Jul 20 13:30:37.657363 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:37.657338    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5fvsm_f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825/routeoverride-cni/0.log"
Jul 20 13:30:37.674852 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:37.674833    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5fvsm_f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825/whereabouts-cni-bincopy/0.log"
Jul 20 13:30:37.694384 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:37.694359    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5fvsm_f7b2c7e2-c533-483d-a2ed-d6f1c2ffb825/whereabouts-cni/0.log"
Jul 20 13:30:38.096355 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:38.096319    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wphvm_5597d831-70ad-4f2c-803d-8775135e6215/kube-multus/0.log"
Jul 20 13:30:38.161826 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:38.161796    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gn69x_d5e87d68-a096-452b-a6b3-c0815771c37d/network-metrics-daemon/0.log"
Jul 20 13:30:38.180185 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:38.180146    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gn69x_d5e87d68-a096-452b-a6b3-c0815771c37d/kube-rbac-proxy/0.log"
Jul 20 13:30:39.285481 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:39.285441    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rhdn8_5efe9094-763c-4689-85b7-83e0ccb19811/ovn-controller/0.log"
Jul 20 13:30:39.300192 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:39.300161    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rhdn8_5efe9094-763c-4689-85b7-83e0ccb19811/ovn-acl-logging/0.log"
Jul 20 13:30:39.300347 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:39.300286    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rhdn8_5efe9094-763c-4689-85b7-83e0ccb19811/ovn-acl-logging/1.log"
Jul 20 13:30:39.315928 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:39.315902    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rhdn8_5efe9094-763c-4689-85b7-83e0ccb19811/kube-rbac-proxy-node/0.log"
Jul 20 13:30:39.333804 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:39.333745    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rhdn8_5efe9094-763c-4689-85b7-83e0ccb19811/kube-rbac-proxy-ovn-metrics/0.log"
Jul 20 13:30:39.349383 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:39.349359    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rhdn8_5efe9094-763c-4689-85b7-83e0ccb19811/northd/0.log"
Jul 20 13:30:39.366033 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:39.366010    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rhdn8_5efe9094-763c-4689-85b7-83e0ccb19811/nbdb/0.log"
Jul 20 13:30:39.383314 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:39.383289    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rhdn8_5efe9094-763c-4689-85b7-83e0ccb19811/sbdb/0.log"
Jul 20 13:30:39.475236 ip-10-0-139-1 kubenswrapper[2570]: I0720 13:30:39.475206    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rhdn8_5efe9094-763c-4689-85b7-83e0ccb19811/ovnkube-controller/0.log"