Jul 15 12:08:58.121609 ip-10-0-133-186 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 15 12:08:58.121624 ip-10-0-133-186 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 15 12:08:58.121635 ip-10-0-133-186 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 15 12:08:58.121968 ip-10-0-133-186 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 15 12:09:09.257346 ip-10-0-133-186 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 15 12:09:09.257366 ip-10-0-133-186 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 1bd5cd09f70e4807802b6040ed09f798 --
Jul 15 12:10:52.759567 ip-10-0-133-186 systemd[1]: Starting Kubernetes Kubelet...
Jul 15 12:10:53.202866 ip-10-0-133-186 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 12:10:53.202866 ip-10-0-133-186 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 15 12:10:53.202866 ip-10-0-133-186 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 12:10:53.202866 ip-10-0-133-186 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 15 12:10:53.202866 ip-10-0-133-186 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 12:10:53.205691 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.205603    2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 15 12:10:53.213006 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.212990    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 12:10:53.213006 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213005    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 12:10:53.213069 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213010    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 12:10:53.213069 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213013    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 12:10:53.213069 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213016    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 12:10:53.213069 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213019    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 12:10:53.213069 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213022    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 12:10:53.213069 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213026    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 12:10:53.213069 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213029    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 12:10:53.213069 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213031    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 12:10:53.213069 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213036    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 12:10:53.213069 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213040    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 12:10:53.213069 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213042    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 12:10:53.213069 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213045    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 12:10:53.213069 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213048    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 12:10:53.213069 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213050    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 12:10:53.213069 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213058    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 12:10:53.213069 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213061    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 12:10:53.213069 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213063    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 12:10:53.213069 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213065    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 12:10:53.213069 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213068    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 12:10:53.213523 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213071    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 12:10:53.213523 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213074    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 12:10:53.213523 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213098    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 12:10:53.213523 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213103    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 12:10:53.213523 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213106    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 12:10:53.213523 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213109    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 12:10:53.213523 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213114    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 12:10:53.213523 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213117    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 12:10:53.213523 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213120    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 12:10:53.213523 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213123    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 12:10:53.213523 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213126    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 12:10:53.213523 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213128    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 12:10:53.213523 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213131    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 12:10:53.213523 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213136    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 12:10:53.213523 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213139    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 12:10:53.213523 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213142    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 12:10:53.213523 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213145    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 12:10:53.213523 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213148    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 12:10:53.213523 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213150    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 12:10:53.213985 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213153    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 12:10:53.213985 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213156    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 12:10:53.213985 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213159    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 12:10:53.213985 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213163    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 12:10:53.213985 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213165    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 12:10:53.213985 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213168    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 12:10:53.213985 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213171    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 12:10:53.213985 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213173    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 12:10:53.213985 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213176    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 12:10:53.213985 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213178    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 12:10:53.213985 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213181    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 12:10:53.213985 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213183    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 12:10:53.213985 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213186    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 12:10:53.213985 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213189    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 12:10:53.213985 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213192    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 12:10:53.213985 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213195    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 12:10:53.213985 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213198    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 12:10:53.213985 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213200    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 12:10:53.213985 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213203    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 12:10:53.213985 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213205    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 12:10:53.214481 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213208    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 12:10:53.214481 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213211    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 12:10:53.214481 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213214    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 12:10:53.214481 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213217    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 12:10:53.214481 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213219    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 12:10:53.214481 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213222    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 12:10:53.214481 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213224    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 12:10:53.214481 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213227    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 12:10:53.214481 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213229    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 12:10:53.214481 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213232    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 12:10:53.214481 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213234    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 12:10:53.214481 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213237    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 12:10:53.214481 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213241    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 12:10:53.214481 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213243    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 12:10:53.214481 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213246    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 12:10:53.214481 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213248    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 12:10:53.214481 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213251    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 12:10:53.214481 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213253    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 12:10:53.214481 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213257    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 12:10:53.214481 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213260    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 12:10:53.214945 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213262    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 12:10:53.214945 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213265    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 12:10:53.214945 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213267    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 12:10:53.214945 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213270    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 12:10:53.214945 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213272    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 12:10:53.214945 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213275    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 12:10:53.214945 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213278    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 12:10:53.214945 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213281    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 12:10:53.214945 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213283    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 12:10:53.214945 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213286    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 12:10:53.214945 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213300    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 12:10:53.214945 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213305    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 12:10:53.214945 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213309    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 12:10:53.214945 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213314    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 12:10:53.214945 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213317    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 12:10:53.214945 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213320    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 12:10:53.214945 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213322    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 12:10:53.214945 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213325    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 12:10:53.214945 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.213328    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 12:10:53.214945 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214035    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 12:10:53.215430 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214042    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 12:10:53.215430 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214045    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 12:10:53.215430 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214048    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 12:10:53.215430 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214051    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 12:10:53.215430 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214053    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 12:10:53.215430 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214056    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 12:10:53.215430 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214059    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 12:10:53.215430 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214062    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 12:10:53.215430 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214065    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 12:10:53.215430 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214068    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 12:10:53.215430 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214073    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 12:10:53.215430 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214077    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 12:10:53.215430 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214080    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 12:10:53.215430 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214083    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 12:10:53.215430 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214086    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 12:10:53.215430 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214089    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 12:10:53.215430 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214091    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 12:10:53.215430 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214094    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 12:10:53.215430 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214097    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 12:10:53.215888 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214099    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 12:10:53.215888 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214102    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 12:10:53.215888 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214105    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 12:10:53.215888 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214107    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 12:10:53.215888 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214110    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 12:10:53.215888 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214112    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 12:10:53.215888 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214115    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 12:10:53.215888 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214118    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 12:10:53.215888 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214121    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 12:10:53.215888 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214123    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 12:10:53.215888 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214125    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 12:10:53.215888 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214128    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 12:10:53.215888 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214130    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 12:10:53.215888 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214133    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 12:10:53.215888 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214135    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 12:10:53.215888 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214138    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 12:10:53.215888 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214140    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 12:10:53.215888 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214143    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 12:10:53.215888 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214145    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 12:10:53.215888 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214148    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 12:10:53.216378 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214151    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 12:10:53.216378 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214153    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 12:10:53.216378 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214157    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 12:10:53.216378 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214161    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 12:10:53.216378 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214163    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 12:10:53.216378 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214166    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 12:10:53.216378 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214168    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 12:10:53.216378 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214171    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 12:10:53.216378 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214173    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 12:10:53.216378 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214176    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 12:10:53.216378 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214178    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 12:10:53.216378 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214180    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 12:10:53.216378 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214183    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 12:10:53.216378 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214185    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 12:10:53.216378 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214188    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 12:10:53.216378 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214191    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 12:10:53.216378 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214195    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 12:10:53.216378 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214198    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 12:10:53.216378 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214201    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 12:10:53.216837 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214205    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 12:10:53.216837 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214207    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 12:10:53.216837 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214210    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 12:10:53.216837 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214213    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 12:10:53.216837 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214216    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 12:10:53.216837 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214218    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 12:10:53.216837 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214221    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 12:10:53.216837 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214223    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 12:10:53.216837 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214226    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 12:10:53.216837 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214229    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 12:10:53.216837 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214231    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 12:10:53.216837 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214234    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 12:10:53.216837 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214237    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 12:10:53.216837 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214240    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 12:10:53.216837 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214242    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 12:10:53.216837 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214245    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 12:10:53.216837 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214248    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 12:10:53.216837 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214251    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 12:10:53.216837 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214253    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 12:10:53.216837 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214256    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 12:10:53.217352 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214258    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 12:10:53.217352 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214260    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 12:10:53.217352 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214263    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 12:10:53.217352 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214265    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 12:10:53.217352 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214268    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 12:10:53.217352 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214270    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 12:10:53.217352 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214272    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 12:10:53.217352 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214275    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 12:10:53.217352 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214277    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 12:10:53.217352 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214280    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 12:10:53.217352 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214282    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 12:10:53.217352 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214285    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 12:10:53.217352 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214289    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 12:10:53.217352 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214302    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 12:10:53.217352 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214305    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 12:10:53.217352 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214308    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 12:10:53.217352 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214310    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 12:10:53.217352 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214313    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 12:10:53.217352 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214315    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 12:10:53.217352 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214318    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 12:10:53.217837 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214696    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 12:10:53.217837 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214701    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 12:10:53.217837 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214704    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 12:10:53.217837 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214707    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 12:10:53.217837 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214710    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 12:10:53.217837 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214713    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 12:10:53.217837 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214717    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 12:10:53.217837 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214719    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 12:10:53.217837 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214722    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 12:10:53.217837 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214725    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 12:10:53.217837 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214728    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 12:10:53.217837 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214730    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 12:10:53.217837 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214733    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 12:10:53.217837 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214735    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 12:10:53.217837 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214738    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 12:10:53.217837 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214741    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 12:10:53.217837 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214744    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 12:10:53.217837 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214748    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 12:10:53.217837 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214751    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 12:10:53.217837 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214754    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 12:10:53.218327 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214756    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 12:10:53.218327 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214759    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 12:10:53.218327 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214763    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 12:10:53.218327 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214765    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 12:10:53.218327 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214767    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 12:10:53.218327 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214770    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 12:10:53.218327 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214773    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 12:10:53.218327 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214776    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 12:10:53.218327 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214779    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 12:10:53.218327 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214781    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 12:10:53.218327 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214783    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 12:10:53.218327 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214786    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 12:10:53.218327 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214788    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 12:10:53.218327 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214791    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 12:10:53.218327 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214793    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 12:10:53.218327 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214796    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 12:10:53.218327 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214799    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 12:10:53.218327 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214801    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 12:10:53.218327 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214804    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 12:10:53.218327 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214807    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 12:10:53.218839 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214809    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 12:10:53.218839 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214812    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 12:10:53.218839 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214815    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 12:10:53.218839 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214819    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 12:10:53.218839 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214822    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 12:10:53.218839 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214825    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 12:10:53.218839 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214828    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 12:10:53.218839 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214831    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 12:10:53.218839 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214834    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 12:10:53.218839 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214837    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 12:10:53.218839 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214840    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 12:10:53.218839 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214842    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 12:10:53.218839 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214845    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 12:10:53.218839 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214847    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 12:10:53.218839 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214850    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 12:10:53.218839 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214852    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 12:10:53.218839 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214855    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 12:10:53.218839 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214857    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 12:10:53.218839 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214859    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 12:10:53.219288 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214862    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 12:10:53.219288 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214865    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 12:10:53.219288 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214867    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 12:10:53.219288 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214870    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 12:10:53.219288 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214872    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 12:10:53.219288 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214874    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 12:10:53.219288 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214877    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 12:10:53.219288 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214879    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 12:10:53.219288 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214883    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 12:10:53.219288 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214885    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 12:10:53.219288 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214888    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 12:10:53.219288 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214891    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 12:10:53.219288 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214893    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 12:10:53.219288 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214896    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 12:10:53.219288 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214898    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 12:10:53.219288 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214901    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 12:10:53.219288 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214904    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 12:10:53.219288 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214907    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 12:10:53.219288 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214909    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 12:10:53.219288 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214913    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 12:10:53.219819 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214916    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 12:10:53.219819 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214919    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 12:10:53.219819 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214922    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 12:10:53.219819 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214924    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 12:10:53.219819 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214927    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 12:10:53.219819 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214929    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 12:10:53.219819 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214932    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 12:10:53.219819 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214934    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 12:10:53.219819 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214937    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 12:10:53.219819 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214939    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 12:10:53.219819 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214942    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 12:10:53.219819 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214944    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 12:10:53.219819 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214947    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 12:10:53.219819 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214949    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 12:10:53.219819 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214952    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 12:10:53.219819 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214955    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 12:10:53.219819 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214958    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 12:10:53.219819 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214960    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 12:10:53.219819 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214963    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 12:10:53.219819 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.214965    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 12:10:53.220307 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215032    2560 flags.go:64] FLAG: --address="0.0.0.0"
Jul 15 12:10:53.220307 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215045    2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 15 12:10:53.220307 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215055    2560 flags.go:64] FLAG: --anonymous-auth="true"
Jul 15 12:10:53.220307 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215061    2560 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 15 12:10:53.220307 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215067    2560 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 15 12:10:53.220307 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215071    2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 15 12:10:53.220307 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215074    2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 15 12:10:53.220307 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215079    2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 15 12:10:53.220307 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215082    2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 15 12:10:53.220307 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215085    2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 15 12:10:53.220307 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215089    2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 15 12:10:53.220307 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215092    2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 15 12:10:53.220307 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215097    2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 15 12:10:53.220307 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215100    2560 flags.go:64] FLAG: --cgroup-root=""
Jul 15 12:10:53.220307 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215103    2560 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 15 12:10:53.220307 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215106    2560 flags.go:64] FLAG: --client-ca-file=""
Jul 15 12:10:53.220307 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215109    2560 flags.go:64] FLAG: --cloud-provider="external"
Jul 15 12:10:53.220307 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215112    2560 flags.go:64] FLAG: --cluster-dns="[]"
Jul 15 12:10:53.220307 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215116    2560 flags.go:64] FLAG: --cluster-domain=""
Jul 15 12:10:53.220307 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215119    2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 15 12:10:53.220307 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215122    2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 15 12:10:53.220307 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215125    2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 15 12:10:53.220307 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215129    2560 flags.go:64] FLAG: --container-log-max-files="5"
Jul 15 12:10:53.220307 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215132    2560 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 15 12:10:53.220874 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215135    2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 15 12:10:53.220874 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215138    2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 15 12:10:53.220874 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215142    2560 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 15 12:10:53.220874 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215145    2560 flags.go:64] FLAG: --contention-profiling="false"
Jul 15 12:10:53.220874 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215148    2560 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 15 12:10:53.220874 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215151    2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 15 12:10:53.220874 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215154    2560 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 15 12:10:53.220874 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215157    2560 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 15 12:10:53.220874 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215161    2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 15 12:10:53.220874 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215165    2560 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 15 12:10:53.220874 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215169    2560 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 15 12:10:53.220874 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215172    2560 flags.go:64] FLAG: --enable-load-reader="false"
Jul 15 12:10:53.220874 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215174    2560 flags.go:64] FLAG: --enable-server="true"
Jul 15 12:10:53.220874 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215177    2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 15 12:10:53.220874 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215182    2560 flags.go:64] FLAG: --event-burst="100"
Jul 15 12:10:53.220874 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215185    2560 flags.go:64] FLAG: --event-qps="50"
Jul 15 12:10:53.220874 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215188    2560 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 15 12:10:53.220874 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215191    2560 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 15 12:10:53.220874 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215194    2560 flags.go:64] FLAG: --eviction-hard=""
Jul 15 12:10:53.220874 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215198    2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 15 12:10:53.220874 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215202    2560 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 15 12:10:53.220874 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215205    2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 15 12:10:53.220874 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215208    2560 flags.go:64] FLAG: --eviction-soft=""
Jul 15 12:10:53.220874 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215210    2560 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 15 12:10:53.220874 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215213    2560 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 15 12:10:53.221593 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215216    2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 15 12:10:53.221593 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215219    2560 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 15 12:10:53.221593 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215222    2560 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 15 12:10:53.221593 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215225    2560 flags.go:64] FLAG: --fail-swap-on="true"
Jul 15 12:10:53.221593 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215228    2560 flags.go:64] FLAG: --feature-gates=""
Jul 15 12:10:53.221593 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215231    2560 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 15 12:10:53.221593 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215234    2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 15 12:10:53.221593 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215237    2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 15 12:10:53.221593 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215240    2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 15 12:10:53.221593 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215243    2560 flags.go:64] FLAG: --healthz-port="10248"
Jul 15 12:10:53.221593 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215246    2560 flags.go:64] FLAG: --help="false"
Jul 15 12:10:53.221593 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215249    2560 flags.go:64] FLAG: --hostname-override="ip-10-0-133-186.ec2.internal"
Jul 15 12:10:53.221593 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215252    2560 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 15 12:10:53.221593 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215255    2560 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 15 12:10:53.221593 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215258    2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 15 12:10:53.221593 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215261    2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 15 12:10:53.221593 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215265    2560 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 15 12:10:53.221593 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215268    2560 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 15 12:10:53.221593 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215271    2560 flags.go:64] FLAG: --image-service-endpoint=""
Jul 15 12:10:53.221593 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215274    2560 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 15 12:10:53.221593 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215276    2560 flags.go:64] FLAG: --kube-api-burst="100"
Jul 15 12:10:53.221593 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215279    2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 15 12:10:53.221593 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215282    2560 flags.go:64] FLAG: --kube-api-qps="50"
Jul 15 12:10:53.221593 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215285    2560 flags.go:64] FLAG: --kube-reserved=""
Jul 15 12:10:53.222187 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215288    2560 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 15 12:10:53.222187 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215306    2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 15 12:10:53.222187 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215312    2560 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 15 12:10:53.222187 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215319    2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 15 12:10:53.222187 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215323    2560 flags.go:64] FLAG: --lock-file=""
Jul 15 12:10:53.222187 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215328    2560 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 15 12:10:53.222187 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215332    2560 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 15 12:10:53.222187 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215336    2560 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 15 12:10:53.222187 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215341    2560 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 15 12:10:53.222187 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215344    2560 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 15 12:10:53.222187 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215347    2560 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 15 12:10:53.222187 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215349    2560 flags.go:64] FLAG: --logging-format="text"
Jul 15 12:10:53.222187 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215352    2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 15 12:10:53.222187 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215355    2560 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 15 12:10:53.222187 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215358    2560 flags.go:64] FLAG: --manifest-url=""
Jul 15 12:10:53.222187 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215361    2560 flags.go:64] FLAG: --manifest-url-header=""
Jul 15 12:10:53.222187 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215365    2560 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 15 12:10:53.222187 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215368    2560 flags.go:64] FLAG: --max-open-files="1000000"
Jul 15 12:10:53.222187 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215372    2560 flags.go:64] FLAG: --max-pods="110"
Jul 15 12:10:53.222187 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215375    2560 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 15 12:10:53.222187 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215378    2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 15 12:10:53.222187 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215381    2560 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 15 12:10:53.222187 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215384    2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 15 12:10:53.222187 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215387    2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 15 12:10:53.222187 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215391    2560 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 15 12:10:53.222796 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215394    2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 15 12:10:53.222796 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215401    2560 flags.go:64] FLAG: --node-status-max-images="50"
Jul 15 12:10:53.222796 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215404    2560 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 15 12:10:53.222796 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215407    2560 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 15 12:10:53.222796 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215410    2560 flags.go:64] FLAG: --pod-cidr=""
Jul 15 12:10:53.222796 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215413    2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 15 12:10:53.222796 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215419    2560 flags.go:64] FLAG: --pod-manifest-path=""
Jul 15 12:10:53.222796 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215422    2560 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 15 12:10:53.222796 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215425    2560 flags.go:64] FLAG: --pods-per-core="0"
Jul 15 12:10:53.222796 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215428    2560 flags.go:64] FLAG: --port="10250"
Jul 15 12:10:53.222796 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215433    2560 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 15 12:10:53.222796 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215436    2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b324e8fca4c0f242"
Jul 15 12:10:53.222796 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215439    2560 flags.go:64] FLAG: --qos-reserved=""
Jul 15 12:10:53.222796 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215442    2560 flags.go:64] FLAG: --read-only-port="10255"
Jul 15 12:10:53.222796 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215445    2560 flags.go:64] FLAG: --register-node="true"
Jul 15 12:10:53.222796 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215448    2560 flags.go:64] FLAG: --register-with-taints=""
Jul 15 12:10:53.222796 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215451    2560 flags.go:64] FLAG: --registry-burst="10"
Jul 15 12:10:53.222796 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215454    2560 flags.go:64] FLAG: --registry-qps="5"
Jul 15 12:10:53.222796 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215457    2560 flags.go:64] FLAG: --reserved-cpus=""
Jul 15 12:10:53.222796 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215460    2560 flags.go:64] FLAG: --reserved-memory=""
Jul 15 12:10:53.222796 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215464    2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 15 12:10:53.222796 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215467    2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 15 12:10:53.222796 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215469    2560 flags.go:64] FLAG: --rotate-certificates="false"
Jul 15 12:10:53.222796 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215472    2560 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 15 12:10:53.222796 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215475    2560 flags.go:64] FLAG: --runonce="false"
Jul 15 12:10:53.223459 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215478    2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 15 12:10:53.223459 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215481    2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 15 12:10:53.223459 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215484    2560 flags.go:64] FLAG: --seccomp-default="false"
Jul 15 12:10:53.223459 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215487    2560 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 15 12:10:53.223459 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215489    2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 15 12:10:53.223459 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215493    2560 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 15 12:10:53.223459 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215496    2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 15 12:10:53.223459 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215500    2560 flags.go:64] FLAG: --storage-driver-password="root"
Jul 15 12:10:53.223459 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215503    2560 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 15 12:10:53.223459 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215506    2560 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 15 12:10:53.223459 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215509    2560 flags.go:64] FLAG: --storage-driver-user="root"
Jul 15 12:10:53.223459 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215512    2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 15 12:10:53.223459 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215515    2560 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 15 12:10:53.223459 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215518    2560 flags.go:64] FLAG: --system-cgroups=""
Jul 15 12:10:53.223459 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215520    2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 15 12:10:53.223459 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215526    2560 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 15 12:10:53.223459 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215528    2560 flags.go:64] FLAG: --tls-cert-file=""
Jul 15 12:10:53.223459 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215533    2560 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 15 12:10:53.223459 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215537    2560 flags.go:64] FLAG: --tls-min-version=""
Jul 15 12:10:53.223459 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215540    2560 flags.go:64] FLAG: --tls-private-key-file=""
Jul 15 12:10:53.223459 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215543    2560 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 15 12:10:53.223459 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215546    2560 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 15 12:10:53.223459 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215548    2560 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 15 12:10:53.223459 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215551    2560 flags.go:64] FLAG: --v="2"
Jul 15 12:10:53.223459 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215555    2560 flags.go:64] FLAG: --version="false"
Jul 15 12:10:53.224329 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215559    2560 flags.go:64] FLAG: --vmodule=""
Jul 15 12:10:53.224329 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215563    2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 15 12:10:53.224329 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.215566    2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 15 12:10:53.224329 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216275    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 12:10:53.224329 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216280    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 12:10:53.224329 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216284    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 12:10:53.224329 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216287    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 12:10:53.224329 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216302    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 12:10:53.224329 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216306    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 12:10:53.224329 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216308    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 12:10:53.224329 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216311    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 12:10:53.224329 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216314    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 12:10:53.224329 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216317    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 12:10:53.224329 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216319    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 12:10:53.224329 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216323    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 12:10:53.224329 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216326    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 12:10:53.224329 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216329    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 12:10:53.224329 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216331    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 12:10:53.224329 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216334    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 12:10:53.224982 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216338    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 12:10:53.224982 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216342    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 12:10:53.224982 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216345    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 12:10:53.224982 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216348    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 12:10:53.224982 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216351    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 12:10:53.224982 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216355    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 12:10:53.224982 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216358    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 12:10:53.224982 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216361    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 12:10:53.224982 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216364    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 12:10:53.224982 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216366    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 12:10:53.224982 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216369    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 12:10:53.224982 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216372    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 12:10:53.224982 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216374    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 12:10:53.224982 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216377    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 12:10:53.224982 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216380    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 12:10:53.224982 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216382    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 12:10:53.224982 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216385    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 12:10:53.224982 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216388    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 12:10:53.224982 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216391    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 12:10:53.224982 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216394    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 12:10:53.225493 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216396    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 12:10:53.225493 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216399    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 12:10:53.225493 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216401    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 12:10:53.225493 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216404    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 12:10:53.225493 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216407    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 12:10:53.225493 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216410    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 12:10:53.225493 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216412    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 12:10:53.225493 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216416    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 12:10:53.225493 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216419    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 12:10:53.225493 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216421    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 12:10:53.225493 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216424    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 12:10:53.225493 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216427    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 12:10:53.225493 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216429    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 12:10:53.225493 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216432    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 12:10:53.225493 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216435    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 12:10:53.225493 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216437    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 12:10:53.225493 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216440    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 12:10:53.225493 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216443    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 12:10:53.225493 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216445    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 12:10:53.225960 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216448    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 12:10:53.225960 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216451    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 12:10:53.225960 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216453    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 12:10:53.225960 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216456    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 12:10:53.225960 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216459    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 12:10:53.225960 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216461    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 12:10:53.225960 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216464    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 12:10:53.225960 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216466    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 12:10:53.225960 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216468    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 12:10:53.225960 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216471    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 12:10:53.225960 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216474    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 12:10:53.225960 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216476    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 12:10:53.225960 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216478    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 12:10:53.225960 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216481    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 12:10:53.225960 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216483    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 12:10:53.225960 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216486    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 12:10:53.225960 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216488    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 12:10:53.225960 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216491    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 12:10:53.225960 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216495    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 12:10:53.226431 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216498    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 12:10:53.226431 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216502    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 12:10:53.226431 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216505    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 12:10:53.226431 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216507    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 12:10:53.226431 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216510    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 12:10:53.226431 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216513    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 12:10:53.226431 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216515    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 12:10:53.226431 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216518    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 12:10:53.226431 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216520    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 12:10:53.226431 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216523    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 12:10:53.226431 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216527    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 12:10:53.226431 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216531    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 12:10:53.226431 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216534    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 12:10:53.226431 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216536    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 12:10:53.226431 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216539    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 12:10:53.226431 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216542    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 12:10:53.226431 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216545    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 12:10:53.226431 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216547    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 12:10:53.226431 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216550    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 12:10:53.226431 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216552    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 12:10:53.226911 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216555    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 12:10:53.226911 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216557    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 12:10:53.226911 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216561    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 12:10:53.226911 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216563    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 12:10:53.226911 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.216566    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 12:10:53.226911 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.217363    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 12:10:53.226911 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.225753    2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 15 12:10:53.226911 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.225769    2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 15 12:10:53.226911 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.225795    2560 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 15 12:10:53.226911 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.225802    2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 15 12:10:53.226911 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.225855    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 12:10:53.226911 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.225861    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 12:10:53.226911 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.225864    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 12:10:53.226911 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.225867    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 12:10:53.227267 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.225870    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 12:10:53.227267 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.225872    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 12:10:53.227267 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.225875    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 12:10:53.227267 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.225879    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 12:10:53.227267 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.225881    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 12:10:53.227267 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.225885    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 12:10:53.227267 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.225887    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 12:10:53.227267 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.225890    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 12:10:53.227267 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.225892    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 12:10:53.227267 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.225895    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 12:10:53.227267 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.225898    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 12:10:53.227267 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.225900    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 12:10:53.227267 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.225903    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 12:10:53.227267 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.225905    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 12:10:53.227267 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.225908    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 12:10:53.227267 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.225911    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 12:10:53.227267 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.225913    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 12:10:53.227267 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.225916    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 12:10:53.227267 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.225919    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 12:10:53.227751 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.225923    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 12:10:53.227751 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.225927    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 12:10:53.227751 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.225930    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 12:10:53.227751 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.225933    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 12:10:53.227751 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.225936    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 12:10:53.227751 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.225939    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 12:10:53.227751 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.225943    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 12:10:53.227751 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.225946    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 12:10:53.227751 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.225948    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 12:10:53.227751 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.225951    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 12:10:53.227751 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.225954    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 12:10:53.227751 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.225956    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 12:10:53.227751 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.225959    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 12:10:53.227751 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.225963    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 12:10:53.227751 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.225967    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 12:10:53.227751 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.225970    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 12:10:53.227751 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.225973    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 12:10:53.227751 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.225976    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 12:10:53.227751 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.225978    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 12:10:53.228204 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.225981    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 12:10:53.228204 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.225984    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 12:10:53.228204 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.225986    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 12:10:53.228204 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.225990    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 12:10:53.228204 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.225993    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 12:10:53.228204 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.225996    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 12:10:53.228204 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.225999    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 12:10:53.228204 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226002    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 12:10:53.228204 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226005    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 12:10:53.228204 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226008    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 12:10:53.228204 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226011    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 12:10:53.228204 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226013    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 12:10:53.228204 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226016    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 12:10:53.228204 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226018    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 12:10:53.228204 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226021    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 12:10:53.228204 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226023    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 12:10:53.228204 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226026    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 12:10:53.228204 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226028    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 12:10:53.228204 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226031    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 12:10:53.228204 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226034    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 12:10:53.228724 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226037    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 12:10:53.228724 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226040    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 12:10:53.228724 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226043    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 12:10:53.228724 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226045    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 12:10:53.228724 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226048    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 12:10:53.228724 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226050    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 12:10:53.228724 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226053    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 12:10:53.228724 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226056    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 12:10:53.228724 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226058    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 12:10:53.228724 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226060    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 12:10:53.228724 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226063    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 12:10:53.228724 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226065    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 12:10:53.228724 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226068    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 12:10:53.228724 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226070    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 12:10:53.228724 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226073    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 12:10:53.228724 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226075    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 12:10:53.228724 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226078    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 12:10:53.228724 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226081    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 12:10:53.228724 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226084    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 12:10:53.229170 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226086    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 12:10:53.229170 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226088    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 12:10:53.229170 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226091    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 12:10:53.229170 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226093    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 12:10:53.229170 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226096    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 12:10:53.229170 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226098    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 12:10:53.229170 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226100    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 12:10:53.229170 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226103    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 12:10:53.229170 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226105    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 12:10:53.229170 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226108    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 12:10:53.229170 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226110    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 12:10:53.229170 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226113    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 12:10:53.229170 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226116    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 12:10:53.229170 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226119    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 12:10:53.229170 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226121    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 12:10:53.229170 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226124    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 12:10:53.229170 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226127    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 12:10:53.229170 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226129    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 12:10:53.229690 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.226134    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 12:10:53.229690 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226245    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 12:10:53.229690 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226250    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 12:10:53.229690 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226254    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 12:10:53.229690 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226257    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 12:10:53.229690 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226259    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 12:10:53.229690 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226262    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 12:10:53.229690 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226265    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 12:10:53.229690 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226267    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 12:10:53.229690 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226269    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 12:10:53.229690 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226272    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 12:10:53.229690 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226274    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 12:10:53.229690 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226277    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 12:10:53.229690 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226280    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 12:10:53.229690 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226283    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 12:10:53.230068 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226286    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 12:10:53.230068 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226304    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 12:10:53.230068 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226308    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 12:10:53.230068 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226311    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 12:10:53.230068 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226314    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 12:10:53.230068 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226316    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 12:10:53.230068 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226319    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 12:10:53.230068 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226321    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 12:10:53.230068 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226324    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 12:10:53.230068 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226326    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 12:10:53.230068 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226329    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 12:10:53.230068 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226331    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 12:10:53.230068 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226334    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 12:10:53.230068 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226336    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 12:10:53.230068 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226339    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 12:10:53.230068 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226342    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 12:10:53.230068 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226345    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 12:10:53.230068 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226348    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 12:10:53.230068 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226350    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 12:10:53.230667 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226352    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 12:10:53.230667 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226355    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 12:10:53.230667 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226357    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 12:10:53.230667 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226360    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 12:10:53.230667 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226362    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 12:10:53.230667 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226365    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 12:10:53.230667 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226369    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 12:10:53.230667 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226372    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 12:10:53.230667 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226375    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 12:10:53.230667 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226378    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 12:10:53.230667 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226381    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 12:10:53.230667 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226383    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 12:10:53.230667 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226386    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 12:10:53.230667 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226389    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 12:10:53.230667 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226392    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 12:10:53.230667 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226394    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 12:10:53.230667 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226397    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 12:10:53.230667 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226399    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 12:10:53.230667 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226402    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 12:10:53.230667 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226404    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 12:10:53.231139 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226407    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 12:10:53.231139 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226409    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 12:10:53.231139 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226412    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 12:10:53.231139 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226414    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 12:10:53.231139 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226417    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 12:10:53.231139 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226419    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 12:10:53.231139 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226422    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 12:10:53.231139 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226424    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 12:10:53.231139 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226427    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 12:10:53.231139 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226429    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 12:10:53.231139 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226432    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 12:10:53.231139 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226434    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 12:10:53.231139 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226437    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 12:10:53.231139 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226440    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 12:10:53.231139 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226443    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 12:10:53.231139 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226445    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 12:10:53.231139 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226448    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 12:10:53.231139 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226451    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 12:10:53.231139 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226453    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 12:10:53.231139 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226456    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 12:10:53.231646 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226459    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 12:10:53.231646 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226461    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 12:10:53.231646 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226463    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 12:10:53.231646 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226466    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 12:10:53.231646 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226468    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 12:10:53.231646 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226474    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 12:10:53.231646 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226476    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 12:10:53.231646 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226479    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 12:10:53.231646 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226482    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 12:10:53.231646 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226484    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 12:10:53.231646 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226487    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 12:10:53.231646 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226490    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 12:10:53.231646 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226492    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 12:10:53.231646 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226495    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 12:10:53.231646 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226497    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 12:10:53.231646 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226500    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 12:10:53.231646 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226503    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 12:10:53.231646 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226505    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 12:10:53.231646 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226508    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 12:10:53.232087 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226510    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 12:10:53.232087 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226513    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 12:10:53.232087 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226515    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 12:10:53.232087 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226518    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 12:10:53.232087 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226520    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 12:10:53.232087 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226526    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 12:10:53.232087 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:53.226530    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 12:10:53.232087 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.226535    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 12:10:53.232087 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.226634    2560 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 15 12:10:53.232087 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.229128    2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 15 12:10:53.232087 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.230647    2560 server.go:1019] "Starting client certificate rotation"
Jul 15 12:10:53.232087 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.230741    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 12:10:53.232087 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.230781    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 12:10:53.233513 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.233499    2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 12:10:53.236539 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.236521    2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 12:10:53.247093 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.247075    2560 log.go:25] "Validated CRI v1 runtime API"
Jul 15 12:10:53.249666 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.249635    2560 log.go:25] "Validated CRI v1 image API"
Jul 15 12:10:53.251381 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.251363    2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 15 12:10:53.253986 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.253965    2560 fs.go:135] Filesystem UUIDs: map[23f20674-4218-4f47-8998-d1bf3099341c:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 a33c3e54-51e6-4f3e-8f24-952d959d31bc:/dev/nvme0n1p3]
Jul 15 12:10:53.254036 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.253986    2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 15 12:10:53.258763 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.258736    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 12:10:53.260696 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.260582    2560 manager.go:216] Machine: {Timestamp:2026-07-15 12:10:53.259083533 +0000 UTC m=+0.373477257 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3129151 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a1e16c0320975b99fa4321c004f12 SystemUUID:ec2a1e16-c032-0975-b99f-a4321c004f12 BootID:1bd5cd09-f70e-4807-802b-6040ed09f798 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:bb:be:8c:a1:d1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:bb:be:8c:a1:d1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0a:cc:f3:35:41:7c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 15 12:10:53.260696 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.260691    2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 15 12:10:53.260843 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.260797    2560 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 15 12:10:53.265704 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.265655    2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 15 12:10:53.265872 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.265712    2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-186.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 15 12:10:53.266670 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.266658    2560 topology_manager.go:138] "Creating topology manager with none policy"
Jul 15 12:10:53.266734 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.266677    2560 container_manager_linux.go:309] "Creating device plugin manager"
Jul 15 12:10:53.266734 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.266689    2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 12:10:53.266734 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.266710    2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 12:10:53.267973 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.267961    2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 15 12:10:53.271723 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.271710    2560 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 12:10:53.271854 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.271842    2560 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 15 12:10:53.271914 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.271881    2560 kubelet.go:486] "Attempting to sync node with API server"
Jul 15 12:10:53.271914 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.271896    2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 15 12:10:53.271994 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.271915    2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 15 12:10:53.271994 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.271928    2560 kubelet.go:398] "Adding apiserver pod source"
Jul 15 12:10:53.271994 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.271940    2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 15 12:10:53.272325 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.272312    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 12:10:53.272385 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.272335    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 12:10:53.274977 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.274961    2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 15 12:10:53.277336 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.277323    2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 15 12:10:53.277381 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.277353    2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 15 12:10:53.278421 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.278410    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 15 12:10:53.278475 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.278426    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 15 12:10:53.278475 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.278433    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 15 12:10:53.278475 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.278438    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 15 12:10:53.278475 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.278447    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 15 12:10:53.278475 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.278453    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 15 12:10:53.278475 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.278461    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 15 12:10:53.278475 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.278467    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 15 12:10:53.278475 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.278474    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 15 12:10:53.278693 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.278480    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 15 12:10:53.278693 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.278490    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 15 12:10:53.278693 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.278496    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 15 12:10:53.279280 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.279269    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 15 12:10:53.279328 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.279282    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 15 12:10:53.282665 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.282650    2560 server.go:1268] "Started kubelet"
Jul 15 12:10:53.283005 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.282887    2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 15 12:10:53.283005 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.282734    2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 15 12:10:53.283120 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.283021    2560 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 15 12:10:53.283559 ip-10-0-133-186 systemd[1]: Started Kubernetes Kubelet.
Jul 15 12:10:53.283967 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.283574    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-186.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 15 12:10:53.284170 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:53.284110    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-186.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 15 12:10:53.284170 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:53.284112    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 15 12:10:53.285173 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.285142    2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 15 12:10:53.285255 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.285178    2560 server.go:310] "Adding debug handlers to kubelet server"
Jul 15 12:10:53.287644 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:53.287626    2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 15 12:10:53.292127 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:53.291007    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-186.ec2.internal.18c2755f007c430e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-186.ec2.internal,UID:ip-10-0-133-186.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-186.ec2.internal,},FirstTimestamp:2026-07-15 12:10:53.28262427 +0000 UTC m=+0.397018013,LastTimestamp:2026-07-15 12:10:53.28262427 +0000 UTC m=+0.397018013,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-186.ec2.internal,}"
Jul 15 12:10:53.292236 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.292219    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 15 12:10:53.292744 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.292727    2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 15 12:10:53.292845 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:53.292827    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-186.ec2.internal\" not found"
Jul 15 12:10:53.293498 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.293473    2560 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 15 12:10:53.293498 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.293496    2560 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 15 12:10:53.293655 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.293478    2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 15 12:10:53.293655 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.293620    2560 reconstruct.go:97] "Volume reconstruction finished"
Jul 15 12:10:53.293655 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.293629    2560 reconciler.go:29] "Reconciler: start to sync state"
Jul 15 12:10:53.293792 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.293745    2560 factory.go:55] Registering systemd factory
Jul 15 12:10:53.293792 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.293760    2560 factory.go:223] Registration of the systemd container factory successfully
Jul 15 12:10:53.294014 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.293998    2560 factory.go:153] Registering CRI-O factory
Jul 15 12:10:53.294014 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.294014    2560 factory.go:223] Registration of the crio container factory successfully
Jul 15 12:10:53.294116 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.294076    2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 15 12:10:53.294116 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.294102    2560 factory.go:103] Registering Raw factory
Jul 15 12:10:53.294116 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.294114    2560 manager.go:1196] Started watching for new ooms in manager
Jul 15 12:10:53.294814 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.294705    2560 manager.go:349] Starting recovery of all containers
Jul 15 12:10:53.299719 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:53.299687    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-186.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 15 12:10:53.299814 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:53.299734    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 15 12:10:53.308041 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.308022    2560 manager.go:354] Recovery completed
Jul 15 12:10:53.312013 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.311997    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hzdtw"
Jul 15 12:10:53.312432 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.312421    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 12:10:53.314237 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.314221    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-186.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 12:10:53.314315 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.314249    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-186.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 12:10:53.314315 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.314259    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-186.ec2.internal" event="NodeHasSufficientPID"
Jul 15 12:10:53.314755 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.314729    2560 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 15 12:10:53.314755 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.314741    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 12:10:53.314755 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.314741    2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 15 12:10:53.314924 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.314773    2560 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 12:10:53.315547 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.315524    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-186.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 12:10:53.315607 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.315550    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-186.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 12:10:53.315607 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.315562    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-186.ec2.internal" event="NodeHasSufficientPID"
Jul 15 12:10:53.315722 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:53.315665    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-186.ec2.internal.18c2755f025e9d9c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-186.ec2.internal,UID:ip-10-0-133-186.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-186.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-186.ec2.internal,},FirstTimestamp:2026-07-15 12:10:53.314235804 +0000 UTC m=+0.428629527,LastTimestamp:2026-07-15 12:10:53.314235804 +0000 UTC m=+0.428629527,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-186.ec2.internal,}"
Jul 15 12:10:53.316124 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.316113    2560 policy_none.go:49] "None policy: Start"
Jul 15 12:10:53.316170 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.316129    2560 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 15 12:10:53.316170 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.316138    2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 15 12:10:53.317244 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.317234    2560 policy_none.go:47] "Start"
Jul 15 12:10:53.319964 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.319947    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hzdtw"
Jul 15 12:10:53.326133 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:53.326061    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-186.ec2.internal.18c2755f025ee472  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-186.ec2.internal,UID:ip-10-0-133-186.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-133-186.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-133-186.ec2.internal,},FirstTimestamp:2026-07-15 12:10:53.314253938 +0000 UTC m=+0.428647661,LastTimestamp:2026-07-15 12:10:53.314253938 +0000 UTC m=+0.428647661,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-186.ec2.internal,}"
Jul 15 12:10:53.357881 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.357868    2560 manager.go:337] "Starting Device Plugin manager"
Jul 15 12:10:53.368193 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:53.357902    2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 15 12:10:53.368193 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.357912    2560 server.go:87] "Starting device plugin registration server"
Jul 15 12:10:53.368193 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.358145    2560 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 15 12:10:53.368193 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.358155    2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 15 12:10:53.368193 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.358248    2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 15 12:10:53.368193 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.358362    2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 15 12:10:53.368193 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.358370    2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 15 12:10:53.368193 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:53.358959    2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 15 12:10:53.368193 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:53.359012    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-186.ec2.internal\" not found"
Jul 15 12:10:53.436362 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.436320    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 15 12:10:53.437503 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.437480    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 15 12:10:53.437594 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.437517    2560 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 15 12:10:53.437594 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.437536    2560 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 15 12:10:53.437594 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:53.437567    2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 15 12:10:53.439957 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.439937    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 12:10:53.458365 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.458321    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 12:10:53.459094 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.459079    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-186.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 12:10:53.459142 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.459113    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-186.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 12:10:53.459142 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.459124    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-186.ec2.internal" event="NodeHasSufficientPID"
Jul 15 12:10:53.459216 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.459149    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-186.ec2.internal"
Jul 15 12:10:53.482377 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.482360    2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-186.ec2.internal"
Jul 15 12:10:53.482432 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:53.482381    2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-186.ec2.internal\": node \"ip-10-0-133-186.ec2.internal\" not found"
Jul 15 12:10:53.530209 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:53.530184    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-186.ec2.internal\" not found"
Jul 15 12:10:53.538278 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.538257    2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-133-186.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-186.ec2.internal"]
Jul 15 12:10:53.538366 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.538333    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 12:10:53.539877 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.539864    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-186.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 12:10:53.539951 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.539893    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-186.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 12:10:53.539951 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.539907    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-186.ec2.internal" event="NodeHasSufficientPID"
Jul 15 12:10:53.541128 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.541115    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 12:10:53.541244 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.541229    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-186.ec2.internal"
Jul 15 12:10:53.541315 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.541265    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 12:10:53.541855 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.541830    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-186.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 12:10:53.541935 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.541860    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-186.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 12:10:53.541935 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.541867    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-186.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 12:10:53.541935 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.541889    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-186.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 12:10:53.541935 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.541900    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-186.ec2.internal" event="NodeHasSufficientPID"
Jul 15 12:10:53.541935 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.541871    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-186.ec2.internal" event="NodeHasSufficientPID"
Jul 15 12:10:53.543021 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.543006    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-186.ec2.internal"
Jul 15 12:10:53.543062 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.543035    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 12:10:53.543624 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.543609    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-186.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 12:10:53.543691 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.543636    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-186.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 12:10:53.543691 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.543646    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-186.ec2.internal" event="NodeHasSufficientPID"
Jul 15 12:10:53.569284 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:53.569107    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-186.ec2.internal\" not found" node="ip-10-0-133-186.ec2.internal"
Jul 15 12:10:53.573749 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:53.573733    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-186.ec2.internal\" not found" node="ip-10-0-133-186.ec2.internal"
Jul 15 12:10:53.595301 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.595279    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b44d4f1a13a5598713990a6a605902da-config\") pod \"kube-apiserver-proxy-ip-10-0-133-186.ec2.internal\" (UID: \"b44d4f1a13a5598713990a6a605902da\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-186.ec2.internal"
Jul 15 12:10:53.595397 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.595327    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/26e0df4d83bbe2ba7879e2ef9a112d54-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-186.ec2.internal\" (UID: \"26e0df4d83bbe2ba7879e2ef9a112d54\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-186.ec2.internal"
Jul 15 12:10:53.595397 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.595353    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/26e0df4d83bbe2ba7879e2ef9a112d54-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-186.ec2.internal\" (UID: \"26e0df4d83bbe2ba7879e2ef9a112d54\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-186.ec2.internal"
Jul 15 12:10:53.630407 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:53.630383    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-186.ec2.internal\" not found"
Jul 15 12:10:53.697386 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.697338    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b44d4f1a13a5598713990a6a605902da-config\") pod \"kube-apiserver-proxy-ip-10-0-133-186.ec2.internal\" (UID: \"b44d4f1a13a5598713990a6a605902da\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-186.ec2.internal"
Jul 15 12:10:53.697386 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.697393    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/26e0df4d83bbe2ba7879e2ef9a112d54-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-186.ec2.internal\" (UID: \"26e0df4d83bbe2ba7879e2ef9a112d54\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-186.ec2.internal"
Jul 15 12:10:53.697533 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.697413    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/26e0df4d83bbe2ba7879e2ef9a112d54-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-186.ec2.internal\" (UID: \"26e0df4d83bbe2ba7879e2ef9a112d54\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-186.ec2.internal"
Jul 15 12:10:53.697533 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.697440    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b44d4f1a13a5598713990a6a605902da-config\") pod \"kube-apiserver-proxy-ip-10-0-133-186.ec2.internal\" (UID: \"b44d4f1a13a5598713990a6a605902da\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-186.ec2.internal"
Jul 15 12:10:53.697533 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.697446    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/26e0df4d83bbe2ba7879e2ef9a112d54-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-186.ec2.internal\" (UID: \"26e0df4d83bbe2ba7879e2ef9a112d54\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-186.ec2.internal"
Jul 15 12:10:53.697533 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.697445    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/26e0df4d83bbe2ba7879e2ef9a112d54-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-186.ec2.internal\" (UID: \"26e0df4d83bbe2ba7879e2ef9a112d54\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-186.ec2.internal"
Jul 15 12:10:53.732702 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:53.732635    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-186.ec2.internal\" not found"
Jul 15 12:10:53.833800 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:53.833758    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-186.ec2.internal\" not found"
Jul 15 12:10:53.872923 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.872884    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-186.ec2.internal"
Jul 15 12:10:53.877018 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:53.876720    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-186.ec2.internal"
Jul 15 12:10:53.936277 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:53.936244    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-186.ec2.internal\" not found"
Jul 15 12:10:54.037414 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:54.037339    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-186.ec2.internal\" not found"
Jul 15 12:10:54.138870 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:54.138833    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-186.ec2.internal\" not found"
Jul 15 12:10:54.231907 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:54.231866    2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 15 12:10:54.232379 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:54.232033    2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 15 12:10:54.239581 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:54.239559    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-186.ec2.internal\" not found"
Jul 15 12:10:54.324671 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:54.324571    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 12:05:54 +0000 UTC" deadline="2028-01-01 20:54:22.519476769 +0000 UTC"
Jul 15 12:10:54.324671 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:54.324614    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12848h43m28.194867067s"
Jul 15 12:10:54.340935 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:54.340913    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-186.ec2.internal\" not found"
Jul 15 12:10:54.419124 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:54.419078    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 12:10:54.421185 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:54.421158    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-186.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 12:10:54.421329 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:54.421204    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-186.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 12:10:54.421329 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:54.421222    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-186.ec2.internal" event="NodeHasSufficientPID"
Jul 15 12:10:54.427139 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:54.427121    2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 12:10:54.477404 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:54.477375    2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 12:10:54.493795 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:54.493772    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-186.ec2.internal"
Jul 15 12:10:54.507249 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:54.507229    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 12:10:54.508368 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:54.508353    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-186.ec2.internal"
Jul 15 12:10:54.515762 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:54.515746    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 12:10:54.797336 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:54.797297    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb44d4f1a13a5598713990a6a605902da.slice/crio-3366b5d466cc46fecadef5d59135e48a67054e5b5d7a55c5ff716cfe2c77c70d WatchSource:0}: Error finding container 3366b5d466cc46fecadef5d59135e48a67054e5b5d7a55c5ff716cfe2c77c70d: Status 404 returned error can't find the container with id 3366b5d466cc46fecadef5d59135e48a67054e5b5d7a55c5ff716cfe2c77c70d
Jul 15 12:10:54.801807 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:54.801788    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 12:10:54.900965 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:54.900940    2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 12:10:55.273720 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.273699    2560 apiserver.go:52] "Watching apiserver"
Jul 15 12:10:55.281322 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.281299    2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 15 12:10:55.281672 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.281652    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-gwfk8","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms92n","openshift-image-registry/node-ca-4tr78","openshift-multus/network-metrics-daemon-spl8b","openshift-network-operator/iptables-alerter-cwldp","openshift-ovn-kubernetes/ovnkube-node-xh4rs","kube-system/global-pull-secret-syncer-b2c8x","kube-system/kube-apiserver-proxy-ip-10-0-133-186.ec2.internal","openshift-cluster-node-tuning-operator/tuned-qqjzq","openshift-dns/node-resolver-zcdxd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-186.ec2.internal","openshift-multus/multus-additional-cni-plugins-htv2v","openshift-multus/multus-jt4gv","openshift-network-diagnostics/network-check-target-4mhn5"]
Jul 15 12:10:55.283933 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.283914    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2c8x"
Jul 15 12:10:55.284024 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:55.284002    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b2c8x" podUID="48797460-a1a5-43f2-9841-61f8adce425d"
Jul 15 12:10:55.285157 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.285139    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jt4gv"
Jul 15 12:10:55.286263 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.286245    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4tr78"
Jul 15 12:10:55.287447 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.287433    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spl8b"
Jul 15 12:10:55.287530 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:55.287483    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spl8b" podUID="19938f5e-4b2c-45f8-9077-4fb510687262"
Jul 15 12:10:55.287960 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.287939    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 15 12:10:55.288101 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.287945    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 15 12:10:55.288101 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.288045    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8djs7\""
Jul 15 12:10:55.288101 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.288087    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 15 12:10:55.288267 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.288132    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 15 12:10:55.288670 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.288645    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 15 12:10:55.288957 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.288935    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cwldp"
Jul 15 12:10:55.289046 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.288968    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 15 12:10:55.289120 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.289078    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 15 12:10:55.289422 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.289356    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9gnk7\""
Jul 15 12:10:55.290303 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.290285    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.291675 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.291636    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qqjzq"
Jul 15 12:10:55.291855 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.291836    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 15 12:10:55.291950 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.291836    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 15 12:10:55.291950 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.291842    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 15 12:10:55.291950 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.291924    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-txlml\""
Jul 15 12:10:55.293027 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.292857    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 15 12:10:55.293027 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.292857    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tg8dg\""
Jul 15 12:10:55.293027 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.292919    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 15 12:10:55.293252 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.293081    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 15 12:10:55.293252 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.293160    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 15 12:10:55.293437 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.293366    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 15 12:10:55.294498 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.293770    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gwfk8"
Jul 15 12:10:55.294498 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.294029    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 15 12:10:55.295038 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.294821    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 15 12:10:55.296435 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.295650    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 15 12:10:55.296435 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.295898    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-sb2lp\""
Jul 15 12:10:55.296435 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.296182    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 15 12:10:55.296653 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.296616    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms92n"
Jul 15 12:10:55.297553 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.297531    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 15 12:10:55.297628 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.297531    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-vsb9j\""
Jul 15 12:10:55.297995 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.297977    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 15 12:10:55.298109 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.298091    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zcdxd"
Jul 15 12:10:55.299443 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.299424    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-w5mcp\""
Jul 15 12:10:55.299525 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.299481    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 15 12:10:55.299581 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.299548    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 15 12:10:55.299962 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.299946    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mhn5"
Jul 15 12:10:55.300034 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:55.300014    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mhn5" podUID="17bfcad0-727f-42da-b33d-64a2d4cad92a"
Jul 15 12:10:55.300250 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.300224    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 15 12:10:55.300910 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.300893    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 15 12:10:55.301259 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.301235    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 15 12:10:55.301340 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.301325    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-htv2v"
Jul 15 12:10:55.301480 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.301464    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-gj684\""
Jul 15 12:10:55.303969 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.303953    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 15 12:10:55.304051 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.304018    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xgn9m\""
Jul 15 12:10:55.304169 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.304153    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 15 12:10:55.306477 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.306461    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5575e886-e349-487c-9ca0-ad530bea441f-etc-modprobe-d\") pod \"tuned-qqjzq\" (UID: \"5575e886-e349-487c-9ca0-ad530bea441f\") " pod="openshift-cluster-node-tuning-operator/tuned-qqjzq"
Jul 15 12:10:55.306531 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.306485    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5575e886-e349-487c-9ca0-ad530bea441f-sys\") pod \"tuned-qqjzq\" (UID: \"5575e886-e349-487c-9ca0-ad530bea441f\") " pod="openshift-cluster-node-tuning-operator/tuned-qqjzq"
Jul 15 12:10:55.306531 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.306503    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3060ca16-de32-4034-8fb1-bda91f17b97d-multus-socket-dir-parent\") pod \"multus-jt4gv\" (UID: \"3060ca16-de32-4034-8fb1-bda91f17b97d\") " pod="openshift-multus/multus-jt4gv"
Jul 15 12:10:55.306531 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.306525    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3060ca16-de32-4034-8fb1-bda91f17b97d-host-run-k8s-cni-cncf-io\") pod \"multus-jt4gv\" (UID: \"3060ca16-de32-4034-8fb1-bda91f17b97d\") " pod="openshift-multus/multus-jt4gv"
Jul 15 12:10:55.306675 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.306550    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2f14aadf-a36b-44ad-bbd6-83181b059d9e-registration-dir\") pod \"aws-ebs-csi-driver-node-ms92n\" (UID: \"2f14aadf-a36b-44ad-bbd6-83181b059d9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms92n"
Jul 15 12:10:55.306675 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.306575    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2f14aadf-a36b-44ad-bbd6-83181b059d9e-device-dir\") pod \"aws-ebs-csi-driver-node-ms92n\" (UID: \"2f14aadf-a36b-44ad-bbd6-83181b059d9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms92n"
Jul 15 12:10:55.306675 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.306598    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5575e886-e349-487c-9ca0-ad530bea441f-etc-sysctl-d\") pod \"tuned-qqjzq\" (UID: \"5575e886-e349-487c-9ca0-ad530bea441f\") " pod="openshift-cluster-node-tuning-operator/tuned-qqjzq"
Jul 15 12:10:55.306675 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.306614    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbxqj\" (UniqueName: \"kubernetes.io/projected/5575e886-e349-487c-9ca0-ad530bea441f-kube-api-access-qbxqj\") pod \"tuned-qqjzq\" (UID: \"5575e886-e349-487c-9ca0-ad530bea441f\") " pod="openshift-cluster-node-tuning-operator/tuned-qqjzq"
Jul 15 12:10:55.306675 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.306633    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c1e0b090-dace-4704-82e6-0c756006f902-agent-certs\") pod \"konnectivity-agent-gwfk8\" (UID: \"c1e0b090-dace-4704-82e6-0c756006f902\") " pod="kube-system/konnectivity-agent-gwfk8"
Jul 15 12:10:55.306859 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.306683    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3060ca16-de32-4034-8fb1-bda91f17b97d-hostroot\") pod \"multus-jt4gv\" (UID: \"3060ca16-de32-4034-8fb1-bda91f17b97d\") " pod="openshift-multus/multus-jt4gv"
Jul 15 12:10:55.306859 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.306715    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3060ca16-de32-4034-8fb1-bda91f17b97d-multus-conf-dir\") pod \"multus-jt4gv\" (UID: \"3060ca16-de32-4034-8fb1-bda91f17b97d\") " pod="openshift-multus/multus-jt4gv"
Jul 15 12:10:55.306859 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.306732    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2de62ab2-7502-4c13-a6f0-5ebbd4982798-etc-openvswitch\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.306859 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.306747    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2de62ab2-7502-4c13-a6f0-5ebbd4982798-ovnkube-config\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.306859 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.306769    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5575e886-e349-487c-9ca0-ad530bea441f-lib-modules\") pod \"tuned-qqjzq\" (UID: \"5575e886-e349-487c-9ca0-ad530bea441f\") " pod="openshift-cluster-node-tuning-operator/tuned-qqjzq"
Jul 15 12:10:55.306859 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.306787    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3060ca16-de32-4034-8fb1-bda91f17b97d-host-run-netns\") pod \"multus-jt4gv\" (UID: \"3060ca16-de32-4034-8fb1-bda91f17b97d\") " pod="openshift-multus/multus-jt4gv"
Jul 15 12:10:55.306859 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.306801    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fa83ebd5-2623-4f6e-ba82-c3d428fa0115-iptables-alerter-script\") pod \"iptables-alerter-cwldp\" (UID: \"fa83ebd5-2623-4f6e-ba82-c3d428fa0115\") " pod="openshift-network-operator/iptables-alerter-cwldp"
Jul 15 12:10:55.306859 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.306817    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2de62ab2-7502-4c13-a6f0-5ebbd4982798-var-lib-openvswitch\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.306859 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.306838    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5575e886-e349-487c-9ca0-ad530bea441f-etc-systemd\") pod \"tuned-qqjzq\" (UID: \"5575e886-e349-487c-9ca0-ad530bea441f\") " pod="openshift-cluster-node-tuning-operator/tuned-qqjzq"
Jul 15 12:10:55.307205 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.306866    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5575e886-e349-487c-9ca0-ad530bea441f-tmp\") pod \"tuned-qqjzq\" (UID: \"5575e886-e349-487c-9ca0-ad530bea441f\") " pod="openshift-cluster-node-tuning-operator/tuned-qqjzq"
Jul 15 12:10:55.307205 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.306902    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3060ca16-de32-4034-8fb1-bda91f17b97d-cni-binary-copy\") pod \"multus-jt4gv\" (UID: \"3060ca16-de32-4034-8fb1-bda91f17b97d\") " pod="openshift-multus/multus-jt4gv"
Jul 15 12:10:55.307205 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.306928    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3060ca16-de32-4034-8fb1-bda91f17b97d-etc-kubernetes\") pod \"multus-jt4gv\" (UID: \"3060ca16-de32-4034-8fb1-bda91f17b97d\") " pod="openshift-multus/multus-jt4gv"
Jul 15 12:10:55.307205 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.306956    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2de62ab2-7502-4c13-a6f0-5ebbd4982798-run-systemd\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.307205 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.306973    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2de62ab2-7502-4c13-a6f0-5ebbd4982798-host-run-ovn-kubernetes\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.307205 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.306996    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5575e886-e349-487c-9ca0-ad530bea441f-etc-sysctl-conf\") pod \"tuned-qqjzq\" (UID: \"5575e886-e349-487c-9ca0-ad530bea441f\") " pod="openshift-cluster-node-tuning-operator/tuned-qqjzq"
Jul 15 12:10:55.307205 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.307020    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c1e0b090-dace-4704-82e6-0c756006f902-konnectivity-ca\") pod \"konnectivity-agent-gwfk8\" (UID: \"c1e0b090-dace-4704-82e6-0c756006f902\") " pod="kube-system/konnectivity-agent-gwfk8"
Jul 15 12:10:55.307205 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.307039    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3060ca16-de32-4034-8fb1-bda91f17b97d-host-var-lib-cni-bin\") pod \"multus-jt4gv\" (UID: \"3060ca16-de32-4034-8fb1-bda91f17b97d\") " pod="openshift-multus/multus-jt4gv"
Jul 15 12:10:55.307205 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.307074    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28vr8\" (UniqueName: \"kubernetes.io/projected/fa83ebd5-2623-4f6e-ba82-c3d428fa0115-kube-api-access-28vr8\") pod \"iptables-alerter-cwldp\" (UID: \"fa83ebd5-2623-4f6e-ba82-c3d428fa0115\") " pod="openshift-network-operator/iptables-alerter-cwldp"
Jul 15 12:10:55.307205 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.307100    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2de62ab2-7502-4c13-a6f0-5ebbd4982798-host-kubelet\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.307205 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.307128    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/48797460-a1a5-43f2-9841-61f8adce425d-original-pull-secret\") pod \"global-pull-secret-syncer-b2c8x\" (UID: \"48797460-a1a5-43f2-9841-61f8adce425d\") " pod="kube-system/global-pull-secret-syncer-b2c8x"
Jul 15 12:10:55.307205 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.307154    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3060ca16-de32-4034-8fb1-bda91f17b97d-multus-cni-dir\") pod \"multus-jt4gv\" (UID: \"3060ca16-de32-4034-8fb1-bda91f17b97d\") " pod="openshift-multus/multus-jt4gv"
Jul 15 12:10:55.307205 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.307181    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/aab771cb-07af-462f-ac09-166b75eaab99-serviceca\") pod \"node-ca-4tr78\" (UID: \"aab771cb-07af-462f-ac09-166b75eaab99\") " pod="openshift-image-registry/node-ca-4tr78"
Jul 15 12:10:55.307205 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.307209    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2f14aadf-a36b-44ad-bbd6-83181b059d9e-sys-fs\") pod \"aws-ebs-csi-driver-node-ms92n\" (UID: \"2f14aadf-a36b-44ad-bbd6-83181b059d9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms92n"
Jul 15 12:10:55.307795 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.307225    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2de62ab2-7502-4c13-a6f0-5ebbd4982798-node-log\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.307795 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.307238    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5575e886-e349-487c-9ca0-ad530bea441f-etc-tuned\") pod \"tuned-qqjzq\" (UID: \"5575e886-e349-487c-9ca0-ad530bea441f\") " pod="openshift-cluster-node-tuning-operator/tuned-qqjzq"
Jul 15 12:10:55.307795 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.307275    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5575e886-e349-487c-9ca0-ad530bea441f-etc-kubernetes\") pod \"tuned-qqjzq\" (UID: \"5575e886-e349-487c-9ca0-ad530bea441f\") " pod="openshift-cluster-node-tuning-operator/tuned-qqjzq"
Jul 15 12:10:55.307795 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.307344    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kd6p5\" (UniqueName: \"kubernetes.io/projected/19938f5e-4b2c-45f8-9077-4fb510687262-kube-api-access-kd6p5\") pod \"network-metrics-daemon-spl8b\" (UID: \"19938f5e-4b2c-45f8-9077-4fb510687262\") " pod="openshift-multus/network-metrics-daemon-spl8b"
Jul 15 12:10:55.307795 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.307372    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2de62ab2-7502-4c13-a6f0-5ebbd4982798-run-ovn\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.307795 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.307399    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2de62ab2-7502-4c13-a6f0-5ebbd4982798-log-socket\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.307795 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.307431    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5575e886-e349-487c-9ca0-ad530bea441f-etc-sysconfig\") pod \"tuned-qqjzq\" (UID: \"5575e886-e349-487c-9ca0-ad530bea441f\") " pod="openshift-cluster-node-tuning-operator/tuned-qqjzq"
Jul 15 12:10:55.307795 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.307454    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5575e886-e349-487c-9ca0-ad530bea441f-run\") pod \"tuned-qqjzq\" (UID: \"5575e886-e349-487c-9ca0-ad530bea441f\") " pod="openshift-cluster-node-tuning-operator/tuned-qqjzq"
Jul 15 12:10:55.307795 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.307487    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/48797460-a1a5-43f2-9841-61f8adce425d-kubelet-config\") pod \"global-pull-secret-syncer-b2c8x\" (UID: \"48797460-a1a5-43f2-9841-61f8adce425d\") " pod="kube-system/global-pull-secret-syncer-b2c8x"
Jul 15 12:10:55.307795 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.307513    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3060ca16-de32-4034-8fb1-bda91f17b97d-host-var-lib-kubelet\") pod \"multus-jt4gv\" (UID: \"3060ca16-de32-4034-8fb1-bda91f17b97d\") " pod="openshift-multus/multus-jt4gv"
Jul 15 12:10:55.307795 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.307528    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aab771cb-07af-462f-ac09-166b75eaab99-host\") pod \"node-ca-4tr78\" (UID: \"aab771cb-07af-462f-ac09-166b75eaab99\") " pod="openshift-image-registry/node-ca-4tr78"
Jul 15 12:10:55.307795 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.307580    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2de62ab2-7502-4c13-a6f0-5ebbd4982798-ovnkube-script-lib\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.307795 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.307602    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2f14aadf-a36b-44ad-bbd6-83181b059d9e-socket-dir\") pod \"aws-ebs-csi-driver-node-ms92n\" (UID: \"2f14aadf-a36b-44ad-bbd6-83181b059d9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms92n"
Jul 15 12:10:55.307795 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.307616    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5575e886-e349-487c-9ca0-ad530bea441f-host\") pod \"tuned-qqjzq\" (UID: \"5575e886-e349-487c-9ca0-ad530bea441f\") " pod="openshift-cluster-node-tuning-operator/tuned-qqjzq"
Jul 15 12:10:55.307795 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.307631    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3060ca16-de32-4034-8fb1-bda91f17b97d-cnibin\") pod \"multus-jt4gv\" (UID: \"3060ca16-de32-4034-8fb1-bda91f17b97d\") " pod="openshift-multus/multus-jt4gv"
Jul 15 12:10:55.307795 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.307667    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3060ca16-de32-4034-8fb1-bda91f17b97d-multus-daemon-config\") pod \"multus-jt4gv\" (UID: \"3060ca16-de32-4034-8fb1-bda91f17b97d\") " pod="openshift-multus/multus-jt4gv"
Jul 15 12:10:55.307795 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.307714    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3060ca16-de32-4034-8fb1-bda91f17b97d-host-run-multus-certs\") pod \"multus-jt4gv\" (UID: \"3060ca16-de32-4034-8fb1-bda91f17b97d\") " pod="openshift-multus/multus-jt4gv"
Jul 15 12:10:55.308649 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.307745    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7vz8\" (UniqueName: \"kubernetes.io/projected/2f14aadf-a36b-44ad-bbd6-83181b059d9e-kube-api-access-v7vz8\") pod \"aws-ebs-csi-driver-node-ms92n\" (UID: \"2f14aadf-a36b-44ad-bbd6-83181b059d9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms92n"
Jul 15 12:10:55.308649 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.307779    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3060ca16-de32-4034-8fb1-bda91f17b97d-host-var-lib-cni-multus\") pod \"multus-jt4gv\" (UID: \"3060ca16-de32-4034-8fb1-bda91f17b97d\") " pod="openshift-multus/multus-jt4gv"
Jul 15 12:10:55.308649 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.307808    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fa83ebd5-2623-4f6e-ba82-c3d428fa0115-host-slash\") pod \"iptables-alerter-cwldp\" (UID: \"fa83ebd5-2623-4f6e-ba82-c3d428fa0115\") " pod="openshift-network-operator/iptables-alerter-cwldp"
Jul 15 12:10:55.308649 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.307834    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2f14aadf-a36b-44ad-bbd6-83181b059d9e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ms92n\" (UID: \"2f14aadf-a36b-44ad-bbd6-83181b059d9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms92n"
Jul 15 12:10:55.308649 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.307860    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2de62ab2-7502-4c13-a6f0-5ebbd4982798-host-slash\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.308649 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.307883    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2de62ab2-7502-4c13-a6f0-5ebbd4982798-run-openvswitch\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.308649 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.307907    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2de62ab2-7502-4c13-a6f0-5ebbd4982798-host-cni-netd\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.308649 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.307933    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2f14aadf-a36b-44ad-bbd6-83181b059d9e-etc-selinux\") pod \"aws-ebs-csi-driver-node-ms92n\" (UID: \"2f14aadf-a36b-44ad-bbd6-83181b059d9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms92n"
Jul 15 12:10:55.308649 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.307956    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2de62ab2-7502-4c13-a6f0-5ebbd4982798-systemd-units\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.308649 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.307977    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5575e886-e349-487c-9ca0-ad530bea441f-var-lib-kubelet\") pod \"tuned-qqjzq\" (UID: \"5575e886-e349-487c-9ca0-ad530bea441f\") " pod="openshift-cluster-node-tuning-operator/tuned-qqjzq"
Jul 15 12:10:55.308649 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.307998    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3060ca16-de32-4034-8fb1-bda91f17b97d-system-cni-dir\") pod \"multus-jt4gv\" (UID: \"3060ca16-de32-4034-8fb1-bda91f17b97d\") " pod="openshift-multus/multus-jt4gv"
Jul 15 12:10:55.308649 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.308024    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chkf8\" (UniqueName: \"kubernetes.io/projected/aab771cb-07af-462f-ac09-166b75eaab99-kube-api-access-chkf8\") pod \"node-ca-4tr78\" (UID: \"aab771cb-07af-462f-ac09-166b75eaab99\") " pod="openshift-image-registry/node-ca-4tr78"
Jul 15 12:10:55.308649 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.308069    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2de62ab2-7502-4c13-a6f0-5ebbd4982798-host-run-netns\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.308649 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.308106    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2de62ab2-7502-4c13-a6f0-5ebbd4982798-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.308649 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.308165    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9nsn\" (UniqueName: \"kubernetes.io/projected/2de62ab2-7502-4c13-a6f0-5ebbd4982798-kube-api-access-h9nsn\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.308649 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.308193    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19938f5e-4b2c-45f8-9077-4fb510687262-metrics-certs\") pod \"network-metrics-daemon-spl8b\" (UID: \"19938f5e-4b2c-45f8-9077-4fb510687262\") " pod="openshift-multus/network-metrics-daemon-spl8b"
Jul 15 12:10:55.309186 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.308217    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/48797460-a1a5-43f2-9841-61f8adce425d-dbus\") pod \"global-pull-secret-syncer-b2c8x\" (UID: \"48797460-a1a5-43f2-9841-61f8adce425d\") " pod="kube-system/global-pull-secret-syncer-b2c8x"
Jul 15 12:10:55.309186 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.308246    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3060ca16-de32-4034-8fb1-bda91f17b97d-os-release\") pod \"multus-jt4gv\" (UID: \"3060ca16-de32-4034-8fb1-bda91f17b97d\") " pod="openshift-multus/multus-jt4gv"
Jul 15 12:10:55.309186 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.308287    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjfsq\" (UniqueName: \"kubernetes.io/projected/3060ca16-de32-4034-8fb1-bda91f17b97d-kube-api-access-mjfsq\") pod \"multus-jt4gv\" (UID: \"3060ca16-de32-4034-8fb1-bda91f17b97d\") " pod="openshift-multus/multus-jt4gv"
Jul 15 12:10:55.309186 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.308352    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2de62ab2-7502-4c13-a6f0-5ebbd4982798-host-cni-bin\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.309186 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.308379    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2de62ab2-7502-4c13-a6f0-5ebbd4982798-env-overrides\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.309186 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.308403    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2de62ab2-7502-4c13-a6f0-5ebbd4982798-ovn-node-metrics-cert\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.312727 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.312709    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 12:10:55.329331 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.329314    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zgh9x"
Jul 15 12:10:55.337509 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.337490    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zgh9x"
Jul 15 12:10:55.394240 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.394218    2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 15 12:10:55.408860 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.408837    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3060ca16-de32-4034-8fb1-bda91f17b97d-cni-binary-copy\") pod \"multus-jt4gv\" (UID: \"3060ca16-de32-4034-8fb1-bda91f17b97d\") " pod="openshift-multus/multus-jt4gv"
Jul 15 12:10:55.408956 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.408868    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3060ca16-de32-4034-8fb1-bda91f17b97d-etc-kubernetes\") pod \"multus-jt4gv\" (UID: \"3060ca16-de32-4034-8fb1-bda91f17b97d\") " pod="openshift-multus/multus-jt4gv"
Jul 15 12:10:55.408956 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.408893    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2de62ab2-7502-4c13-a6f0-5ebbd4982798-run-systemd\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.408956 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.408918    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2de62ab2-7502-4c13-a6f0-5ebbd4982798-host-run-ovn-kubernetes\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.409098 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.408965    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3060ca16-de32-4034-8fb1-bda91f17b97d-etc-kubernetes\") pod \"multus-jt4gv\" (UID: \"3060ca16-de32-4034-8fb1-bda91f17b97d\") " pod="openshift-multus/multus-jt4gv"
Jul 15 12:10:55.409098 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.408974    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2de62ab2-7502-4c13-a6f0-5ebbd4982798-host-run-ovn-kubernetes\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.409098 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.408983    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5575e886-e349-487c-9ca0-ad530bea441f-etc-sysctl-conf\") pod \"tuned-qqjzq\" (UID: \"5575e886-e349-487c-9ca0-ad530bea441f\") " pod="openshift-cluster-node-tuning-operator/tuned-qqjzq"
Jul 15 12:10:55.409098 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.408968    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2de62ab2-7502-4c13-a6f0-5ebbd4982798-run-systemd\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.409098 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.409006    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c1e0b090-dace-4704-82e6-0c756006f902-konnectivity-ca\") pod \"konnectivity-agent-gwfk8\" (UID: \"c1e0b090-dace-4704-82e6-0c756006f902\") " pod="kube-system/konnectivity-agent-gwfk8"
Jul 15 12:10:55.409098 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.409059    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnrjk\" (UniqueName: \"kubernetes.io/projected/17bfcad0-727f-42da-b33d-64a2d4cad92a-kube-api-access-qnrjk\") pod \"network-check-target-4mhn5\" (UID: \"17bfcad0-727f-42da-b33d-64a2d4cad92a\") " pod="openshift-network-diagnostics/network-check-target-4mhn5"
Jul 15 12:10:55.409098 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.409075    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5575e886-e349-487c-9ca0-ad530bea441f-etc-sysctl-conf\") pod \"tuned-qqjzq\" (UID: \"5575e886-e349-487c-9ca0-ad530bea441f\") " pod="openshift-cluster-node-tuning-operator/tuned-qqjzq"
Jul 15 12:10:55.409098 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.409092    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4c29b692-3631-4562-96d0-83dad331764b-cni-binary-copy\") pod \"multus-additional-cni-plugins-htv2v\" (UID: \"4c29b692-3631-4562-96d0-83dad331764b\") " pod="openshift-multus/multus-additional-cni-plugins-htv2v"
Jul 15 12:10:55.409521 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.409122    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3060ca16-de32-4034-8fb1-bda91f17b97d-host-var-lib-cni-bin\") pod \"multus-jt4gv\" (UID: \"3060ca16-de32-4034-8fb1-bda91f17b97d\") " pod="openshift-multus/multus-jt4gv"
Jul 15 12:10:55.409521 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.409149    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28vr8\" (UniqueName: \"kubernetes.io/projected/fa83ebd5-2623-4f6e-ba82-c3d428fa0115-kube-api-access-28vr8\") pod \"iptables-alerter-cwldp\" (UID: \"fa83ebd5-2623-4f6e-ba82-c3d428fa0115\") " pod="openshift-network-operator/iptables-alerter-cwldp"
Jul 15 12:10:55.409521 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.409176    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2de62ab2-7502-4c13-a6f0-5ebbd4982798-host-kubelet\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.409521 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.409184    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3060ca16-de32-4034-8fb1-bda91f17b97d-host-var-lib-cni-bin\") pod \"multus-jt4gv\" (UID: \"3060ca16-de32-4034-8fb1-bda91f17b97d\") " pod="openshift-multus/multus-jt4gv"
Jul 15 12:10:55.409521 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.409211    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4c29b692-3631-4562-96d0-83dad331764b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-htv2v\" (UID: \"4c29b692-3631-4562-96d0-83dad331764b\") " pod="openshift-multus/multus-additional-cni-plugins-htv2v"
Jul 15 12:10:55.409521 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.409241    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/48797460-a1a5-43f2-9841-61f8adce425d-original-pull-secret\") pod \"global-pull-secret-syncer-b2c8x\" (UID: \"48797460-a1a5-43f2-9841-61f8adce425d\") " pod="kube-system/global-pull-secret-syncer-b2c8x"
Jul 15 12:10:55.409521 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.409264    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2de62ab2-7502-4c13-a6f0-5ebbd4982798-host-kubelet\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.409521 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.409266    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3060ca16-de32-4034-8fb1-bda91f17b97d-multus-cni-dir\") pod \"multus-jt4gv\" (UID: \"3060ca16-de32-4034-8fb1-bda91f17b97d\") " pod="openshift-multus/multus-jt4gv"
Jul 15 12:10:55.409521 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.409340    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/aab771cb-07af-462f-ac09-166b75eaab99-serviceca\") pod \"node-ca-4tr78\" (UID: \"aab771cb-07af-462f-ac09-166b75eaab99\") " pod="openshift-image-registry/node-ca-4tr78"
Jul 15 12:10:55.409521 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.409373    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2f14aadf-a36b-44ad-bbd6-83181b059d9e-sys-fs\") pod \"aws-ebs-csi-driver-node-ms92n\" (UID: \"2f14aadf-a36b-44ad-bbd6-83181b059d9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms92n"
Jul 15 12:10:55.409521 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.409429    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2f14aadf-a36b-44ad-bbd6-83181b059d9e-sys-fs\") pod \"aws-ebs-csi-driver-node-ms92n\" (UID: \"2f14aadf-a36b-44ad-bbd6-83181b059d9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms92n"
Jul 15 12:10:55.409521 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:55.409387    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 12:10:55.409521 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.409462    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2de62ab2-7502-4c13-a6f0-5ebbd4982798-node-log\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.409521 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.409428    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2de62ab2-7502-4c13-a6f0-5ebbd4982798-node-log\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.409521 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.409491    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3060ca16-de32-4034-8fb1-bda91f17b97d-cni-binary-copy\") pod \"multus-jt4gv\" (UID: \"3060ca16-de32-4034-8fb1-bda91f17b97d\") " pod="openshift-multus/multus-jt4gv"
Jul 15 12:10:55.409521 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.409495    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3060ca16-de32-4034-8fb1-bda91f17b97d-multus-cni-dir\") pod \"multus-jt4gv\" (UID: \"3060ca16-de32-4034-8fb1-bda91f17b97d\") " pod="openshift-multus/multus-jt4gv"
Jul 15 12:10:55.409521 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.409498    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fe1a8d7e-70d9-4b84-8ccd-64e1fc8f803b-hosts-file\") pod \"node-resolver-zcdxd\" (UID: \"fe1a8d7e-70d9-4b84-8ccd-64e1fc8f803b\") " pod="openshift-dns/node-resolver-zcdxd"
Jul 15 12:10:55.410163 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:55.409575    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48797460-a1a5-43f2-9841-61f8adce425d-original-pull-secret podName:48797460-a1a5-43f2-9841-61f8adce425d nodeName:}" failed. No retries permitted until 2026-07-15 12:10:55.909500411 +0000 UTC m=+3.023894139 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/48797460-a1a5-43f2-9841-61f8adce425d-original-pull-secret") pod "global-pull-secret-syncer-b2c8x" (UID: "48797460-a1a5-43f2-9841-61f8adce425d") : object "kube-system"/"original-pull-secret" not registered
Jul 15 12:10:55.410163 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.409601    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5575e886-e349-487c-9ca0-ad530bea441f-etc-tuned\") pod \"tuned-qqjzq\" (UID: \"5575e886-e349-487c-9ca0-ad530bea441f\") " pod="openshift-cluster-node-tuning-operator/tuned-qqjzq"
Jul 15 12:10:55.410163 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.409620    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5575e886-e349-487c-9ca0-ad530bea441f-etc-kubernetes\") pod \"tuned-qqjzq\" (UID: \"5575e886-e349-487c-9ca0-ad530bea441f\") " pod="openshift-cluster-node-tuning-operator/tuned-qqjzq"
Jul 15 12:10:55.410163 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.409644    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kd6p5\" (UniqueName: \"kubernetes.io/projected/19938f5e-4b2c-45f8-9077-4fb510687262-kube-api-access-kd6p5\") pod \"network-metrics-daemon-spl8b\" (UID: \"19938f5e-4b2c-45f8-9077-4fb510687262\") " pod="openshift-multus/network-metrics-daemon-spl8b"
Jul 15 12:10:55.410163 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.409672    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2de62ab2-7502-4c13-a6f0-5ebbd4982798-run-ovn\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.410163 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.409644    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c1e0b090-dace-4704-82e6-0c756006f902-konnectivity-ca\") pod \"konnectivity-agent-gwfk8\" (UID: \"c1e0b090-dace-4704-82e6-0c756006f902\") " pod="kube-system/konnectivity-agent-gwfk8"
Jul 15 12:10:55.410163 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.409706    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5575e886-e349-487c-9ca0-ad530bea441f-etc-kubernetes\") pod \"tuned-qqjzq\" (UID: \"5575e886-e349-487c-9ca0-ad530bea441f\") " pod="openshift-cluster-node-tuning-operator/tuned-qqjzq"
Jul 15 12:10:55.410163 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.409715    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2de62ab2-7502-4c13-a6f0-5ebbd4982798-log-socket\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.410163 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.409758    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2de62ab2-7502-4c13-a6f0-5ebbd4982798-run-ovn\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.410163 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.409765    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5575e886-e349-487c-9ca0-ad530bea441f-etc-sysconfig\") pod \"tuned-qqjzq\" (UID: \"5575e886-e349-487c-9ca0-ad530bea441f\") " pod="openshift-cluster-node-tuning-operator/tuned-qqjzq"
Jul 15 12:10:55.410163 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.409788    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5575e886-e349-487c-9ca0-ad530bea441f-run\") pod \"tuned-qqjzq\" (UID: \"5575e886-e349-487c-9ca0-ad530bea441f\") " pod="openshift-cluster-node-tuning-operator/tuned-qqjzq"
Jul 15 12:10:55.410163 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.409830    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5575e886-e349-487c-9ca0-ad530bea441f-etc-sysconfig\") pod \"tuned-qqjzq\" (UID: \"5575e886-e349-487c-9ca0-ad530bea441f\") " pod="openshift-cluster-node-tuning-operator/tuned-qqjzq"
Jul 15 12:10:55.410163 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.409847    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/aab771cb-07af-462f-ac09-166b75eaab99-serviceca\") pod \"node-ca-4tr78\" (UID: \"aab771cb-07af-462f-ac09-166b75eaab99\") " pod="openshift-image-registry/node-ca-4tr78"
Jul 15 12:10:55.410163 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.409848    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5575e886-e349-487c-9ca0-ad530bea441f-run\") pod \"tuned-qqjzq\" (UID: \"5575e886-e349-487c-9ca0-ad530bea441f\") " pod="openshift-cluster-node-tuning-operator/tuned-qqjzq"
Jul 15 12:10:55.410163 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.409786    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2de62ab2-7502-4c13-a6f0-5ebbd4982798-log-socket\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.410163 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.409929    2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 15 12:10:55.410886 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.410504    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/48797460-a1a5-43f2-9841-61f8adce425d-kubelet-config\") pod \"global-pull-secret-syncer-b2c8x\" (UID: \"48797460-a1a5-43f2-9841-61f8adce425d\") " pod="kube-system/global-pull-secret-syncer-b2c8x"
Jul 15 12:10:55.410886 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.410552    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3060ca16-de32-4034-8fb1-bda91f17b97d-host-var-lib-kubelet\") pod \"multus-jt4gv\" (UID: \"3060ca16-de32-4034-8fb1-bda91f17b97d\") " pod="openshift-multus/multus-jt4gv"
Jul 15 12:10:55.410886 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.410587    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aab771cb-07af-462f-ac09-166b75eaab99-host\") pod \"node-ca-4tr78\" (UID: \"aab771cb-07af-462f-ac09-166b75eaab99\") " pod="openshift-image-registry/node-ca-4tr78"
Jul 15 12:10:55.410886 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.410615    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2de62ab2-7502-4c13-a6f0-5ebbd4982798-ovnkube-script-lib\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.410886 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.410646    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2f14aadf-a36b-44ad-bbd6-83181b059d9e-socket-dir\") pod \"aws-ebs-csi-driver-node-ms92n\" (UID: \"2f14aadf-a36b-44ad-bbd6-83181b059d9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms92n"
Jul 15 12:10:55.410886 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.410645    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/48797460-a1a5-43f2-9841-61f8adce425d-kubelet-config\") pod \"global-pull-secret-syncer-b2c8x\" (UID: \"48797460-a1a5-43f2-9841-61f8adce425d\") " pod="kube-system/global-pull-secret-syncer-b2c8x"
Jul 15 12:10:55.410886 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.410705    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aab771cb-07af-462f-ac09-166b75eaab99-host\") pod \"node-ca-4tr78\" (UID: \"aab771cb-07af-462f-ac09-166b75eaab99\") " pod="openshift-image-registry/node-ca-4tr78"
Jul 15 12:10:55.410886 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.410756    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5575e886-e349-487c-9ca0-ad530bea441f-host\") pod \"tuned-qqjzq\" (UID: \"5575e886-e349-487c-9ca0-ad530bea441f\") " pod="openshift-cluster-node-tuning-operator/tuned-qqjzq"
Jul 15 12:10:55.410886 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.410795    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3060ca16-de32-4034-8fb1-bda91f17b97d-cnibin\") pod \"multus-jt4gv\" (UID: \"3060ca16-de32-4034-8fb1-bda91f17b97d\") " pod="openshift-multus/multus-jt4gv"
Jul 15 12:10:55.410886 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.410832    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3060ca16-de32-4034-8fb1-bda91f17b97d-multus-daemon-config\") pod \"multus-jt4gv\" (UID: \"3060ca16-de32-4034-8fb1-bda91f17b97d\") " pod="openshift-multus/multus-jt4gv"
Jul 15 12:10:55.410886 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.410869    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3060ca16-de32-4034-8fb1-bda91f17b97d-host-run-multus-certs\") pod \"multus-jt4gv\" (UID: \"3060ca16-de32-4034-8fb1-bda91f17b97d\") " pod="openshift-multus/multus-jt4gv"
Jul 15 12:10:55.411446 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.410925    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c29b692-3631-4562-96d0-83dad331764b-system-cni-dir\") pod \"multus-additional-cni-plugins-htv2v\" (UID: \"4c29b692-3631-4562-96d0-83dad331764b\") " pod="openshift-multus/multus-additional-cni-plugins-htv2v"
Jul 15 12:10:55.411446 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.410964    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4c29b692-3631-4562-96d0-83dad331764b-cnibin\") pod \"multus-additional-cni-plugins-htv2v\" (UID: \"4c29b692-3631-4562-96d0-83dad331764b\") " pod="openshift-multus/multus-additional-cni-plugins-htv2v"
Jul 15 12:10:55.411446 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.411002    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7vz8\" (UniqueName: \"kubernetes.io/projected/2f14aadf-a36b-44ad-bbd6-83181b059d9e-kube-api-access-v7vz8\") pod \"aws-ebs-csi-driver-node-ms92n\" (UID: \"2f14aadf-a36b-44ad-bbd6-83181b059d9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms92n"
Jul 15 12:10:55.411446 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.411039    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3060ca16-de32-4034-8fb1-bda91f17b97d-host-var-lib-cni-multus\") pod \"multus-jt4gv\" (UID: \"3060ca16-de32-4034-8fb1-bda91f17b97d\") " pod="openshift-multus/multus-jt4gv"
Jul 15 12:10:55.411446 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.411068    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fa83ebd5-2623-4f6e-ba82-c3d428fa0115-host-slash\") pod \"iptables-alerter-cwldp\" (UID: \"fa83ebd5-2623-4f6e-ba82-c3d428fa0115\") " pod="openshift-network-operator/iptables-alerter-cwldp"
Jul 15 12:10:55.411446 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.411105    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2f14aadf-a36b-44ad-bbd6-83181b059d9e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ms92n\" (UID: \"2f14aadf-a36b-44ad-bbd6-83181b059d9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms92n"
Jul 15 12:10:55.411446 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.411142    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2de62ab2-7502-4c13-a6f0-5ebbd4982798-host-slash\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.411446 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.411176    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2de62ab2-7502-4c13-a6f0-5ebbd4982798-run-openvswitch\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.411446 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.411210    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2de62ab2-7502-4c13-a6f0-5ebbd4982798-host-cni-netd\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.411446 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.411244    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2f14aadf-a36b-44ad-bbd6-83181b059d9e-etc-selinux\") pod \"aws-ebs-csi-driver-node-ms92n\" (UID: \"2f14aadf-a36b-44ad-bbd6-83181b059d9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms92n"
Jul 15 12:10:55.411446 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.411248    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2de62ab2-7502-4c13-a6f0-5ebbd4982798-ovnkube-script-lib\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.411446 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.411279    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2de62ab2-7502-4c13-a6f0-5ebbd4982798-systemd-units\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.411446 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.411314    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5575e886-e349-487c-9ca0-ad530bea441f-var-lib-kubelet\") pod \"tuned-qqjzq\" (UID: \"5575e886-e349-487c-9ca0-ad530bea441f\") " pod="openshift-cluster-node-tuning-operator/tuned-qqjzq"
Jul 15 12:10:55.411446 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.411347    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3060ca16-de32-4034-8fb1-bda91f17b97d-system-cni-dir\") pod \"multus-jt4gv\" (UID: \"3060ca16-de32-4034-8fb1-bda91f17b97d\") " pod="openshift-multus/multus-jt4gv"
Jul 15 12:10:55.411446 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.411367    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2f14aadf-a36b-44ad-bbd6-83181b059d9e-socket-dir\") pod \"aws-ebs-csi-driver-node-ms92n\" (UID: \"2f14aadf-a36b-44ad-bbd6-83181b059d9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms92n"
Jul 15 12:10:55.411446 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.411403    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chkf8\" (UniqueName: \"kubernetes.io/projected/aab771cb-07af-462f-ac09-166b75eaab99-kube-api-access-chkf8\") pod \"node-ca-4tr78\" (UID: \"aab771cb-07af-462f-ac09-166b75eaab99\") " pod="openshift-image-registry/node-ca-4tr78"
Jul 15 12:10:55.411446 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.411439    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3060ca16-de32-4034-8fb1-bda91f17b97d-host-var-lib-cni-multus\") pod \"multus-jt4gv\" (UID: \"3060ca16-de32-4034-8fb1-bda91f17b97d\") " pod="openshift-multus/multus-jt4gv"
Jul 15 12:10:55.412286 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.411449    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2de62ab2-7502-4c13-a6f0-5ebbd4982798-host-run-netns\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.412286 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.411481    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2de62ab2-7502-4c13-a6f0-5ebbd4982798-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.412286 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.411513    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5575e886-e349-487c-9ca0-ad530bea441f-host\") pod \"tuned-qqjzq\" (UID: \"5575e886-e349-487c-9ca0-ad530bea441f\") " pod="openshift-cluster-node-tuning-operator/tuned-qqjzq"
Jul 15 12:10:55.412286 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.411520    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9nsn\" (UniqueName: \"kubernetes.io/projected/2de62ab2-7502-4c13-a6f0-5ebbd4982798-kube-api-access-h9nsn\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.412286 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.411571    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3060ca16-de32-4034-8fb1-bda91f17b97d-cnibin\") pod \"multus-jt4gv\" (UID: \"3060ca16-de32-4034-8fb1-bda91f17b97d\") " pod="openshift-multus/multus-jt4gv"
Jul 15 12:10:55.412286 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.411607    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19938f5e-4b2c-45f8-9077-4fb510687262-metrics-certs\") pod \"network-metrics-daemon-spl8b\" (UID: \"19938f5e-4b2c-45f8-9077-4fb510687262\") " pod="openshift-multus/network-metrics-daemon-spl8b"
Jul 15 12:10:55.412286 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.411641    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe1a8d7e-70d9-4b84-8ccd-64e1fc8f803b-tmp-dir\") pod \"node-resolver-zcdxd\" (UID: \"fe1a8d7e-70d9-4b84-8ccd-64e1fc8f803b\") " pod="openshift-dns/node-resolver-zcdxd"
Jul 15 12:10:55.412286 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.411675    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/48797460-a1a5-43f2-9841-61f8adce425d-dbus\") pod \"global-pull-secret-syncer-b2c8x\" (UID: \"48797460-a1a5-43f2-9841-61f8adce425d\") " pod="kube-system/global-pull-secret-syncer-b2c8x"
Jul 15 12:10:55.412286 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.411702    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3060ca16-de32-4034-8fb1-bda91f17b97d-os-release\") pod \"multus-jt4gv\" (UID: \"3060ca16-de32-4034-8fb1-bda91f17b97d\") " pod="openshift-multus/multus-jt4gv"
Jul 15 12:10:55.412286 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.411733    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjfsq\" (UniqueName: \"kubernetes.io/projected/3060ca16-de32-4034-8fb1-bda91f17b97d-kube-api-access-mjfsq\") pod \"multus-jt4gv\" (UID: \"3060ca16-de32-4034-8fb1-bda91f17b97d\") " pod="openshift-multus/multus-jt4gv"
Jul 15 12:10:55.412286 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.411765    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2de62ab2-7502-4c13-a6f0-5ebbd4982798-host-cni-bin\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.412286 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.411796    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2de62ab2-7502-4c13-a6f0-5ebbd4982798-env-overrides\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.412286 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.411837    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2de62ab2-7502-4c13-a6f0-5ebbd4982798-ovn-node-metrics-cert\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.412286 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.411842    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fa83ebd5-2623-4f6e-ba82-c3d428fa0115-host-slash\") pod \"iptables-alerter-cwldp\" (UID: \"fa83ebd5-2623-4f6e-ba82-c3d428fa0115\") " pod="openshift-network-operator/iptables-alerter-cwldp"
Jul 15 12:10:55.412286 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.411866    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4c29b692-3631-4562-96d0-83dad331764b-os-release\") pod \"multus-additional-cni-plugins-htv2v\" (UID: \"4c29b692-3631-4562-96d0-83dad331764b\") " pod="openshift-multus/multus-additional-cni-plugins-htv2v"
Jul 15 12:10:55.412286 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.411898    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5575e886-e349-487c-9ca0-ad530bea441f-etc-modprobe-d\") pod \"tuned-qqjzq\" (UID: \"5575e886-e349-487c-9ca0-ad530bea441f\") " pod="openshift-cluster-node-tuning-operator/tuned-qqjzq"
Jul 15 12:10:55.412286 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.411916    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2f14aadf-a36b-44ad-bbd6-83181b059d9e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ms92n\" (UID: \"2f14aadf-a36b-44ad-bbd6-83181b059d9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms92n"
Jul 15 12:10:55.413204 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.411927    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5575e886-e349-487c-9ca0-ad530bea441f-sys\") pod \"tuned-qqjzq\" (UID: \"5575e886-e349-487c-9ca0-ad530bea441f\") " pod="openshift-cluster-node-tuning-operator/tuned-qqjzq"
Jul 15 12:10:55.413204 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.411978    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5575e886-e349-487c-9ca0-ad530bea441f-sys\") pod \"tuned-qqjzq\" (UID: \"5575e886-e349-487c-9ca0-ad530bea441f\") " pod="openshift-cluster-node-tuning-operator/tuned-qqjzq"
Jul 15 12:10:55.413204 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.411986    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2de62ab2-7502-4c13-a6f0-5ebbd4982798-host-slash\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.413204 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.412016    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3060ca16-de32-4034-8fb1-bda91f17b97d-multus-socket-dir-parent\") pod \"multus-jt4gv\" (UID: \"3060ca16-de32-4034-8fb1-bda91f17b97d\") " pod="openshift-multus/multus-jt4gv"
Jul 15 12:10:55.413204 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.412040    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2de62ab2-7502-4c13-a6f0-5ebbd4982798-run-openvswitch\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.413204 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.412049    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3060ca16-de32-4034-8fb1-bda91f17b97d-host-run-k8s-cni-cncf-io\") pod \"multus-jt4gv\" (UID: \"3060ca16-de32-4034-8fb1-bda91f17b97d\") " pod="openshift-multus/multus-jt4gv"
Jul 15 12:10:55.413204 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.412091    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2de62ab2-7502-4c13-a6f0-5ebbd4982798-host-cni-netd\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.413204 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.412098    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3060ca16-de32-4034-8fb1-bda91f17b97d-host-run-k8s-cni-cncf-io\") pod \"multus-jt4gv\" (UID: \"3060ca16-de32-4034-8fb1-bda91f17b97d\") " pod="openshift-multus/multus-jt4gv"
Jul 15 12:10:55.413204 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.412158    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3060ca16-de32-4034-8fb1-bda91f17b97d-host-run-multus-certs\") pod \"multus-jt4gv\" (UID: \"3060ca16-de32-4034-8fb1-bda91f17b97d\") " pod="openshift-multus/multus-jt4gv"
Jul 15 12:10:55.413204 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.412406    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2de62ab2-7502-4c13-a6f0-5ebbd4982798-host-run-netns\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.413204 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.412468    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3060ca16-de32-4034-8fb1-bda91f17b97d-host-var-lib-kubelet\") pod \"multus-jt4gv\" (UID: \"3060ca16-de32-4034-8fb1-bda91f17b97d\") " pod="openshift-multus/multus-jt4gv"
Jul 15 12:10:55.413204 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:55.412506    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 12:10:55.413204 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:55.412565    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19938f5e-4b2c-45f8-9077-4fb510687262-metrics-certs podName:19938f5e-4b2c-45f8-9077-4fb510687262 nodeName:}" failed. No retries permitted until 2026-07-15 12:10:55.912547419 +0000 UTC m=+3.026941131 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19938f5e-4b2c-45f8-9077-4fb510687262-metrics-certs") pod "network-metrics-daemon-spl8b" (UID: "19938f5e-4b2c-45f8-9077-4fb510687262") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 12:10:55.413204 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.412641    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/48797460-a1a5-43f2-9841-61f8adce425d-dbus\") pod \"global-pull-secret-syncer-b2c8x\" (UID: \"48797460-a1a5-43f2-9841-61f8adce425d\") " pod="kube-system/global-pull-secret-syncer-b2c8x"
Jul 15 12:10:55.413204 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.412706    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3060ca16-de32-4034-8fb1-bda91f17b97d-os-release\") pod \"multus-jt4gv\" (UID: \"3060ca16-de32-4034-8fb1-bda91f17b97d\") " pod="openshift-multus/multus-jt4gv"
Jul 15 12:10:55.413204 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.412936    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2de62ab2-7502-4c13-a6f0-5ebbd4982798-host-cni-bin\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.413204 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.412955    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3060ca16-de32-4034-8fb1-bda91f17b97d-multus-daemon-config\") pod \"multus-jt4gv\" (UID: \"3060ca16-de32-4034-8fb1-bda91f17b97d\") " pod="openshift-multus/multus-jt4gv"
Jul 15 12:10:55.414126 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.413388    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2de62ab2-7502-4c13-a6f0-5ebbd4982798-env-overrides\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.414126 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.413477    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5575e886-e349-487c-9ca0-ad530bea441f-var-lib-kubelet\") pod \"tuned-qqjzq\" (UID: \"5575e886-e349-487c-9ca0-ad530bea441f\") " pod="openshift-cluster-node-tuning-operator/tuned-qqjzq"
Jul 15 12:10:55.414126 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.413542    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3060ca16-de32-4034-8fb1-bda91f17b97d-system-cni-dir\") pod \"multus-jt4gv\" (UID: \"3060ca16-de32-4034-8fb1-bda91f17b97d\") " pod="openshift-multus/multus-jt4gv"
Jul 15 12:10:55.414126 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.413598    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2de62ab2-7502-4c13-a6f0-5ebbd4982798-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.414126 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.413638    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2f14aadf-a36b-44ad-bbd6-83181b059d9e-registration-dir\") pod \"aws-ebs-csi-driver-node-ms92n\" (UID: \"2f14aadf-a36b-44ad-bbd6-83181b059d9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms92n"
Jul 15 12:10:55.414126 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.413675    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2f14aadf-a36b-44ad-bbd6-83181b059d9e-device-dir\") pod \"aws-ebs-csi-driver-node-ms92n\" (UID: \"2f14aadf-a36b-44ad-bbd6-83181b059d9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms92n"
Jul 15 12:10:55.414126 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.413698    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5575e886-e349-487c-9ca0-ad530bea441f-etc-modprobe-d\") pod \"tuned-qqjzq\" (UID: \"5575e886-e349-487c-9ca0-ad530bea441f\") " pod="openshift-cluster-node-tuning-operator/tuned-qqjzq"
Jul 15 12:10:55.414126 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.413715    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4c29b692-3631-4562-96d0-83dad331764b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-htv2v\" (UID: \"4c29b692-3631-4562-96d0-83dad331764b\") " pod="openshift-multus/multus-additional-cni-plugins-htv2v"
Jul 15 12:10:55.414126 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.413746    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5575e886-e349-487c-9ca0-ad530bea441f-etc-sysctl-d\") pod \"tuned-qqjzq\" (UID: \"5575e886-e349-487c-9ca0-ad530bea441f\") " pod="openshift-cluster-node-tuning-operator/tuned-qqjzq"
Jul 15 12:10:55.414126 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.413768    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3060ca16-de32-4034-8fb1-bda91f17b97d-multus-socket-dir-parent\") pod \"multus-jt4gv\" (UID: \"3060ca16-de32-4034-8fb1-bda91f17b97d\") " pod="openshift-multus/multus-jt4gv"
Jul 15 12:10:55.414126 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.413783    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbxqj\" (UniqueName: \"kubernetes.io/projected/5575e886-e349-487c-9ca0-ad530bea441f-kube-api-access-qbxqj\") pod \"tuned-qqjzq\" (UID: \"5575e886-e349-487c-9ca0-ad530bea441f\") " pod="openshift-cluster-node-tuning-operator/tuned-qqjzq"
Jul 15 12:10:55.414126 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.413821    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c1e0b090-dace-4704-82e6-0c756006f902-agent-certs\") pod \"konnectivity-agent-gwfk8\" (UID: \"c1e0b090-dace-4704-82e6-0c756006f902\") " pod="kube-system/konnectivity-agent-gwfk8"
Jul 15 12:10:55.414126 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.413836    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2f14aadf-a36b-44ad-bbd6-83181b059d9e-registration-dir\") pod \"aws-ebs-csi-driver-node-ms92n\" (UID: \"2f14aadf-a36b-44ad-bbd6-83181b059d9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms92n"
Jul 15 12:10:55.414126 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.413853    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3060ca16-de32-4034-8fb1-bda91f17b97d-hostroot\") pod \"multus-jt4gv\" (UID: \"3060ca16-de32-4034-8fb1-bda91f17b97d\") " pod="openshift-multus/multus-jt4gv"
Jul 15 12:10:55.414126 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.413888    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3060ca16-de32-4034-8fb1-bda91f17b97d-multus-conf-dir\") pod \"multus-jt4gv\" (UID: \"3060ca16-de32-4034-8fb1-bda91f17b97d\") " pod="openshift-multus/multus-jt4gv"
Jul 15 12:10:55.414126 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.413922    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2f14aadf-a36b-44ad-bbd6-83181b059d9e-etc-selinux\") pod \"aws-ebs-csi-driver-node-ms92n\" (UID: \"2f14aadf-a36b-44ad-bbd6-83181b059d9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms92n"
Jul 15 12:10:55.414126 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.413922    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2de62ab2-7502-4c13-a6f0-5ebbd4982798-etc-openvswitch\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.414996 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.413960    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2de62ab2-7502-4c13-a6f0-5ebbd4982798-etc-openvswitch\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.414996 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.413967    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2de62ab2-7502-4c13-a6f0-5ebbd4982798-ovnkube-config\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.414996 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.414001    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4c29b692-3631-4562-96d0-83dad331764b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-htv2v\" (UID: \"4c29b692-3631-4562-96d0-83dad331764b\") " pod="openshift-multus/multus-additional-cni-plugins-htv2v"
Jul 15 12:10:55.414996 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.414038    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5575e886-e349-487c-9ca0-ad530bea441f-lib-modules\") pod \"tuned-qqjzq\" (UID: \"5575e886-e349-487c-9ca0-ad530bea441f\") " pod="openshift-cluster-node-tuning-operator/tuned-qqjzq"
Jul 15 12:10:55.414996 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.414072    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3060ca16-de32-4034-8fb1-bda91f17b97d-host-run-netns\") pod \"multus-jt4gv\" (UID: \"3060ca16-de32-4034-8fb1-bda91f17b97d\") " pod="openshift-multus/multus-jt4gv"
Jul 15 12:10:55.414996 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.414102    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fa83ebd5-2623-4f6e-ba82-c3d428fa0115-iptables-alerter-script\") pod \"iptables-alerter-cwldp\" (UID: \"fa83ebd5-2623-4f6e-ba82-c3d428fa0115\") " pod="openshift-network-operator/iptables-alerter-cwldp"
Jul 15 12:10:55.414996 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.414145    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2de62ab2-7502-4c13-a6f0-5ebbd4982798-systemd-units\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.414996 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.414156    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3060ca16-de32-4034-8fb1-bda91f17b97d-hostroot\") pod \"multus-jt4gv\" (UID: \"3060ca16-de32-4034-8fb1-bda91f17b97d\") " pod="openshift-multus/multus-jt4gv"
Jul 15 12:10:55.414996 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.414239    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3060ca16-de32-4034-8fb1-bda91f17b97d-multus-conf-dir\") pod \"multus-jt4gv\" (UID: \"3060ca16-de32-4034-8fb1-bda91f17b97d\") " pod="openshift-multus/multus-jt4gv"
Jul 15 12:10:55.414996 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.414358    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2de62ab2-7502-4c13-a6f0-5ebbd4982798-var-lib-openvswitch\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.414996 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.414465    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5575e886-e349-487c-9ca0-ad530bea441f-etc-sysctl-d\") pod \"tuned-qqjzq\" (UID: \"5575e886-e349-487c-9ca0-ad530bea441f\") " pod="openshift-cluster-node-tuning-operator/tuned-qqjzq"
Jul 15 12:10:55.414996 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.414518    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3060ca16-de32-4034-8fb1-bda91f17b97d-host-run-netns\") pod \"multus-jt4gv\" (UID: \"3060ca16-de32-4034-8fb1-bda91f17b97d\") " pod="openshift-multus/multus-jt4gv"
Jul 15 12:10:55.414996 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.414524    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6pfl\" (UniqueName: \"kubernetes.io/projected/4c29b692-3631-4562-96d0-83dad331764b-kube-api-access-m6pfl\") pod \"multus-additional-cni-plugins-htv2v\" (UID: \"4c29b692-3631-4562-96d0-83dad331764b\") " pod="openshift-multus/multus-additional-cni-plugins-htv2v"
Jul 15 12:10:55.414996 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.414578    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2f14aadf-a36b-44ad-bbd6-83181b059d9e-device-dir\") pod \"aws-ebs-csi-driver-node-ms92n\" (UID: \"2f14aadf-a36b-44ad-bbd6-83181b059d9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms92n"
Jul 15 12:10:55.414996 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.414667    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5575e886-e349-487c-9ca0-ad530bea441f-lib-modules\") pod \"tuned-qqjzq\" (UID: \"5575e886-e349-487c-9ca0-ad530bea441f\") " pod="openshift-cluster-node-tuning-operator/tuned-qqjzq"
Jul 15 12:10:55.414996 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.414715    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2de62ab2-7502-4c13-a6f0-5ebbd4982798-var-lib-openvswitch\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.414996 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.414815    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6kq5\" (UniqueName: \"kubernetes.io/projected/fe1a8d7e-70d9-4b84-8ccd-64e1fc8f803b-kube-api-access-d6kq5\") pod \"node-resolver-zcdxd\" (UID: \"fe1a8d7e-70d9-4b84-8ccd-64e1fc8f803b\") " pod="openshift-dns/node-resolver-zcdxd"
Jul 15 12:10:55.415930 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.414874    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5575e886-e349-487c-9ca0-ad530bea441f-etc-systemd\") pod \"tuned-qqjzq\" (UID: \"5575e886-e349-487c-9ca0-ad530bea441f\") " pod="openshift-cluster-node-tuning-operator/tuned-qqjzq"
Jul 15 12:10:55.415930 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.415031    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fa83ebd5-2623-4f6e-ba82-c3d428fa0115-iptables-alerter-script\") pod \"iptables-alerter-cwldp\" (UID: \"fa83ebd5-2623-4f6e-ba82-c3d428fa0115\") " pod="openshift-network-operator/iptables-alerter-cwldp"
Jul 15 12:10:55.415930 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.415039    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5575e886-e349-487c-9ca0-ad530bea441f-tmp\") pod \"tuned-qqjzq\" (UID: \"5575e886-e349-487c-9ca0-ad530bea441f\") " pod="openshift-cluster-node-tuning-operator/tuned-qqjzq"
Jul 15 12:10:55.415930 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.415033    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5575e886-e349-487c-9ca0-ad530bea441f-etc-systemd\") pod \"tuned-qqjzq\" (UID: \"5575e886-e349-487c-9ca0-ad530bea441f\") " pod="openshift-cluster-node-tuning-operator/tuned-qqjzq"
Jul 15 12:10:55.415930 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.415104    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2de62ab2-7502-4c13-a6f0-5ebbd4982798-ovnkube-config\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.416781 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.416759    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5575e886-e349-487c-9ca0-ad530bea441f-etc-tuned\") pod \"tuned-qqjzq\" (UID: \"5575e886-e349-487c-9ca0-ad530bea441f\") " pod="openshift-cluster-node-tuning-operator/tuned-qqjzq"
Jul 15 12:10:55.416964 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.416931    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2de62ab2-7502-4c13-a6f0-5ebbd4982798-ovn-node-metrics-cert\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.417635 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.417616    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5575e886-e349-487c-9ca0-ad530bea441f-tmp\") pod \"tuned-qqjzq\" (UID: \"5575e886-e349-487c-9ca0-ad530bea441f\") " pod="openshift-cluster-node-tuning-operator/tuned-qqjzq"
Jul 15 12:10:55.418169 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.418151    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c1e0b090-dace-4704-82e6-0c756006f902-agent-certs\") pod \"konnectivity-agent-gwfk8\" (UID: \"c1e0b090-dace-4704-82e6-0c756006f902\") " pod="kube-system/konnectivity-agent-gwfk8"
Jul 15 12:10:55.418299 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.418279    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28vr8\" (UniqueName: \"kubernetes.io/projected/fa83ebd5-2623-4f6e-ba82-c3d428fa0115-kube-api-access-28vr8\") pod \"iptables-alerter-cwldp\" (UID: \"fa83ebd5-2623-4f6e-ba82-c3d428fa0115\") " pod="openshift-network-operator/iptables-alerter-cwldp"
Jul 15 12:10:55.418521 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.418504    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kd6p5\" (UniqueName: \"kubernetes.io/projected/19938f5e-4b2c-45f8-9077-4fb510687262-kube-api-access-kd6p5\") pod \"network-metrics-daemon-spl8b\" (UID: \"19938f5e-4b2c-45f8-9077-4fb510687262\") " pod="openshift-multus/network-metrics-daemon-spl8b"
Jul 15 12:10:55.428867 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.428843    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9nsn\" (UniqueName: \"kubernetes.io/projected/2de62ab2-7502-4c13-a6f0-5ebbd4982798-kube-api-access-h9nsn\") pod \"ovnkube-node-xh4rs\" (UID: \"2de62ab2-7502-4c13-a6f0-5ebbd4982798\") " pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.429740 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.429723    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chkf8\" (UniqueName: \"kubernetes.io/projected/aab771cb-07af-462f-ac09-166b75eaab99-kube-api-access-chkf8\") pod \"node-ca-4tr78\" (UID: \"aab771cb-07af-462f-ac09-166b75eaab99\") " pod="openshift-image-registry/node-ca-4tr78"
Jul 15 12:10:55.429856 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.429789    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjfsq\" (UniqueName: \"kubernetes.io/projected/3060ca16-de32-4034-8fb1-bda91f17b97d-kube-api-access-mjfsq\") pod \"multus-jt4gv\" (UID: \"3060ca16-de32-4034-8fb1-bda91f17b97d\") " pod="openshift-multus/multus-jt4gv"
Jul 15 12:10:55.430036 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.430017    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7vz8\" (UniqueName: \"kubernetes.io/projected/2f14aadf-a36b-44ad-bbd6-83181b059d9e-kube-api-access-v7vz8\") pod \"aws-ebs-csi-driver-node-ms92n\" (UID: \"2f14aadf-a36b-44ad-bbd6-83181b059d9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms92n"
Jul 15 12:10:55.430110 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.430079    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbxqj\" (UniqueName: \"kubernetes.io/projected/5575e886-e349-487c-9ca0-ad530bea441f-kube-api-access-qbxqj\") pod \"tuned-qqjzq\" (UID: \"5575e886-e349-487c-9ca0-ad530bea441f\") " pod="openshift-cluster-node-tuning-operator/tuned-qqjzq"
Jul 15 12:10:55.441465 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.441429    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-186.ec2.internal" event={"ID":"b44d4f1a13a5598713990a6a605902da","Type":"ContainerStarted","Data":"3366b5d466cc46fecadef5d59135e48a67054e5b5d7a55c5ff716cfe2c77c70d"}
Jul 15 12:10:55.515690 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.515652    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnrjk\" (UniqueName: \"kubernetes.io/projected/17bfcad0-727f-42da-b33d-64a2d4cad92a-kube-api-access-qnrjk\") pod \"network-check-target-4mhn5\" (UID: \"17bfcad0-727f-42da-b33d-64a2d4cad92a\") " pod="openshift-network-diagnostics/network-check-target-4mhn5"
Jul 15 12:10:55.515810 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.515693    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4c29b692-3631-4562-96d0-83dad331764b-cni-binary-copy\") pod \"multus-additional-cni-plugins-htv2v\" (UID: \"4c29b692-3631-4562-96d0-83dad331764b\") " pod="openshift-multus/multus-additional-cni-plugins-htv2v"
Jul 15 12:10:55.515810 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.515715    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4c29b692-3631-4562-96d0-83dad331764b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-htv2v\" (UID: \"4c29b692-3631-4562-96d0-83dad331764b\") " pod="openshift-multus/multus-additional-cni-plugins-htv2v"
Jul 15 12:10:55.515810 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.515758    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fe1a8d7e-70d9-4b84-8ccd-64e1fc8f803b-hosts-file\") pod \"node-resolver-zcdxd\" (UID: \"fe1a8d7e-70d9-4b84-8ccd-64e1fc8f803b\") " pod="openshift-dns/node-resolver-zcdxd"
Jul 15 12:10:55.515810 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.515801    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c29b692-3631-4562-96d0-83dad331764b-system-cni-dir\") pod \"multus-additional-cni-plugins-htv2v\" (UID: \"4c29b692-3631-4562-96d0-83dad331764b\") " pod="openshift-multus/multus-additional-cni-plugins-htv2v"
Jul 15 12:10:55.515969 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.515825    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4c29b692-3631-4562-96d0-83dad331764b-cnibin\") pod \"multus-additional-cni-plugins-htv2v\" (UID: \"4c29b692-3631-4562-96d0-83dad331764b\") " pod="openshift-multus/multus-additional-cni-plugins-htv2v"
Jul 15 12:10:55.515969 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.515833    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fe1a8d7e-70d9-4b84-8ccd-64e1fc8f803b-hosts-file\") pod \"node-resolver-zcdxd\" (UID: \"fe1a8d7e-70d9-4b84-8ccd-64e1fc8f803b\") " pod="openshift-dns/node-resolver-zcdxd"
Jul 15 12:10:55.515969 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.515872    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe1a8d7e-70d9-4b84-8ccd-64e1fc8f803b-tmp-dir\") pod \"node-resolver-zcdxd\" (UID: \"fe1a8d7e-70d9-4b84-8ccd-64e1fc8f803b\") " pod="openshift-dns/node-resolver-zcdxd"
Jul 15 12:10:55.515969 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.515890    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c29b692-3631-4562-96d0-83dad331764b-system-cni-dir\") pod \"multus-additional-cni-plugins-htv2v\" (UID: \"4c29b692-3631-4562-96d0-83dad331764b\") " pod="openshift-multus/multus-additional-cni-plugins-htv2v"
Jul 15 12:10:55.515969 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.515901    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4c29b692-3631-4562-96d0-83dad331764b-os-release\") pod \"multus-additional-cni-plugins-htv2v\" (UID: \"4c29b692-3631-4562-96d0-83dad331764b\") " pod="openshift-multus/multus-additional-cni-plugins-htv2v"
Jul 15 12:10:55.515969 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.515915    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4c29b692-3631-4562-96d0-83dad331764b-cnibin\") pod \"multus-additional-cni-plugins-htv2v\" (UID: \"4c29b692-3631-4562-96d0-83dad331764b\") " pod="openshift-multus/multus-additional-cni-plugins-htv2v"
Jul 15 12:10:55.515969 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.515932    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4c29b692-3631-4562-96d0-83dad331764b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-htv2v\" (UID: \"4c29b692-3631-4562-96d0-83dad331764b\") " pod="openshift-multus/multus-additional-cni-plugins-htv2v"
Jul 15 12:10:55.516380 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.515976    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4c29b692-3631-4562-96d0-83dad331764b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-htv2v\" (UID: \"4c29b692-3631-4562-96d0-83dad331764b\") " pod="openshift-multus/multus-additional-cni-plugins-htv2v"
Jul 15 12:10:55.516380 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.516014    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6pfl\" (UniqueName: \"kubernetes.io/projected/4c29b692-3631-4562-96d0-83dad331764b-kube-api-access-m6pfl\") pod \"multus-additional-cni-plugins-htv2v\" (UID: \"4c29b692-3631-4562-96d0-83dad331764b\") " pod="openshift-multus/multus-additional-cni-plugins-htv2v"
Jul 15 12:10:55.516380 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.516040    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6kq5\" (UniqueName: \"kubernetes.io/projected/fe1a8d7e-70d9-4b84-8ccd-64e1fc8f803b-kube-api-access-d6kq5\") pod \"node-resolver-zcdxd\" (UID: \"fe1a8d7e-70d9-4b84-8ccd-64e1fc8f803b\") " pod="openshift-dns/node-resolver-zcdxd"
Jul 15 12:10:55.516380 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.516060    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4c29b692-3631-4562-96d0-83dad331764b-os-release\") pod \"multus-additional-cni-plugins-htv2v\" (UID: \"4c29b692-3631-4562-96d0-83dad331764b\") " pod="openshift-multus/multus-additional-cni-plugins-htv2v"
Jul 15 12:10:55.516380 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.516246    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe1a8d7e-70d9-4b84-8ccd-64e1fc8f803b-tmp-dir\") pod \"node-resolver-zcdxd\" (UID: \"fe1a8d7e-70d9-4b84-8ccd-64e1fc8f803b\") " pod="openshift-dns/node-resolver-zcdxd"
Jul 15 12:10:55.516380 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.516251    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4c29b692-3631-4562-96d0-83dad331764b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-htv2v\" (UID: \"4c29b692-3631-4562-96d0-83dad331764b\") " pod="openshift-multus/multus-additional-cni-plugins-htv2v"
Jul 15 12:10:55.516380 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.516365    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4c29b692-3631-4562-96d0-83dad331764b-cni-binary-copy\") pod \"multus-additional-cni-plugins-htv2v\" (UID: \"4c29b692-3631-4562-96d0-83dad331764b\") " pod="openshift-multus/multus-additional-cni-plugins-htv2v"
Jul 15 12:10:55.516610 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.516467    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4c29b692-3631-4562-96d0-83dad331764b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-htv2v\" (UID: \"4c29b692-3631-4562-96d0-83dad331764b\") " pod="openshift-multus/multus-additional-cni-plugins-htv2v"
Jul 15 12:10:55.516610 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.516471    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4c29b692-3631-4562-96d0-83dad331764b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-htv2v\" (UID: \"4c29b692-3631-4562-96d0-83dad331764b\") " pod="openshift-multus/multus-additional-cni-plugins-htv2v"
Jul 15 12:10:55.521722 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:55.521703    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 12:10:55.521722 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:55.521721    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 12:10:55.521822 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:55.521731    2560 projected.go:196] Error preparing data for projected volume kube-api-access-qnrjk for pod openshift-network-diagnostics/network-check-target-4mhn5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 12:10:55.521822 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:55.521785    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17bfcad0-727f-42da-b33d-64a2d4cad92a-kube-api-access-qnrjk podName:17bfcad0-727f-42da-b33d-64a2d4cad92a nodeName:}" failed. No retries permitted until 2026-07-15 12:10:56.021768568 +0000 UTC m=+3.136162302 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qnrjk" (UniqueName: "kubernetes.io/projected/17bfcad0-727f-42da-b33d-64a2d4cad92a-kube-api-access-qnrjk") pod "network-check-target-4mhn5" (UID: "17bfcad0-727f-42da-b33d-64a2d4cad92a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 12:10:55.523649 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.523627    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6pfl\" (UniqueName: \"kubernetes.io/projected/4c29b692-3631-4562-96d0-83dad331764b-kube-api-access-m6pfl\") pod \"multus-additional-cni-plugins-htv2v\" (UID: \"4c29b692-3631-4562-96d0-83dad331764b\") " pod="openshift-multus/multus-additional-cni-plugins-htv2v"
Jul 15 12:10:55.523794 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.523756    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6kq5\" (UniqueName: \"kubernetes.io/projected/fe1a8d7e-70d9-4b84-8ccd-64e1fc8f803b-kube-api-access-d6kq5\") pod \"node-resolver-zcdxd\" (UID: \"fe1a8d7e-70d9-4b84-8ccd-64e1fc8f803b\") " pod="openshift-dns/node-resolver-zcdxd"
Jul 15 12:10:55.528481 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.528463    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 12:10:55.597893 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.597868    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jt4gv"
Jul 15 12:10:55.605364 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.605349    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4tr78"
Jul 15 12:10:55.607556 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:55.607535    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3060ca16_de32_4034_8fb1_bda91f17b97d.slice/crio-d43ce3a04a2ced261f54aad94bd5c6b6cfc8e2454275d33649f2ef2e46be53a1 WatchSource:0}: Error finding container d43ce3a04a2ced261f54aad94bd5c6b6cfc8e2454275d33649f2ef2e46be53a1: Status 404 returned error can't find the container with id d43ce3a04a2ced261f54aad94bd5c6b6cfc8e2454275d33649f2ef2e46be53a1
Jul 15 12:10:55.612678 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.612660    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cwldp"
Jul 15 12:10:55.612964 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:55.612942    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaab771cb_07af_462f_ac09_166b75eaab99.slice/crio-80f36a4a4062c86aeb64e762dfb3fd596c75bb7bdec9aae6d4050a5a1825cae4 WatchSource:0}: Error finding container 80f36a4a4062c86aeb64e762dfb3fd596c75bb7bdec9aae6d4050a5a1825cae4: Status 404 returned error can't find the container with id 80f36a4a4062c86aeb64e762dfb3fd596c75bb7bdec9aae6d4050a5a1825cae4
Jul 15 12:10:55.617628 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.617610    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:10:55.620647 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:55.620613    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa83ebd5_2623_4f6e_ba82_c3d428fa0115.slice/crio-e04f4901c3e90ad218c85b9a1fa08d2f6ebd0ac3be43c55e44c3937f7ba6b91e WatchSource:0}: Error finding container e04f4901c3e90ad218c85b9a1fa08d2f6ebd0ac3be43c55e44c3937f7ba6b91e: Status 404 returned error can't find the container with id e04f4901c3e90ad218c85b9a1fa08d2f6ebd0ac3be43c55e44c3937f7ba6b91e
Jul 15 12:10:55.624177 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.624160    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qqjzq"
Jul 15 12:10:55.626072 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:55.626055    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2de62ab2_7502_4c13_a6f0_5ebbd4982798.slice/crio-4ef033e044811fc05d96efdbe8b457f9e8d5ee8d416a8f9d3559ad3e2c055204 WatchSource:0}: Error finding container 4ef033e044811fc05d96efdbe8b457f9e8d5ee8d416a8f9d3559ad3e2c055204: Status 404 returned error can't find the container with id 4ef033e044811fc05d96efdbe8b457f9e8d5ee8d416a8f9d3559ad3e2c055204
Jul 15 12:10:55.629467 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.629445    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gwfk8"
Jul 15 12:10:55.635532 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.635517    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms92n"
Jul 15 12:10:55.641436 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.641416    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zcdxd"
Jul 15 12:10:55.642094 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:55.642069    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5575e886_e349_487c_9ca0_ad530bea441f.slice/crio-5dc6dc2cc5f6dfdbb7ced39cee7af5830bc74b50284c9132d389a965c3a4bfa7 WatchSource:0}: Error finding container 5dc6dc2cc5f6dfdbb7ced39cee7af5830bc74b50284c9132d389a965c3a4bfa7: Status 404 returned error can't find the container with id 5dc6dc2cc5f6dfdbb7ced39cee7af5830bc74b50284c9132d389a965c3a4bfa7
Jul 15 12:10:55.645325 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.645307    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-htv2v"
Jul 15 12:10:55.647010 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:55.646984    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1e0b090_dace_4704_82e6_0c756006f902.slice/crio-ee23b4915a4bfdfa19a3d422ffb3cd410754f52fa8e769f6ef167c1db6bd674b WatchSource:0}: Error finding container ee23b4915a4bfdfa19a3d422ffb3cd410754f52fa8e769f6ef167c1db6bd674b: Status 404 returned error can't find the container with id ee23b4915a4bfdfa19a3d422ffb3cd410754f52fa8e769f6ef167c1db6bd674b
Jul 15 12:10:55.647698 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:55.647620    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f14aadf_a36b_44ad_bbd6_83181b059d9e.slice/crio-9a91a5d44858a83b3580d14d0a7a8ad1ec0a8e05019fac7bf9f31aa15d044445 WatchSource:0}: Error finding container 9a91a5d44858a83b3580d14d0a7a8ad1ec0a8e05019fac7bf9f31aa15d044445: Status 404 returned error can't find the container with id 9a91a5d44858a83b3580d14d0a7a8ad1ec0a8e05019fac7bf9f31aa15d044445
Jul 15 12:10:55.648991 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:55.648970    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26e0df4d83bbe2ba7879e2ef9a112d54.slice/crio-e32924c555c59c39129fe9faef7667ba7fd0286596f2d5688fbafab924fe6e8a WatchSource:0}: Error finding container e32924c555c59c39129fe9faef7667ba7fd0286596f2d5688fbafab924fe6e8a: Status 404 returned error can't find the container with id e32924c555c59c39129fe9faef7667ba7fd0286596f2d5688fbafab924fe6e8a
Jul 15 12:10:55.654893 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:55.654873    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe1a8d7e_70d9_4b84_8ccd_64e1fc8f803b.slice/crio-d8168a20bb134bb1428f9f9c16d108224d0ea7d6d436918cd55bd9904d2e4954 WatchSource:0}: Error finding container d8168a20bb134bb1428f9f9c16d108224d0ea7d6d436918cd55bd9904d2e4954: Status 404 returned error can't find the container with id d8168a20bb134bb1428f9f9c16d108224d0ea7d6d436918cd55bd9904d2e4954
Jul 15 12:10:55.656151 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:10:55.656130    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c29b692_3631_4562_96d0_83dad331764b.slice/crio-e6eff4034b80208ec4e052b0510fab3008fcf005f60bf4313eb4eb13a7088d6d WatchSource:0}: Error finding container e6eff4034b80208ec4e052b0510fab3008fcf005f60bf4313eb4eb13a7088d6d: Status 404 returned error can't find the container with id e6eff4034b80208ec4e052b0510fab3008fcf005f60bf4313eb4eb13a7088d6d
Jul 15 12:10:55.920394 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.920282    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19938f5e-4b2c-45f8-9077-4fb510687262-metrics-certs\") pod \"network-metrics-daemon-spl8b\" (UID: \"19938f5e-4b2c-45f8-9077-4fb510687262\") " pod="openshift-multus/network-metrics-daemon-spl8b"
Jul 15 12:10:55.920394 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:55.920372    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/48797460-a1a5-43f2-9841-61f8adce425d-original-pull-secret\") pod \"global-pull-secret-syncer-b2c8x\" (UID: \"48797460-a1a5-43f2-9841-61f8adce425d\") " pod="kube-system/global-pull-secret-syncer-b2c8x"
Jul 15 12:10:55.920573 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:55.920426    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 12:10:55.920573 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:55.920467    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 12:10:55.920573 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:55.920496    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19938f5e-4b2c-45f8-9077-4fb510687262-metrics-certs podName:19938f5e-4b2c-45f8-9077-4fb510687262 nodeName:}" failed. No retries permitted until 2026-07-15 12:10:56.920478349 +0000 UTC m=+4.034872061 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19938f5e-4b2c-45f8-9077-4fb510687262-metrics-certs") pod "network-metrics-daemon-spl8b" (UID: "19938f5e-4b2c-45f8-9077-4fb510687262") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 12:10:55.920573 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:55.920514    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48797460-a1a5-43f2-9841-61f8adce425d-original-pull-secret podName:48797460-a1a5-43f2-9841-61f8adce425d nodeName:}" failed. No retries permitted until 2026-07-15 12:10:56.920505728 +0000 UTC m=+4.034899440 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/48797460-a1a5-43f2-9841-61f8adce425d-original-pull-secret") pod "global-pull-secret-syncer-b2c8x" (UID: "48797460-a1a5-43f2-9841-61f8adce425d") : object "kube-system"/"original-pull-secret" not registered
Jul 15 12:10:56.122101 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:56.122063    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnrjk\" (UniqueName: \"kubernetes.io/projected/17bfcad0-727f-42da-b33d-64a2d4cad92a-kube-api-access-qnrjk\") pod \"network-check-target-4mhn5\" (UID: \"17bfcad0-727f-42da-b33d-64a2d4cad92a\") " pod="openshift-network-diagnostics/network-check-target-4mhn5"
Jul 15 12:10:56.122326 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:56.122236    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 12:10:56.122326 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:56.122265    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 12:10:56.122326 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:56.122283    2560 projected.go:196] Error preparing data for projected volume kube-api-access-qnrjk for pod openshift-network-diagnostics/network-check-target-4mhn5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 12:10:56.122515 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:56.122366    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17bfcad0-727f-42da-b33d-64a2d4cad92a-kube-api-access-qnrjk podName:17bfcad0-727f-42da-b33d-64a2d4cad92a nodeName:}" failed. No retries permitted until 2026-07-15 12:10:57.12234412 +0000 UTC m=+4.236737851 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qnrjk" (UniqueName: "kubernetes.io/projected/17bfcad0-727f-42da-b33d-64a2d4cad92a-kube-api-access-qnrjk") pod "network-check-target-4mhn5" (UID: "17bfcad0-727f-42da-b33d-64a2d4cad92a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 12:10:56.340108 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:56.339991    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 12:05:56 +0000 UTC" deadline="2028-04-28 03:19:33.978822476 +0000 UTC"
Jul 15 12:10:56.340108 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:56.340053    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15663h8m37.638774239s"
Jul 15 12:10:56.437769 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:56.437735    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2c8x"
Jul 15 12:10:56.437967 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:56.437875    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b2c8x" podUID="48797460-a1a5-43f2-9841-61f8adce425d"
Jul 15 12:10:56.449278 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:56.449248    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-htv2v" event={"ID":"4c29b692-3631-4562-96d0-83dad331764b","Type":"ContainerStarted","Data":"e6eff4034b80208ec4e052b0510fab3008fcf005f60bf4313eb4eb13a7088d6d"}
Jul 15 12:10:56.453109 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:56.452958    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms92n" event={"ID":"2f14aadf-a36b-44ad-bbd6-83181b059d9e","Type":"ContainerStarted","Data":"9a91a5d44858a83b3580d14d0a7a8ad1ec0a8e05019fac7bf9f31aa15d044445"}
Jul 15 12:10:56.460638 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:56.460508    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gwfk8" event={"ID":"c1e0b090-dace-4704-82e6-0c756006f902","Type":"ContainerStarted","Data":"ee23b4915a4bfdfa19a3d422ffb3cd410754f52fa8e769f6ef167c1db6bd674b"}
Jul 15 12:10:56.463843 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:56.463815    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qqjzq" event={"ID":"5575e886-e349-487c-9ca0-ad530bea441f","Type":"ContainerStarted","Data":"5dc6dc2cc5f6dfdbb7ced39cee7af5830bc74b50284c9132d389a965c3a4bfa7"}
Jul 15 12:10:56.467759 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:56.467731    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs" event={"ID":"2de62ab2-7502-4c13-a6f0-5ebbd4982798","Type":"ContainerStarted","Data":"4ef033e044811fc05d96efdbe8b457f9e8d5ee8d416a8f9d3559ad3e2c055204"}
Jul 15 12:10:56.474125 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:56.474042    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jt4gv" event={"ID":"3060ca16-de32-4034-8fb1-bda91f17b97d","Type":"ContainerStarted","Data":"d43ce3a04a2ced261f54aad94bd5c6b6cfc8e2454275d33649f2ef2e46be53a1"}
Jul 15 12:10:56.479111 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:56.479058    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zcdxd" event={"ID":"fe1a8d7e-70d9-4b84-8ccd-64e1fc8f803b","Type":"ContainerStarted","Data":"d8168a20bb134bb1428f9f9c16d108224d0ea7d6d436918cd55bd9904d2e4954"}
Jul 15 12:10:56.484231 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:56.484201    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-186.ec2.internal" event={"ID":"26e0df4d83bbe2ba7879e2ef9a112d54","Type":"ContainerStarted","Data":"e32924c555c59c39129fe9faef7667ba7fd0286596f2d5688fbafab924fe6e8a"}
Jul 15 12:10:56.496127 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:56.496097    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cwldp" event={"ID":"fa83ebd5-2623-4f6e-ba82-c3d428fa0115","Type":"ContainerStarted","Data":"e04f4901c3e90ad218c85b9a1fa08d2f6ebd0ac3be43c55e44c3937f7ba6b91e"}
Jul 15 12:10:56.500742 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:56.500715    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4tr78" event={"ID":"aab771cb-07af-462f-ac09-166b75eaab99","Type":"ContainerStarted","Data":"80f36a4a4062c86aeb64e762dfb3fd596c75bb7bdec9aae6d4050a5a1825cae4"}
Jul 15 12:10:56.929971 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:56.929920    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19938f5e-4b2c-45f8-9077-4fb510687262-metrics-certs\") pod \"network-metrics-daemon-spl8b\" (UID: \"19938f5e-4b2c-45f8-9077-4fb510687262\") " pod="openshift-multus/network-metrics-daemon-spl8b"
Jul 15 12:10:56.930163 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:56.930009    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/48797460-a1a5-43f2-9841-61f8adce425d-original-pull-secret\") pod \"global-pull-secret-syncer-b2c8x\" (UID: \"48797460-a1a5-43f2-9841-61f8adce425d\") " pod="kube-system/global-pull-secret-syncer-b2c8x"
Jul 15 12:10:56.930163 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:56.930155    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 12:10:56.930272 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:56.930218    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48797460-a1a5-43f2-9841-61f8adce425d-original-pull-secret podName:48797460-a1a5-43f2-9841-61f8adce425d nodeName:}" failed. No retries permitted until 2026-07-15 12:10:58.930199004 +0000 UTC m=+6.044592722 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/48797460-a1a5-43f2-9841-61f8adce425d-original-pull-secret") pod "global-pull-secret-syncer-b2c8x" (UID: "48797460-a1a5-43f2-9841-61f8adce425d") : object "kube-system"/"original-pull-secret" not registered
Jul 15 12:10:56.930348 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:56.930286    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 12:10:56.930348 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:56.930319    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19938f5e-4b2c-45f8-9077-4fb510687262-metrics-certs podName:19938f5e-4b2c-45f8-9077-4fb510687262 nodeName:}" failed. No retries permitted until 2026-07-15 12:10:58.930307466 +0000 UTC m=+6.044701180 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19938f5e-4b2c-45f8-9077-4fb510687262-metrics-certs") pod "network-metrics-daemon-spl8b" (UID: "19938f5e-4b2c-45f8-9077-4fb510687262") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 12:10:57.132013 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:57.131968    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnrjk\" (UniqueName: \"kubernetes.io/projected/17bfcad0-727f-42da-b33d-64a2d4cad92a-kube-api-access-qnrjk\") pod \"network-check-target-4mhn5\" (UID: \"17bfcad0-727f-42da-b33d-64a2d4cad92a\") " pod="openshift-network-diagnostics/network-check-target-4mhn5"
Jul 15 12:10:57.132201 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:57.132163    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 12:10:57.132270 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:57.132187    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 12:10:57.132270 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:57.132219    2560 projected.go:196] Error preparing data for projected volume kube-api-access-qnrjk for pod openshift-network-diagnostics/network-check-target-4mhn5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 12:10:57.132411 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:57.132278    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17bfcad0-727f-42da-b33d-64a2d4cad92a-kube-api-access-qnrjk podName:17bfcad0-727f-42da-b33d-64a2d4cad92a nodeName:}" failed. No retries permitted until 2026-07-15 12:10:59.132258856 +0000 UTC m=+6.246652585 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qnrjk" (UniqueName: "kubernetes.io/projected/17bfcad0-727f-42da-b33d-64a2d4cad92a-kube-api-access-qnrjk") pod "network-check-target-4mhn5" (UID: "17bfcad0-727f-42da-b33d-64a2d4cad92a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 12:10:57.341062 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:57.340973    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 12:05:56 +0000 UTC" deadline="2028-04-27 21:43:15.230992608 +0000 UTC"
Jul 15 12:10:57.341062 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:57.341015    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15657h32m17.88998313s"
Jul 15 12:10:57.440809 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:57.440096    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mhn5"
Jul 15 12:10:57.440809 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:57.440227    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mhn5" podUID="17bfcad0-727f-42da-b33d-64a2d4cad92a"
Jul 15 12:10:57.440809 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:57.440651    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spl8b"
Jul 15 12:10:57.440809 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:57.440756    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spl8b" podUID="19938f5e-4b2c-45f8-9077-4fb510687262"
Jul 15 12:10:58.438321 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:58.438283    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2c8x"
Jul 15 12:10:58.438966 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:58.438455    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b2c8x" podUID="48797460-a1a5-43f2-9841-61f8adce425d"
Jul 15 12:10:58.947916 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:58.947610    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/48797460-a1a5-43f2-9841-61f8adce425d-original-pull-secret\") pod \"global-pull-secret-syncer-b2c8x\" (UID: \"48797460-a1a5-43f2-9841-61f8adce425d\") " pod="kube-system/global-pull-secret-syncer-b2c8x"
Jul 15 12:10:58.947916 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:58.947734    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19938f5e-4b2c-45f8-9077-4fb510687262-metrics-certs\") pod \"network-metrics-daemon-spl8b\" (UID: \"19938f5e-4b2c-45f8-9077-4fb510687262\") " pod="openshift-multus/network-metrics-daemon-spl8b"
Jul 15 12:10:58.947916 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:58.947772    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 12:10:58.947916 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:58.947835    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 12:10:58.947916 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:58.947840    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48797460-a1a5-43f2-9841-61f8adce425d-original-pull-secret podName:48797460-a1a5-43f2-9841-61f8adce425d nodeName:}" failed. No retries permitted until 2026-07-15 12:11:02.94782092 +0000 UTC m=+10.062214633 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/48797460-a1a5-43f2-9841-61f8adce425d-original-pull-secret") pod "global-pull-secret-syncer-b2c8x" (UID: "48797460-a1a5-43f2-9841-61f8adce425d") : object "kube-system"/"original-pull-secret" not registered
Jul 15 12:10:58.947916 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:58.947881    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19938f5e-4b2c-45f8-9077-4fb510687262-metrics-certs podName:19938f5e-4b2c-45f8-9077-4fb510687262 nodeName:}" failed. No retries permitted until 2026-07-15 12:11:02.947870339 +0000 UTC m=+10.062264057 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19938f5e-4b2c-45f8-9077-4fb510687262-metrics-certs") pod "network-metrics-daemon-spl8b" (UID: "19938f5e-4b2c-45f8-9077-4fb510687262") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 12:10:59.149201 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:59.149165    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnrjk\" (UniqueName: \"kubernetes.io/projected/17bfcad0-727f-42da-b33d-64a2d4cad92a-kube-api-access-qnrjk\") pod \"network-check-target-4mhn5\" (UID: \"17bfcad0-727f-42da-b33d-64a2d4cad92a\") " pod="openshift-network-diagnostics/network-check-target-4mhn5"
Jul 15 12:10:59.149436 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:59.149409    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 12:10:59.149517 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:59.149438    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 12:10:59.149517 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:59.149456    2560 projected.go:196] Error preparing data for projected volume kube-api-access-qnrjk for pod openshift-network-diagnostics/network-check-target-4mhn5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 12:10:59.149671 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:59.149533    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17bfcad0-727f-42da-b33d-64a2d4cad92a-kube-api-access-qnrjk podName:17bfcad0-727f-42da-b33d-64a2d4cad92a nodeName:}" failed. No retries permitted until 2026-07-15 12:11:03.149513259 +0000 UTC m=+10.263906988 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qnrjk" (UniqueName: "kubernetes.io/projected/17bfcad0-727f-42da-b33d-64a2d4cad92a-kube-api-access-qnrjk") pod "network-check-target-4mhn5" (UID: "17bfcad0-727f-42da-b33d-64a2d4cad92a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 12:10:59.439341 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:59.438599    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mhn5"
Jul 15 12:10:59.439341 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:59.438747    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mhn5" podUID="17bfcad0-727f-42da-b33d-64a2d4cad92a"
Jul 15 12:10:59.439341 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:10:59.438560    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spl8b"
Jul 15 12:10:59.439341 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:10:59.439212    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spl8b" podUID="19938f5e-4b2c-45f8-9077-4fb510687262"
Jul 15 12:11:00.438673 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:00.438629    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2c8x"
Jul 15 12:11:00.438863 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:00.438769    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b2c8x" podUID="48797460-a1a5-43f2-9841-61f8adce425d"
Jul 15 12:11:01.437746 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:01.437717    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mhn5"
Jul 15 12:11:01.438207 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:01.437843    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mhn5" podUID="17bfcad0-727f-42da-b33d-64a2d4cad92a"
Jul 15 12:11:01.438207 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:01.437851    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spl8b"
Jul 15 12:11:01.438207 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:01.437945    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spl8b" podUID="19938f5e-4b2c-45f8-9077-4fb510687262"
Jul 15 12:11:02.438193 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:02.438123    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2c8x"
Jul 15 12:11:02.438694 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:02.438278    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b2c8x" podUID="48797460-a1a5-43f2-9841-61f8adce425d"
Jul 15 12:11:02.986112 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:02.985820    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/48797460-a1a5-43f2-9841-61f8adce425d-original-pull-secret\") pod \"global-pull-secret-syncer-b2c8x\" (UID: \"48797460-a1a5-43f2-9841-61f8adce425d\") " pod="kube-system/global-pull-secret-syncer-b2c8x"
Jul 15 12:11:02.986112 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:02.985896    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19938f5e-4b2c-45f8-9077-4fb510687262-metrics-certs\") pod \"network-metrics-daemon-spl8b\" (UID: \"19938f5e-4b2c-45f8-9077-4fb510687262\") " pod="openshift-multus/network-metrics-daemon-spl8b"
Jul 15 12:11:02.986112 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:02.986047    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 12:11:02.986112 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:02.986054    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 12:11:02.986112 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:02.986112    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48797460-a1a5-43f2-9841-61f8adce425d-original-pull-secret podName:48797460-a1a5-43f2-9841-61f8adce425d nodeName:}" failed. No retries permitted until 2026-07-15 12:11:10.986091373 +0000 UTC m=+18.100485092 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/48797460-a1a5-43f2-9841-61f8adce425d-original-pull-secret") pod "global-pull-secret-syncer-b2c8x" (UID: "48797460-a1a5-43f2-9841-61f8adce425d") : object "kube-system"/"original-pull-secret" not registered
Jul 15 12:11:02.986561 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:02.986131    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19938f5e-4b2c-45f8-9077-4fb510687262-metrics-certs podName:19938f5e-4b2c-45f8-9077-4fb510687262 nodeName:}" failed. No retries permitted until 2026-07-15 12:11:10.986121245 +0000 UTC m=+18.100514957 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19938f5e-4b2c-45f8-9077-4fb510687262-metrics-certs") pod "network-metrics-daemon-spl8b" (UID: "19938f5e-4b2c-45f8-9077-4fb510687262") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 12:11:03.187924 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:03.187788    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnrjk\" (UniqueName: \"kubernetes.io/projected/17bfcad0-727f-42da-b33d-64a2d4cad92a-kube-api-access-qnrjk\") pod \"network-check-target-4mhn5\" (UID: \"17bfcad0-727f-42da-b33d-64a2d4cad92a\") " pod="openshift-network-diagnostics/network-check-target-4mhn5"
Jul 15 12:11:03.188113 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:03.187933    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 12:11:03.188113 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:03.187960    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 12:11:03.188113 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:03.187973    2560 projected.go:196] Error preparing data for projected volume kube-api-access-qnrjk for pod openshift-network-diagnostics/network-check-target-4mhn5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 12:11:03.188113 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:03.188036    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17bfcad0-727f-42da-b33d-64a2d4cad92a-kube-api-access-qnrjk podName:17bfcad0-727f-42da-b33d-64a2d4cad92a nodeName:}" failed. No retries permitted until 2026-07-15 12:11:11.188017823 +0000 UTC m=+18.302411534 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qnrjk" (UniqueName: "kubernetes.io/projected/17bfcad0-727f-42da-b33d-64a2d4cad92a-kube-api-access-qnrjk") pod "network-check-target-4mhn5" (UID: "17bfcad0-727f-42da-b33d-64a2d4cad92a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 12:11:03.443801 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:03.441666    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spl8b"
Jul 15 12:11:03.443801 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:03.441848    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spl8b" podUID="19938f5e-4b2c-45f8-9077-4fb510687262"
Jul 15 12:11:03.443801 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:03.442322    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mhn5"
Jul 15 12:11:03.443801 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:03.442473    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mhn5" podUID="17bfcad0-727f-42da-b33d-64a2d4cad92a"
Jul 15 12:11:04.438360 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:04.438185    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2c8x"
Jul 15 12:11:04.438360 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:04.438337    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b2c8x" podUID="48797460-a1a5-43f2-9841-61f8adce425d"
Jul 15 12:11:05.438313 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:05.438216    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mhn5"
Jul 15 12:11:05.438313 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:05.438246    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spl8b"
Jul 15 12:11:05.438878 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:05.438366    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mhn5" podUID="17bfcad0-727f-42da-b33d-64a2d4cad92a"
Jul 15 12:11:05.438878 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:05.438453    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spl8b" podUID="19938f5e-4b2c-45f8-9077-4fb510687262"
Jul 15 12:11:06.438619 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:06.438590    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2c8x"
Jul 15 12:11:06.439002 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:06.438702    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b2c8x" podUID="48797460-a1a5-43f2-9841-61f8adce425d"
Jul 15 12:11:07.438464 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:07.438382    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mhn5"
Jul 15 12:11:07.438464 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:07.438421    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spl8b"
Jul 15 12:11:07.438653 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:07.438521    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mhn5" podUID="17bfcad0-727f-42da-b33d-64a2d4cad92a"
Jul 15 12:11:07.438961 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:07.438659    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spl8b" podUID="19938f5e-4b2c-45f8-9077-4fb510687262"
Jul 15 12:11:08.438139 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:08.438103    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2c8x"
Jul 15 12:11:08.438350 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:08.438237    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b2c8x" podUID="48797460-a1a5-43f2-9841-61f8adce425d"
Jul 15 12:11:09.438571 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:09.438534    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mhn5"
Jul 15 12:11:09.439031 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:09.438676    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mhn5" podUID="17bfcad0-727f-42da-b33d-64a2d4cad92a"
Jul 15 12:11:09.439031 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:09.438711    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spl8b"
Jul 15 12:11:09.439031 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:09.438840    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spl8b" podUID="19938f5e-4b2c-45f8-9077-4fb510687262"
Jul 15 12:11:10.438584 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:10.438556    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2c8x"
Jul 15 12:11:10.439039 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:10.438670    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b2c8x" podUID="48797460-a1a5-43f2-9841-61f8adce425d"
Jul 15 12:11:11.053311 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:11.053267    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19938f5e-4b2c-45f8-9077-4fb510687262-metrics-certs\") pod \"network-metrics-daemon-spl8b\" (UID: \"19938f5e-4b2c-45f8-9077-4fb510687262\") " pod="openshift-multus/network-metrics-daemon-spl8b"
Jul 15 12:11:11.053532 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:11.053331    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/48797460-a1a5-43f2-9841-61f8adce425d-original-pull-secret\") pod \"global-pull-secret-syncer-b2c8x\" (UID: \"48797460-a1a5-43f2-9841-61f8adce425d\") " pod="kube-system/global-pull-secret-syncer-b2c8x"
Jul 15 12:11:11.053532 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:11.053411    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 12:11:11.053532 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:11.053470    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19938f5e-4b2c-45f8-9077-4fb510687262-metrics-certs podName:19938f5e-4b2c-45f8-9077-4fb510687262 nodeName:}" failed. No retries permitted until 2026-07-15 12:11:27.053454811 +0000 UTC m=+34.167848520 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19938f5e-4b2c-45f8-9077-4fb510687262-metrics-certs") pod "network-metrics-daemon-spl8b" (UID: "19938f5e-4b2c-45f8-9077-4fb510687262") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 12:11:11.053532 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:11.053414    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 12:11:11.053532 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:11.053532    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48797460-a1a5-43f2-9841-61f8adce425d-original-pull-secret podName:48797460-a1a5-43f2-9841-61f8adce425d nodeName:}" failed. No retries permitted until 2026-07-15 12:11:27.053521271 +0000 UTC m=+34.167914980 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/48797460-a1a5-43f2-9841-61f8adce425d-original-pull-secret") pod "global-pull-secret-syncer-b2c8x" (UID: "48797460-a1a5-43f2-9841-61f8adce425d") : object "kube-system"/"original-pull-secret" not registered
Jul 15 12:11:11.255367 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:11.255332    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnrjk\" (UniqueName: \"kubernetes.io/projected/17bfcad0-727f-42da-b33d-64a2d4cad92a-kube-api-access-qnrjk\") pod \"network-check-target-4mhn5\" (UID: \"17bfcad0-727f-42da-b33d-64a2d4cad92a\") " pod="openshift-network-diagnostics/network-check-target-4mhn5"
Jul 15 12:11:11.255553 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:11.255476    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 12:11:11.255553 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:11.255494    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 12:11:11.255553 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:11.255506    2560 projected.go:196] Error preparing data for projected volume kube-api-access-qnrjk for pod openshift-network-diagnostics/network-check-target-4mhn5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 12:11:11.255724 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:11.255562    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17bfcad0-727f-42da-b33d-64a2d4cad92a-kube-api-access-qnrjk podName:17bfcad0-727f-42da-b33d-64a2d4cad92a nodeName:}" failed. No retries permitted until 2026-07-15 12:11:27.255545562 +0000 UTC m=+34.369939279 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qnrjk" (UniqueName: "kubernetes.io/projected/17bfcad0-727f-42da-b33d-64a2d4cad92a-kube-api-access-qnrjk") pod "network-check-target-4mhn5" (UID: "17bfcad0-727f-42da-b33d-64a2d4cad92a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 12:11:11.438725 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:11.438642    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mhn5"
Jul 15 12:11:11.439146 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:11.438642    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spl8b"
Jul 15 12:11:11.439146 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:11.438775    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mhn5" podUID="17bfcad0-727f-42da-b33d-64a2d4cad92a"
Jul 15 12:11:11.439146 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:11.438868    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spl8b" podUID="19938f5e-4b2c-45f8-9077-4fb510687262"
Jul 15 12:11:12.438776 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:12.438741    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2c8x"
Jul 15 12:11:12.439174 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:12.438876    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b2c8x" podUID="48797460-a1a5-43f2-9841-61f8adce425d"
Jul 15 12:11:13.439344 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:13.439285    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mhn5"
Jul 15 12:11:13.439808 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:13.439351    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spl8b"
Jul 15 12:11:13.439808 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:13.439404    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mhn5" podUID="17bfcad0-727f-42da-b33d-64a2d4cad92a"
Jul 15 12:11:13.439808 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:13.439577    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spl8b" podUID="19938f5e-4b2c-45f8-9077-4fb510687262"
Jul 15 12:11:14.438747 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:14.438704    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2c8x"
Jul 15 12:11:14.438934 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:14.438832    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b2c8x" podUID="48797460-a1a5-43f2-9841-61f8adce425d"
Jul 15 12:11:15.438114 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:15.438055    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mhn5"
Jul 15 12:11:15.438114 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:15.438073    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spl8b"
Jul 15 12:11:15.438641 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:15.438185    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mhn5" podUID="17bfcad0-727f-42da-b33d-64a2d4cad92a"
Jul 15 12:11:15.438641 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:15.438341    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spl8b" podUID="19938f5e-4b2c-45f8-9077-4fb510687262"
Jul 15 12:11:16.437884 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:16.437773    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2c8x"
Jul 15 12:11:16.437962 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:16.437942    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b2c8x" podUID="48797460-a1a5-43f2-9841-61f8adce425d"
Jul 15 12:11:16.539585 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:16.539557    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-186.ec2.internal" event={"ID":"b44d4f1a13a5598713990a6a605902da","Type":"ContainerStarted","Data":"12f737597b45a1804d2c81a5c3fad90dd6923f585e85fe4941ecdad73b454dee"}
Jul 15 12:11:16.541113 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:16.541080    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qqjzq" event={"ID":"5575e886-e349-487c-9ca0-ad530bea441f","Type":"ContainerStarted","Data":"5b2ec2b01bdcbd8692aa539df565ab30fdde392a4ff8647f434bcfa710d4dcdf"}
Jul 15 12:11:16.542899 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:16.542873    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs" event={"ID":"2de62ab2-7502-4c13-a6f0-5ebbd4982798","Type":"ContainerStarted","Data":"2147a1a975141a74c3f140ea62783d581d2b5005d5bf9a5910d53d6322223430"}
Jul 15 12:11:16.542994 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:16.542938    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs" event={"ID":"2de62ab2-7502-4c13-a6f0-5ebbd4982798","Type":"ContainerStarted","Data":"939fe2a91f19ad7a4bae2fc33a4c575bc3768e63ed1f5d824849e0c9be42a671"}
Jul 15 12:11:16.544370 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:16.544349    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jt4gv" event={"ID":"3060ca16-de32-4034-8fb1-bda91f17b97d","Type":"ContainerStarted","Data":"e64b2debf22a76f12a616a4d350c65ffbb9bac45cc19d370e5c128dfbe39d354"}
Jul 15 12:11:16.575875 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:16.575829    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-jt4gv" podStartSLOduration=1.8922058179999999 podStartE2EDuration="22.575814406s" totalImagesPullingTime="20.683608588s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:10:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:11:16.575382622 +0000 UTC m=+23.689776368" watchObservedRunningTime="2026-07-15 12:11:16.575814406 +0000 UTC m=+23.690208137"
Jul 15 12:11:16.591517 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:16.591476    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qqjzq" podStartSLOduration=1.988543719 podStartE2EDuration="22.591461497s" totalImagesPullingTime="20.602917778s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:10:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:11:16.591174079 +0000 UTC m=+23.705567815" watchObservedRunningTime="2026-07-15 12:11:16.591461497 +0000 UTC m=+23.705855229"
Jul 15 12:11:16.603955 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:16.603917    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-186.ec2.internal" podStartSLOduration=21.603902148 podStartE2EDuration="21.603902148s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:10:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:11:16.603411878 +0000 UTC m=+23.717805610" watchObservedRunningTime="2026-07-15 12:11:16.603902148 +0000 UTC m=+23.718295880"
Jul 15 12:11:17.437840 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:17.437814    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mhn5"
Jul 15 12:11:17.438018 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:17.437986    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mhn5" podUID="17bfcad0-727f-42da-b33d-64a2d4cad92a"
Jul 15 12:11:17.438069 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:17.438043    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spl8b"
Jul 15 12:11:17.438185 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:17.438164    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spl8b" podUID="19938f5e-4b2c-45f8-9077-4fb510687262"
Jul 15 12:11:17.548128 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:17.548051    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms92n" event={"ID":"2f14aadf-a36b-44ad-bbd6-83181b059d9e","Type":"ContainerStarted","Data":"0381430c9fc8e470836d0698dcbb4a73bc49784845e744f03fa96f13d005e510"}
Jul 15 12:11:17.549664 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:17.549635    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gwfk8" event={"ID":"c1e0b090-dace-4704-82e6-0c756006f902","Type":"ContainerStarted","Data":"c8c3e6563aa611db5a5208bd746f0f0854b45477789c08cc1f2874e1c476a66d"}
Jul 15 12:11:17.552697 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:17.552678    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xh4rs_2de62ab2-7502-4c13-a6f0-5ebbd4982798/ovn-acl-logging/0.log"
Jul 15 12:11:17.553031 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:17.553010    2560 generic.go:356] "Generic (PLEG): container finished" podID="2de62ab2-7502-4c13-a6f0-5ebbd4982798" containerID="2147a1a975141a74c3f140ea62783d581d2b5005d5bf9a5910d53d6322223430" exitCode=1
Jul 15 12:11:17.553179 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:17.553086    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs" event={"ID":"2de62ab2-7502-4c13-a6f0-5ebbd4982798","Type":"ContainerDied","Data":"2147a1a975141a74c3f140ea62783d581d2b5005d5bf9a5910d53d6322223430"}
Jul 15 12:11:17.553179 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:17.553161    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs" event={"ID":"2de62ab2-7502-4c13-a6f0-5ebbd4982798","Type":"ContainerStarted","Data":"472454f425f177a716636b1ad64094dea3cfba1439ef7c1bd0b5a85491bc6a97"}
Jul 15 12:11:17.553373 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:17.553212    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs" event={"ID":"2de62ab2-7502-4c13-a6f0-5ebbd4982798","Type":"ContainerStarted","Data":"e0177450c1293fef95b8a49d3d216da11ebba6e04dc9c95cea26550dcf145808"}
Jul 15 12:11:17.553373 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:17.553264    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs" event={"ID":"2de62ab2-7502-4c13-a6f0-5ebbd4982798","Type":"ContainerStarted","Data":"8516c6a463806383bc9d8000718c563b6552fe81b69423f2e7ab3619b19cb92c"}
Jul 15 12:11:17.553373 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:17.553337    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs" event={"ID":"2de62ab2-7502-4c13-a6f0-5ebbd4982798","Type":"ContainerStarted","Data":"0d52d3b5f536f534cf2b4572a69641b7891ab612845b83443229704970fece7b"}
Jul 15 12:11:17.554553 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:17.554529    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zcdxd" event={"ID":"fe1a8d7e-70d9-4b84-8ccd-64e1fc8f803b","Type":"ContainerStarted","Data":"c67380a226cb6beea10455dea52a0d0860431342f3c02f25fe81c7f69524f28c"}
Jul 15 12:11:17.556144 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:17.556123    2560 generic.go:356] "Generic (PLEG): container finished" podID="26e0df4d83bbe2ba7879e2ef9a112d54" containerID="433d3e1130e5f6693cf035ba7188baca7495f2b08d9479ffebef45cf51d00e05" exitCode=0
Jul 15 12:11:17.556246 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:17.556204    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-186.ec2.internal" event={"ID":"26e0df4d83bbe2ba7879e2ef9a112d54","Type":"ContainerDied","Data":"433d3e1130e5f6693cf035ba7188baca7495f2b08d9479ffebef45cf51d00e05"}
Jul 15 12:11:17.557799 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:17.557775    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cwldp" event={"ID":"fa83ebd5-2623-4f6e-ba82-c3d428fa0115","Type":"ContainerStarted","Data":"74336d61011d1d652c043a83a96a00859e6a1e42266c0ae1f84dd09595b6dc29"}
Jul 15 12:11:17.559348 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:17.559325    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4tr78" event={"ID":"aab771cb-07af-462f-ac09-166b75eaab99","Type":"ContainerStarted","Data":"ec47368a4c6b0f86c9508652d7e1f5758ee3d69c261deee8fe2651480965f79a"}
Jul 15 12:11:17.560950 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:17.560929    2560 generic.go:356] "Generic (PLEG): container finished" podID="4c29b692-3631-4562-96d0-83dad331764b" containerID="3ec9979ca67f5e8750c4c77f6ce83e6b504c9ff490f10af98d9a7c4edc5eee43" exitCode=0
Jul 15 12:11:17.561030 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:17.560993    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-htv2v" event={"ID":"4c29b692-3631-4562-96d0-83dad331764b","Type":"ContainerDied","Data":"3ec9979ca67f5e8750c4c77f6ce83e6b504c9ff490f10af98d9a7c4edc5eee43"}
Jul 15 12:11:17.564765 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:17.564734    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gwfk8" podStartSLOduration=12.073446716 podStartE2EDuration="23.564722687s" totalImagesPullingTime="11.491275971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:10:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:11:17.564523986 +0000 UTC m=+24.678917718" watchObservedRunningTime="2026-07-15 12:11:17.564722687 +0000 UTC m=+24.679116418"
Jul 15 12:11:17.597102 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:17.597039    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-cwldp" podStartSLOduration=2.976385455 podStartE2EDuration="23.597026842s" totalImagesPullingTime="20.620641387s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:10:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:11:17.596162077 +0000 UTC m=+24.710555809" watchObservedRunningTime="2026-07-15 12:11:17.597026842 +0000 UTC m=+24.711420574"
Jul 15 12:11:17.666814 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:17.666760    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-zcdxd" podStartSLOduration=3.058534855 podStartE2EDuration="23.666739294s" totalImagesPullingTime="20.608204439s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:10:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:11:17.666606344 +0000 UTC m=+24.781000075" watchObservedRunningTime="2026-07-15 12:11:17.666739294 +0000 UTC m=+24.781133097"
Jul 15 12:11:17.667319 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:17.667270    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4tr78" podStartSLOduration=3.038377403 podStartE2EDuration="23.667259258s" totalImagesPullingTime="20.628881855s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:10:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:11:17.648321218 +0000 UTC m=+24.762714944" watchObservedRunningTime="2026-07-15 12:11:17.667259258 +0000 UTC m=+24.781652991"
Jul 15 12:11:18.086621 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:18.086593    2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 15 12:11:18.371459 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:18.371334    2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T12:11:18.08661499Z","UUID":"c7c91a75-49f8-4b5b-94ee-c9e60f6d1c5e","Handler":null,"Name":"","Endpoint":""}
Jul 15 12:11:18.372739 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:18.372712    2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 15 12:11:18.372860 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:18.372759    2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 15 12:11:18.437971 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:18.437939    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2c8x"
Jul 15 12:11:18.438148 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:18.438042    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b2c8x" podUID="48797460-a1a5-43f2-9841-61f8adce425d"
Jul 15 12:11:18.568564 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:18.568524    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-186.ec2.internal" event={"ID":"26e0df4d83bbe2ba7879e2ef9a112d54","Type":"ContainerStarted","Data":"d33a9ae7ddc1837018c3d0b468d763ebfdd832a4df3d2214c67ed25a6c66bbab"}
Jul 15 12:11:18.570914 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:18.570881    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms92n" event={"ID":"2f14aadf-a36b-44ad-bbd6-83181b059d9e","Type":"ContainerStarted","Data":"21e5ca9f4fae728423b170357a26504a5c160272e6c439133b4078f7e8d8c410"}
Jul 15 12:11:18.584185 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:18.584136    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-186.ec2.internal" podStartSLOduration=23.584117073 podStartE2EDuration="23.584117073s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:10:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:11:18.583332809 +0000 UTC m=+25.697726541" watchObservedRunningTime="2026-07-15 12:11:18.584117073 +0000 UTC m=+25.698510806"
Jul 15 12:11:19.438503 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:19.438478    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spl8b"
Jul 15 12:11:19.438503 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:19.438497    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mhn5"
Jul 15 12:11:19.438699 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:19.438612    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spl8b" podUID="19938f5e-4b2c-45f8-9077-4fb510687262"
Jul 15 12:11:19.438699 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:19.438688    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mhn5" podUID="17bfcad0-727f-42da-b33d-64a2d4cad92a"
Jul 15 12:11:19.483884 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:19.483856    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gwfk8"
Jul 15 12:11:19.484533 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:19.484511    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gwfk8"
Jul 15 12:11:19.577207 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:19.577185    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xh4rs_2de62ab2-7502-4c13-a6f0-5ebbd4982798/ovn-acl-logging/0.log"
Jul 15 12:11:19.577657 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:19.577629    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs" event={"ID":"2de62ab2-7502-4c13-a6f0-5ebbd4982798","Type":"ContainerStarted","Data":"76cda3335b2e0bd05150d24b495b67f7fa594d0c6eb5e7918c60145d60697b55"}
Jul 15 12:11:19.580199 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:19.580127    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms92n" event={"ID":"2f14aadf-a36b-44ad-bbd6-83181b059d9e","Type":"ContainerStarted","Data":"2b822d27e39c0e519c5bc8302e5a9b4558e34e56a8f6f92bed24474b3c2da208"}
Jul 15 12:11:19.580747 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:19.580579    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gwfk8"
Jul 15 12:11:19.580943 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:19.580922    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gwfk8"
Jul 15 12:11:19.598749 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:19.598702    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms92n" podStartSLOduration=2.434099755 podStartE2EDuration="25.598685445s" totalImagesPullingTime="23.16458569s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:10:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:11:19.598428773 +0000 UTC m=+26.712822516" watchObservedRunningTime="2026-07-15 12:11:19.598685445 +0000 UTC m=+26.713079178"
Jul 15 12:11:20.437747 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:20.437717    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2c8x"
Jul 15 12:11:20.437920 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:20.437829    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b2c8x" podUID="48797460-a1a5-43f2-9841-61f8adce425d"
Jul 15 12:11:21.437886 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:21.437854    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mhn5"
Jul 15 12:11:21.437886 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:21.437868    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spl8b"
Jul 15 12:11:21.438374 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:21.437957    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mhn5" podUID="17bfcad0-727f-42da-b33d-64a2d4cad92a"
Jul 15 12:11:21.438374 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:21.438110    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spl8b" podUID="19938f5e-4b2c-45f8-9077-4fb510687262"
Jul 15 12:11:22.438050 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:22.437912    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2c8x"
Jul 15 12:11:22.438544 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:22.438133    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b2c8x" podUID="48797460-a1a5-43f2-9841-61f8adce425d"
Jul 15 12:11:22.588695 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:22.588662    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-htv2v" event={"ID":"4c29b692-3631-4562-96d0-83dad331764b","Type":"ContainerStarted","Data":"50bebcfc0770324ce8471b003090fcb259aabf21768d7ee006f02ae6b86fac52"}
Jul 15 12:11:22.591999 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:22.591983    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xh4rs_2de62ab2-7502-4c13-a6f0-5ebbd4982798/ovn-acl-logging/0.log"
Jul 15 12:11:22.592373 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:22.592344    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs" event={"ID":"2de62ab2-7502-4c13-a6f0-5ebbd4982798","Type":"ContainerStarted","Data":"211f64cf5c82dd309c82d8868b9a9ab04980a2568239d549b58c905cebd00b55"}
Jul 15 12:11:22.592655 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:22.592619    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:11:22.592747 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:22.592711    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:11:22.592876 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:22.592859    2560 scope.go:117] "RemoveContainer" containerID="2147a1a975141a74c3f140ea62783d581d2b5005d5bf9a5910d53d6322223430"
Jul 15 12:11:22.607805 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:22.607783    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:11:22.609071 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:22.609038    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:11:23.012816 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:23.012788    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:11:23.438631 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:23.438562    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mhn5"
Jul 15 12:11:23.439033 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:23.438648    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mhn5" podUID="17bfcad0-727f-42da-b33d-64a2d4cad92a"
Jul 15 12:11:23.439033 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:23.438736    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spl8b"
Jul 15 12:11:23.439033 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:23.438825    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spl8b" podUID="19938f5e-4b2c-45f8-9077-4fb510687262"
Jul 15 12:11:23.596529 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:23.596492    2560 generic.go:356] "Generic (PLEG): container finished" podID="4c29b692-3631-4562-96d0-83dad331764b" containerID="50bebcfc0770324ce8471b003090fcb259aabf21768d7ee006f02ae6b86fac52" exitCode=0
Jul 15 12:11:23.596739 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:23.596586    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-htv2v" event={"ID":"4c29b692-3631-4562-96d0-83dad331764b","Type":"ContainerDied","Data":"50bebcfc0770324ce8471b003090fcb259aabf21768d7ee006f02ae6b86fac52"}
Jul 15 12:11:23.601010 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:23.600994    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xh4rs_2de62ab2-7502-4c13-a6f0-5ebbd4982798/ovn-acl-logging/0.log"
Jul 15 12:11:23.601389 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:23.601366    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs" event={"ID":"2de62ab2-7502-4c13-a6f0-5ebbd4982798","Type":"ContainerStarted","Data":"e3827389ff49f294cba6275505490f6a1cb74fac554662b8a5a56899310853a8"}
Jul 15 12:11:23.644399 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:23.644343    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs" podStartSLOduration=8.958957989 podStartE2EDuration="29.644328734s" totalImagesPullingTime="20.685370745s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:10:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:11:23.643819459 +0000 UTC m=+30.758213193" watchObservedRunningTime="2026-07-15 12:11:23.644328734 +0000 UTC m=+30.758722466"
Jul 15 12:11:24.438715 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:24.438508    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2c8x"
Jul 15 12:11:24.439169 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:24.438829    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b2c8x" podUID="48797460-a1a5-43f2-9841-61f8adce425d"
Jul 15 12:11:24.500789 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:24.500761    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-spl8b"]
Jul 15 12:11:24.500947 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:24.500862    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spl8b"
Jul 15 12:11:24.501001 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:24.500971    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spl8b" podUID="19938f5e-4b2c-45f8-9077-4fb510687262"
Jul 15 12:11:24.503773 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:24.503751    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-b2c8x"]
Jul 15 12:11:24.504342 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:24.504320    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4mhn5"]
Jul 15 12:11:24.504449 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:24.504410    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mhn5"
Jul 15 12:11:24.504512 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:24.504496    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mhn5" podUID="17bfcad0-727f-42da-b33d-64a2d4cad92a"
Jul 15 12:11:24.603892 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:24.603864    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2c8x"
Jul 15 12:11:24.604042 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:24.603994    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b2c8x" podUID="48797460-a1a5-43f2-9841-61f8adce425d"
Jul 15 12:11:25.608599 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:25.608511    2560 generic.go:356] "Generic (PLEG): container finished" podID="4c29b692-3631-4562-96d0-83dad331764b" containerID="79a5018def8a71f033a929447c37f02d85820ab42140561c507ed98370388980" exitCode=0
Jul 15 12:11:25.608599 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:25.608579    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-htv2v" event={"ID":"4c29b692-3631-4562-96d0-83dad331764b","Type":"ContainerDied","Data":"79a5018def8a71f033a929447c37f02d85820ab42140561c507ed98370388980"}
Jul 15 12:11:26.438183 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:26.438159    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2c8x"
Jul 15 12:11:26.438289 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:26.438159    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mhn5"
Jul 15 12:11:26.438289 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:26.438260    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b2c8x" podUID="48797460-a1a5-43f2-9841-61f8adce425d"
Jul 15 12:11:26.438381 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:26.438158    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spl8b"
Jul 15 12:11:26.438381 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:26.438338    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mhn5" podUID="17bfcad0-727f-42da-b33d-64a2d4cad92a"
Jul 15 12:11:26.438495 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:26.438475    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spl8b" podUID="19938f5e-4b2c-45f8-9077-4fb510687262"
Jul 15 12:11:26.613548 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:26.613465    2560 generic.go:356] "Generic (PLEG): container finished" podID="4c29b692-3631-4562-96d0-83dad331764b" containerID="0694b3545233e371d2774adc1601a9d729751a58fb85e0612605bc8580d0a8f3" exitCode=0
Jul 15 12:11:26.613548 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:26.613522    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-htv2v" event={"ID":"4c29b692-3631-4562-96d0-83dad331764b","Type":"ContainerDied","Data":"0694b3545233e371d2774adc1601a9d729751a58fb85e0612605bc8580d0a8f3"}
Jul 15 12:11:27.079720 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:27.079680    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19938f5e-4b2c-45f8-9077-4fb510687262-metrics-certs\") pod \"network-metrics-daemon-spl8b\" (UID: \"19938f5e-4b2c-45f8-9077-4fb510687262\") " pod="openshift-multus/network-metrics-daemon-spl8b"
Jul 15 12:11:27.079877 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:27.079739    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/48797460-a1a5-43f2-9841-61f8adce425d-original-pull-secret\") pod \"global-pull-secret-syncer-b2c8x\" (UID: \"48797460-a1a5-43f2-9841-61f8adce425d\") " pod="kube-system/global-pull-secret-syncer-b2c8x"
Jul 15 12:11:27.079877 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:27.079823    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 12:11:27.079877 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:27.079824    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 12:11:27.079877 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:27.079871    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48797460-a1a5-43f2-9841-61f8adce425d-original-pull-secret podName:48797460-a1a5-43f2-9841-61f8adce425d nodeName:}" failed. No retries permitted until 2026-07-15 12:11:59.079857029 +0000 UTC m=+66.194250740 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/48797460-a1a5-43f2-9841-61f8adce425d-original-pull-secret") pod "global-pull-secret-syncer-b2c8x" (UID: "48797460-a1a5-43f2-9841-61f8adce425d") : object "kube-system"/"original-pull-secret" not registered
Jul 15 12:11:27.080005 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:27.079885    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19938f5e-4b2c-45f8-9077-4fb510687262-metrics-certs podName:19938f5e-4b2c-45f8-9077-4fb510687262 nodeName:}" failed. No retries permitted until 2026-07-15 12:11:59.079878152 +0000 UTC m=+66.194271862 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19938f5e-4b2c-45f8-9077-4fb510687262-metrics-certs") pod "network-metrics-daemon-spl8b" (UID: "19938f5e-4b2c-45f8-9077-4fb510687262") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 12:11:27.280963 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:27.280933    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnrjk\" (UniqueName: \"kubernetes.io/projected/17bfcad0-727f-42da-b33d-64a2d4cad92a-kube-api-access-qnrjk\") pod \"network-check-target-4mhn5\" (UID: \"17bfcad0-727f-42da-b33d-64a2d4cad92a\") " pod="openshift-network-diagnostics/network-check-target-4mhn5"
Jul 15 12:11:27.281144 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:27.281094    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 12:11:27.281144 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:27.281111    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 12:11:27.281144 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:27.281120    2560 projected.go:196] Error preparing data for projected volume kube-api-access-qnrjk for pod openshift-network-diagnostics/network-check-target-4mhn5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 12:11:27.281275 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:27.281182    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17bfcad0-727f-42da-b33d-64a2d4cad92a-kube-api-access-qnrjk podName:17bfcad0-727f-42da-b33d-64a2d4cad92a nodeName:}" failed. No retries permitted until 2026-07-15 12:11:59.28116355 +0000 UTC m=+66.395557262 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qnrjk" (UniqueName: "kubernetes.io/projected/17bfcad0-727f-42da-b33d-64a2d4cad92a-kube-api-access-qnrjk") pod "network-check-target-4mhn5" (UID: "17bfcad0-727f-42da-b33d-64a2d4cad92a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 12:11:28.437849 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:28.437726    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2c8x"
Jul 15 12:11:28.437849 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:28.437833    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spl8b"
Jul 15 12:11:28.437849 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:28.437847    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mhn5"
Jul 15 12:11:28.438370 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:28.437840    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b2c8x" podUID="48797460-a1a5-43f2-9841-61f8adce425d"
Jul 15 12:11:28.438370 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:28.437950    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spl8b" podUID="19938f5e-4b2c-45f8-9077-4fb510687262"
Jul 15 12:11:28.438370 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:28.438020    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mhn5" podUID="17bfcad0-727f-42da-b33d-64a2d4cad92a"
Jul 15 12:11:30.184618 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.184542    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-186.ec2.internal" event="NodeReady"
Jul 15 12:11:30.185018 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.184732    2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 15 12:11:30.222646 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.222616    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5dc4f89c55-8fdlw"]
Jul 15 12:11:30.226998 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.226976    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5dc4f89c55-8fdlw"
Jul 15 12:11:30.229756 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.229736    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 15 12:11:30.229880 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.229781    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6jhfg\""
Jul 15 12:11:30.230234 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.230211    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 15 12:11:30.230234 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.230229    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 15 12:11:30.235691 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.235473    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 15 12:11:30.236070 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.236052    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-cs8bw"]
Jul 15 12:11:30.239445 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.239425    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5dc4f89c55-8fdlw"]
Jul 15 12:11:30.239547 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.239533    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-cs8bw"
Jul 15 12:11:30.242483 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.242465    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 15 12:11:30.242573 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.242517    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 15 12:11:30.242573 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.242535    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-b8vbs\""
Jul 15 12:11:30.242656 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.242605    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-sfm96"]
Jul 15 12:11:30.246624 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.246608    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7ktfc"]
Jul 15 12:11:30.246753 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.246735    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sfm96"
Jul 15 12:11:30.249600 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.249582    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gfjwd\""
Jul 15 12:11:30.249698 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.249630    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 15 12:11:30.249812 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.249779    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 15 12:11:30.251132 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.251112    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-cs8bw"]
Jul 15 12:11:30.251227 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.251202    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7ktfc"
Jul 15 12:11:30.253824 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.253802    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 15 12:11:30.253962 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.253942    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xk7gb\""
Jul 15 12:11:30.254127 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.254096    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 15 12:11:30.254269 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.254204    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 15 12:11:30.259520 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.259436    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sfm96"]
Jul 15 12:11:30.260441 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.260425    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7ktfc"]
Jul 15 12:11:30.373989 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.373954    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwfk8_c1e0b090-dace-4704-82e6-0c756006f902/konnectivity-agent/0.log" limit=1024
Jul 15 12:11:30.404001 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.403971    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-installation-pull-secrets\") pod \"image-registry-5dc4f89c55-8fdlw\" (UID: \"c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece\") " pod="openshift-image-registry/image-registry-5dc4f89c55-8fdlw"
Jul 15 12:11:30.404174 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.404009    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hpfk\" (UniqueName: \"kubernetes.io/projected/636b4e9e-64bd-41fb-a053-18d469b82593-kube-api-access-7hpfk\") pod \"ingress-canary-7ktfc\" (UID: \"636b4e9e-64bd-41fb-a053-18d469b82593\") " pod="openshift-ingress-canary/ingress-canary-7ktfc"
Jul 15 12:11:30.404174 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.404035    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2b930a70-91ac-47df-abbe-c3c2ec0ac1d4-nginx-conf\") pod \"networking-console-plugin-6cf856758c-cs8bw\" (UID: \"2b930a70-91ac-47df-abbe-c3c2ec0ac1d4\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-cs8bw"
Jul 15 12:11:30.404174 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.404100    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2b930a70-91ac-47df-abbe-c3c2ec0ac1d4-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-cs8bw\" (UID: \"2b930a70-91ac-47df-abbe-c3c2ec0ac1d4\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-cs8bw"
Jul 15 12:11:30.404174 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.404162    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b9a23fbe-f3c1-4d56-84a9-37025a59b3e4-config-volume\") pod \"dns-default-sfm96\" (UID: \"b9a23fbe-f3c1-4d56-84a9-37025a59b3e4\") " pod="openshift-dns/dns-default-sfm96"
Jul 15 12:11:30.404376 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.404198    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-image-registry-private-configuration\") pod \"image-registry-5dc4f89c55-8fdlw\" (UID: \"c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece\") " pod="openshift-image-registry/image-registry-5dc4f89c55-8fdlw"
Jul 15 12:11:30.404376 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.404239    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87524\" (UniqueName: \"kubernetes.io/projected/b9a23fbe-f3c1-4d56-84a9-37025a59b3e4-kube-api-access-87524\") pod \"dns-default-sfm96\" (UID: \"b9a23fbe-f3c1-4d56-84a9-37025a59b3e4\") " pod="openshift-dns/dns-default-sfm96"
Jul 15 12:11:30.404376 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.404258    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-registry-tls\") pod \"image-registry-5dc4f89c55-8fdlw\" (UID: \"c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece\") " pod="openshift-image-registry/image-registry-5dc4f89c55-8fdlw"
Jul 15 12:11:30.404376 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.404372    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9a23fbe-f3c1-4d56-84a9-37025a59b3e4-tmp-dir\") pod \"dns-default-sfm96\" (UID: \"b9a23fbe-f3c1-4d56-84a9-37025a59b3e4\") " pod="openshift-dns/dns-default-sfm96"
Jul 15 12:11:30.404537 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.404409    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-bound-sa-token\") pod \"image-registry-5dc4f89c55-8fdlw\" (UID: \"c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece\") " pod="openshift-image-registry/image-registry-5dc4f89c55-8fdlw"
Jul 15 12:11:30.404537 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.404457    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-registry-certificates\") pod \"image-registry-5dc4f89c55-8fdlw\" (UID: \"c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece\") " pod="openshift-image-registry/image-registry-5dc4f89c55-8fdlw"
Jul 15 12:11:30.404537 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.404511    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msc78\" (UniqueName: \"kubernetes.io/projected/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-kube-api-access-msc78\") pod \"image-registry-5dc4f89c55-8fdlw\" (UID: \"c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece\") " pod="openshift-image-registry/image-registry-5dc4f89c55-8fdlw"
Jul 15 12:11:30.404654 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.404572    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/636b4e9e-64bd-41fb-a053-18d469b82593-cert\") pod \"ingress-canary-7ktfc\" (UID: \"636b4e9e-64bd-41fb-a053-18d469b82593\") " pod="openshift-ingress-canary/ingress-canary-7ktfc"
Jul 15 12:11:30.404686 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.404658    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9a23fbe-f3c1-4d56-84a9-37025a59b3e4-metrics-tls\") pod \"dns-default-sfm96\" (UID: \"b9a23fbe-f3c1-4d56-84a9-37025a59b3e4\") " pod="openshift-dns/dns-default-sfm96"
Jul 15 12:11:30.404728 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.404694    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-ca-trust-extracted\") pod \"image-registry-5dc4f89c55-8fdlw\" (UID: \"c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece\") " pod="openshift-image-registry/image-registry-5dc4f89c55-8fdlw"
Jul 15 12:11:30.404771 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.404734    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-trusted-ca\") pod \"image-registry-5dc4f89c55-8fdlw\" (UID: \"c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece\") " pod="openshift-image-registry/image-registry-5dc4f89c55-8fdlw"
Jul 15 12:11:30.438817 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.438752    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spl8b"
Jul 15 12:11:30.438969 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.438753    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2c8x"
Jul 15 12:11:30.439025 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.438753    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mhn5"
Jul 15 12:11:30.441640 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.441615    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 12:11:30.441762 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.441695    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5qgtr\""
Jul 15 12:11:30.441762 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.441713    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 12:11:30.441762 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.441742    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 12:11:30.442000 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.441982    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 12:11:30.442072 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.442053    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tcn8s\""
Jul 15 12:11:30.458518 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.458482    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwfk8_c1e0b090-dace-4704-82e6-0c756006f902/konnectivity-agent/0.log" limit=1024
Jul 15 12:11:30.505780 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.505749    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87524\" (UniqueName: \"kubernetes.io/projected/b9a23fbe-f3c1-4d56-84a9-37025a59b3e4-kube-api-access-87524\") pod \"dns-default-sfm96\" (UID: \"b9a23fbe-f3c1-4d56-84a9-37025a59b3e4\") " pod="openshift-dns/dns-default-sfm96"
Jul 15 12:11:30.505780 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.505784    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-registry-tls\") pod \"image-registry-5dc4f89c55-8fdlw\" (UID: \"c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece\") " pod="openshift-image-registry/image-registry-5dc4f89c55-8fdlw"
Jul 15 12:11:30.505968 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.505807    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9a23fbe-f3c1-4d56-84a9-37025a59b3e4-tmp-dir\") pod \"dns-default-sfm96\" (UID: \"b9a23fbe-f3c1-4d56-84a9-37025a59b3e4\") " pod="openshift-dns/dns-default-sfm96"
Jul 15 12:11:30.505968 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.505834    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-bound-sa-token\") pod \"image-registry-5dc4f89c55-8fdlw\" (UID: \"c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece\") " pod="openshift-image-registry/image-registry-5dc4f89c55-8fdlw"
Jul 15 12:11:30.505968 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.505867    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-registry-certificates\") pod \"image-registry-5dc4f89c55-8fdlw\" (UID: \"c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece\") " pod="openshift-image-registry/image-registry-5dc4f89c55-8fdlw"
Jul 15 12:11:30.505968 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.505884    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msc78\" (UniqueName: \"kubernetes.io/projected/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-kube-api-access-msc78\") pod \"image-registry-5dc4f89c55-8fdlw\" (UID: \"c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece\") " pod="openshift-image-registry/image-registry-5dc4f89c55-8fdlw"
Jul 15 12:11:30.505968 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:30.505932    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 12:11:30.505968 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:30.505955    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dc4f89c55-8fdlw: secret "image-registry-tls" not found
Jul 15 12:11:30.506234 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.506024    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/636b4e9e-64bd-41fb-a053-18d469b82593-cert\") pod \"ingress-canary-7ktfc\" (UID: \"636b4e9e-64bd-41fb-a053-18d469b82593\") " pod="openshift-ingress-canary/ingress-canary-7ktfc"
Jul 15 12:11:30.506234 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:30.506033    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-registry-tls podName:c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece nodeName:}" failed. No retries permitted until 2026-07-15 12:11:31.006012202 +0000 UTC m=+38.120405928 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-registry-tls") pod "image-registry-5dc4f89c55-8fdlw" (UID: "c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece") : secret "image-registry-tls" not found
Jul 15 12:11:30.506234 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.506095    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9a23fbe-f3c1-4d56-84a9-37025a59b3e4-metrics-tls\") pod \"dns-default-sfm96\" (UID: \"b9a23fbe-f3c1-4d56-84a9-37025a59b3e4\") " pod="openshift-dns/dns-default-sfm96"
Jul 15 12:11:30.506234 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.506121    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-ca-trust-extracted\") pod \"image-registry-5dc4f89c55-8fdlw\" (UID: \"c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece\") " pod="openshift-image-registry/image-registry-5dc4f89c55-8fdlw"
Jul 15 12:11:30.506234 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.506146    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-trusted-ca\") pod \"image-registry-5dc4f89c55-8fdlw\" (UID: \"c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece\") " pod="openshift-image-registry/image-registry-5dc4f89c55-8fdlw"
Jul 15 12:11:30.506234 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.506179    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-installation-pull-secrets\") pod \"image-registry-5dc4f89c55-8fdlw\" (UID: \"c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece\") " pod="openshift-image-registry/image-registry-5dc4f89c55-8fdlw"
Jul 15 12:11:30.506234 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.506206    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hpfk\" (UniqueName: \"kubernetes.io/projected/636b4e9e-64bd-41fb-a053-18d469b82593-kube-api-access-7hpfk\") pod \"ingress-canary-7ktfc\" (UID: \"636b4e9e-64bd-41fb-a053-18d469b82593\") " pod="openshift-ingress-canary/ingress-canary-7ktfc"
Jul 15 12:11:30.506234 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:30.506210    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 12:11:30.506234 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.506231    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2b930a70-91ac-47df-abbe-c3c2ec0ac1d4-nginx-conf\") pod \"networking-console-plugin-6cf856758c-cs8bw\" (UID: \"2b930a70-91ac-47df-abbe-c3c2ec0ac1d4\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-cs8bw"
Jul 15 12:11:30.506663 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.506253    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2b930a70-91ac-47df-abbe-c3c2ec0ac1d4-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-cs8bw\" (UID: \"2b930a70-91ac-47df-abbe-c3c2ec0ac1d4\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-cs8bw"
Jul 15 12:11:30.506663 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:30.506286    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9a23fbe-f3c1-4d56-84a9-37025a59b3e4-metrics-tls podName:b9a23fbe-f3c1-4d56-84a9-37025a59b3e4 nodeName:}" failed. No retries permitted until 2026-07-15 12:11:31.006261822 +0000 UTC m=+38.120655537 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b9a23fbe-f3c1-4d56-84a9-37025a59b3e4-metrics-tls") pod "dns-default-sfm96" (UID: "b9a23fbe-f3c1-4d56-84a9-37025a59b3e4") : secret "dns-default-metrics-tls" not found
Jul 15 12:11:30.506663 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:30.506341    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 15 12:11:30.506663 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.506363    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b9a23fbe-f3c1-4d56-84a9-37025a59b3e4-config-volume\") pod \"dns-default-sfm96\" (UID: \"b9a23fbe-f3c1-4d56-84a9-37025a59b3e4\") " pod="openshift-dns/dns-default-sfm96"
Jul 15 12:11:30.506663 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:30.506401    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b930a70-91ac-47df-abbe-c3c2ec0ac1d4-networking-console-plugin-cert podName:2b930a70-91ac-47df-abbe-c3c2ec0ac1d4 nodeName:}" failed. No retries permitted until 2026-07-15 12:11:31.006386163 +0000 UTC m=+38.120779876 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2b930a70-91ac-47df-abbe-c3c2ec0ac1d4-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-cs8bw" (UID: "2b930a70-91ac-47df-abbe-c3c2ec0ac1d4") : secret "networking-console-plugin-cert" not found
Jul 15 12:11:30.506663 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.506595    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-ca-trust-extracted\") pod \"image-registry-5dc4f89c55-8fdlw\" (UID: \"c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece\") " pod="openshift-image-registry/image-registry-5dc4f89c55-8fdlw"
Jul 15 12:11:30.506663 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.506615    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-image-registry-private-configuration\") pod \"image-registry-5dc4f89c55-8fdlw\" (UID: \"c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece\") " pod="openshift-image-registry/image-registry-5dc4f89c55-8fdlw"
Jul 15 12:11:30.506663 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.506540    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9a23fbe-f3c1-4d56-84a9-37025a59b3e4-tmp-dir\") pod \"dns-default-sfm96\" (UID: \"b9a23fbe-f3c1-4d56-84a9-37025a59b3e4\") " pod="openshift-dns/dns-default-sfm96"
Jul 15 12:11:30.507051 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.506894    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-registry-certificates\") pod \"image-registry-5dc4f89c55-8fdlw\" (UID: \"c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece\") " pod="openshift-image-registry/image-registry-5dc4f89c55-8fdlw"
Jul 15 12:11:30.507051 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.506904    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b9a23fbe-f3c1-4d56-84a9-37025a59b3e4-config-volume\") pod \"dns-default-sfm96\" (UID: \"b9a23fbe-f3c1-4d56-84a9-37025a59b3e4\") " pod="openshift-dns/dns-default-sfm96"
Jul 15 12:11:30.507222 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.507196    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2b930a70-91ac-47df-abbe-c3c2ec0ac1d4-nginx-conf\") pod \"networking-console-plugin-6cf856758c-cs8bw\" (UID: \"2b930a70-91ac-47df-abbe-c3c2ec0ac1d4\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-cs8bw"
Jul 15 12:11:30.507495 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.507477    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-trusted-ca\") pod \"image-registry-5dc4f89c55-8fdlw\" (UID: \"c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece\") " pod="openshift-image-registry/image-registry-5dc4f89c55-8fdlw"
Jul 15 12:11:30.510184 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.510157    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-image-registry-private-configuration\") pod \"image-registry-5dc4f89c55-8fdlw\" (UID: \"c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece\") " pod="openshift-image-registry/image-registry-5dc4f89c55-8fdlw"
Jul 15 12:11:30.510310 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.510202    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-installation-pull-secrets\") pod \"image-registry-5dc4f89c55-8fdlw\" (UID: \"c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece\") " pod="openshift-image-registry/image-registry-5dc4f89c55-8fdlw"
Jul 15 12:11:30.510310 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.510249    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/636b4e9e-64bd-41fb-a053-18d469b82593-cert\") pod \"ingress-canary-7ktfc\" (UID: \"636b4e9e-64bd-41fb-a053-18d469b82593\") " pod="openshift-ingress-canary/ingress-canary-7ktfc"
Jul 15 12:11:30.514541 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.514514    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hpfk\" (UniqueName: \"kubernetes.io/projected/636b4e9e-64bd-41fb-a053-18d469b82593-kube-api-access-7hpfk\") pod \"ingress-canary-7ktfc\" (UID: \"636b4e9e-64bd-41fb-a053-18d469b82593\") " pod="openshift-ingress-canary/ingress-canary-7ktfc"
Jul 15 12:11:30.514640 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.514605    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-bound-sa-token\") pod \"image-registry-5dc4f89c55-8fdlw\" (UID: \"c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece\") " pod="openshift-image-registry/image-registry-5dc4f89c55-8fdlw"
Jul 15 12:11:30.514958 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.514941    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-msc78\" (UniqueName: \"kubernetes.io/projected/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-kube-api-access-msc78\") pod \"image-registry-5dc4f89c55-8fdlw\" (UID: \"c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece\") " pod="openshift-image-registry/image-registry-5dc4f89c55-8fdlw"
Jul 15 12:11:30.515151 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.515136    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87524\" (UniqueName: \"kubernetes.io/projected/b9a23fbe-f3c1-4d56-84a9-37025a59b3e4-kube-api-access-87524\") pod \"dns-default-sfm96\" (UID: \"b9a23fbe-f3c1-4d56-84a9-37025a59b3e4\") " pod="openshift-dns/dns-default-sfm96"
Jul 15 12:11:30.566232 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.566213    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7ktfc"
Jul 15 12:11:30.708065 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:30.708037    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7ktfc"]
Jul 15 12:11:30.712663 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:11:30.712625    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod636b4e9e_64bd_41fb_a053_18d469b82593.slice/crio-273ee2f093892d16ffa9ee5c42a37c9f6681dcf37f037840c5cf42cc9b8ef727 WatchSource:0}: Error finding container 273ee2f093892d16ffa9ee5c42a37c9f6681dcf37f037840c5cf42cc9b8ef727: Status 404 returned error can't find the container with id 273ee2f093892d16ffa9ee5c42a37c9f6681dcf37f037840c5cf42cc9b8ef727
Jul 15 12:11:31.010061 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:31.009951    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9a23fbe-f3c1-4d56-84a9-37025a59b3e4-metrics-tls\") pod \"dns-default-sfm96\" (UID: \"b9a23fbe-f3c1-4d56-84a9-37025a59b3e4\") " pod="openshift-dns/dns-default-sfm96"
Jul 15 12:11:31.010061 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:31.010022    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2b930a70-91ac-47df-abbe-c3c2ec0ac1d4-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-cs8bw\" (UID: \"2b930a70-91ac-47df-abbe-c3c2ec0ac1d4\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-cs8bw"
Jul 15 12:11:31.010061 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:31.010050    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-registry-tls\") pod \"image-registry-5dc4f89c55-8fdlw\" (UID: \"c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece\") " pod="openshift-image-registry/image-registry-5dc4f89c55-8fdlw"
Jul 15 12:11:31.010256 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:31.010104    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 12:11:31.010256 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:31.010143    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 12:11:31.010256 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:31.010144    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 15 12:11:31.010256 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:31.010172    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9a23fbe-f3c1-4d56-84a9-37025a59b3e4-metrics-tls podName:b9a23fbe-f3c1-4d56-84a9-37025a59b3e4 nodeName:}" failed. No retries permitted until 2026-07-15 12:11:32.010155661 +0000 UTC m=+39.124549390 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b9a23fbe-f3c1-4d56-84a9-37025a59b3e4-metrics-tls") pod "dns-default-sfm96" (UID: "b9a23fbe-f3c1-4d56-84a9-37025a59b3e4") : secret "dns-default-metrics-tls" not found
Jul 15 12:11:31.010256 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:31.010193    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b930a70-91ac-47df-abbe-c3c2ec0ac1d4-networking-console-plugin-cert podName:2b930a70-91ac-47df-abbe-c3c2ec0ac1d4 nodeName:}" failed. No retries permitted until 2026-07-15 12:11:32.010181073 +0000 UTC m=+39.124574784 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2b930a70-91ac-47df-abbe-c3c2ec0ac1d4-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-cs8bw" (UID: "2b930a70-91ac-47df-abbe-c3c2ec0ac1d4") : secret "networking-console-plugin-cert" not found
Jul 15 12:11:31.010256 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:31.010154    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dc4f89c55-8fdlw: secret "image-registry-tls" not found
Jul 15 12:11:31.010256 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:31.010222    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-registry-tls podName:c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece nodeName:}" failed. No retries permitted until 2026-07-15 12:11:32.010215917 +0000 UTC m=+39.124609626 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-registry-tls") pod "image-registry-5dc4f89c55-8fdlw" (UID: "c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece") : secret "image-registry-tls" not found
Jul 15 12:11:31.629979 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:31.629909    2560 generic.go:356] "Generic (PLEG): container finished" podID="4c29b692-3631-4562-96d0-83dad331764b" containerID="7bcc3aabc718b3568ac5082f286d42932bbcca30d9dd090b9f618a398609d756" exitCode=0
Jul 15 12:11:31.630851 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:31.629999    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-htv2v" event={"ID":"4c29b692-3631-4562-96d0-83dad331764b","Type":"ContainerDied","Data":"7bcc3aabc718b3568ac5082f286d42932bbcca30d9dd090b9f618a398609d756"}
Jul 15 12:11:31.631312 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:31.631274    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7ktfc" event={"ID":"636b4e9e-64bd-41fb-a053-18d469b82593","Type":"ContainerStarted","Data":"273ee2f093892d16ffa9ee5c42a37c9f6681dcf37f037840c5cf42cc9b8ef727"}
Jul 15 12:11:32.019637 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:32.019441    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9a23fbe-f3c1-4d56-84a9-37025a59b3e4-metrics-tls\") pod \"dns-default-sfm96\" (UID: \"b9a23fbe-f3c1-4d56-84a9-37025a59b3e4\") " pod="openshift-dns/dns-default-sfm96"
Jul 15 12:11:32.019834 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:32.019663    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2b930a70-91ac-47df-abbe-c3c2ec0ac1d4-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-cs8bw\" (UID: \"2b930a70-91ac-47df-abbe-c3c2ec0ac1d4\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-cs8bw"
Jul 15 12:11:32.019834 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:32.019708    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-registry-tls\") pod \"image-registry-5dc4f89c55-8fdlw\" (UID: \"c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece\") " pod="openshift-image-registry/image-registry-5dc4f89c55-8fdlw"
Jul 15 12:11:32.019834 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:32.019603    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 12:11:32.019834 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:32.019800    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9a23fbe-f3c1-4d56-84a9-37025a59b3e4-metrics-tls podName:b9a23fbe-f3c1-4d56-84a9-37025a59b3e4 nodeName:}" failed. No retries permitted until 2026-07-15 12:11:34.019778919 +0000 UTC m=+41.134172642 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b9a23fbe-f3c1-4d56-84a9-37025a59b3e4-metrics-tls") pod "dns-default-sfm96" (UID: "b9a23fbe-f3c1-4d56-84a9-37025a59b3e4") : secret "dns-default-metrics-tls" not found
Jul 15 12:11:32.019834 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:32.019821    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 15 12:11:32.020060 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:32.019852    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 12:11:32.020060 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:32.019866    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dc4f89c55-8fdlw: secret "image-registry-tls" not found
Jul 15 12:11:32.020060 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:32.019877    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b930a70-91ac-47df-abbe-c3c2ec0ac1d4-networking-console-plugin-cert podName:2b930a70-91ac-47df-abbe-c3c2ec0ac1d4 nodeName:}" failed. No retries permitted until 2026-07-15 12:11:34.019865067 +0000 UTC m=+41.134258777 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2b930a70-91ac-47df-abbe-c3c2ec0ac1d4-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-cs8bw" (UID: "2b930a70-91ac-47df-abbe-c3c2ec0ac1d4") : secret "networking-console-plugin-cert" not found
Jul 15 12:11:32.020060 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:32.019898    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-registry-tls podName:c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece nodeName:}" failed. No retries permitted until 2026-07-15 12:11:34.019888978 +0000 UTC m=+41.134282689 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-registry-tls") pod "image-registry-5dc4f89c55-8fdlw" (UID: "c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece") : secret "image-registry-tls" not found
Jul 15 12:11:32.637544 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:32.637508    2560 generic.go:356] "Generic (PLEG): container finished" podID="4c29b692-3631-4562-96d0-83dad331764b" containerID="e8d290bd927425795fbc00079d91bea876a4682b7d640af2fc6affa60d96c7e7" exitCode=0
Jul 15 12:11:32.638016 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:32.637581    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-htv2v" event={"ID":"4c29b692-3631-4562-96d0-83dad331764b","Type":"ContainerDied","Data":"e8d290bd927425795fbc00079d91bea876a4682b7d640af2fc6affa60d96c7e7"}
Jul 15 12:11:33.643223 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:33.643134    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-htv2v" event={"ID":"4c29b692-3631-4562-96d0-83dad331764b","Type":"ContainerStarted","Data":"38c766433f7af75d4186ea5253a3f62b1667269d3e92fdf7574efc619b84f64f"}
Jul 15 12:11:33.644529 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:33.644499    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7ktfc" event={"ID":"636b4e9e-64bd-41fb-a053-18d469b82593","Type":"ContainerStarted","Data":"fda5e068a3667427c33c2dd7f2bed5c5049a87dee3d13d7cbbf71b898c11f50f"}
Jul 15 12:11:33.667936 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:33.667893    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-htv2v" podStartSLOduration=8.138597171 podStartE2EDuration="39.66788103s" totalImagesPullingTime="31.529283859s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:10:54 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:11:33.666349556 +0000 UTC m=+40.780743288" watchObservedRunningTime="2026-07-15 12:11:33.66788103 +0000 UTC m=+40.782274761"
Jul 15 12:11:33.684101 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:33.684057    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7ktfc" podStartSLOduration=1.113475549 podStartE2EDuration="3.684041733s" totalImagesPullingTime="2.570566184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:11:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:11:33.683691535 +0000 UTC m=+40.798085266" watchObservedRunningTime="2026-07-15 12:11:33.684041733 +0000 UTC m=+40.798435476"
Jul 15 12:11:33.796071 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:33.796037    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwfk8_c1e0b090-dace-4704-82e6-0c756006f902/konnectivity-agent/0.log" limit=1024
Jul 15 12:11:33.895713 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:33.895623    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwfk8_c1e0b090-dace-4704-82e6-0c756006f902/konnectivity-agent/0.log" limit=1024
Jul 15 12:11:34.038403 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:34.038367    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9a23fbe-f3c1-4d56-84a9-37025a59b3e4-metrics-tls\") pod \"dns-default-sfm96\" (UID: \"b9a23fbe-f3c1-4d56-84a9-37025a59b3e4\") " pod="openshift-dns/dns-default-sfm96"
Jul 15 12:11:34.038571 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:34.038410    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2b930a70-91ac-47df-abbe-c3c2ec0ac1d4-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-cs8bw\" (UID: \"2b930a70-91ac-47df-abbe-c3c2ec0ac1d4\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-cs8bw"
Jul 15 12:11:34.038571 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:34.038441    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-registry-tls\") pod \"image-registry-5dc4f89c55-8fdlw\" (UID: \"c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece\") " pod="openshift-image-registry/image-registry-5dc4f89c55-8fdlw"
Jul 15 12:11:34.038571 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:34.038479    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 12:11:34.038571 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:34.038538    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9a23fbe-f3c1-4d56-84a9-37025a59b3e4-metrics-tls podName:b9a23fbe-f3c1-4d56-84a9-37025a59b3e4 nodeName:}" failed. No retries permitted until 2026-07-15 12:11:38.038523524 +0000 UTC m=+45.152917234 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b9a23fbe-f3c1-4d56-84a9-37025a59b3e4-metrics-tls") pod "dns-default-sfm96" (UID: "b9a23fbe-f3c1-4d56-84a9-37025a59b3e4") : secret "dns-default-metrics-tls" not found
Jul 15 12:11:34.038571 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:34.038541    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 12:11:34.038571 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:34.038541    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 15 12:11:34.038802 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:34.038613    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b930a70-91ac-47df-abbe-c3c2ec0ac1d4-networking-console-plugin-cert podName:2b930a70-91ac-47df-abbe-c3c2ec0ac1d4 nodeName:}" failed. No retries permitted until 2026-07-15 12:11:38.038596945 +0000 UTC m=+45.152990661 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2b930a70-91ac-47df-abbe-c3c2ec0ac1d4-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-cs8bw" (UID: "2b930a70-91ac-47df-abbe-c3c2ec0ac1d4") : secret "networking-console-plugin-cert" not found
Jul 15 12:11:34.038802 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:34.038551    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dc4f89c55-8fdlw: secret "image-registry-tls" not found
Jul 15 12:11:34.038802 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:34.038677    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-registry-tls podName:c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece nodeName:}" failed. No retries permitted until 2026-07-15 12:11:38.038656607 +0000 UTC m=+45.153050321 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-registry-tls") pod "image-registry-5dc4f89c55-8fdlw" (UID: "c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece") : secret "image-registry-tls" not found
Jul 15 12:11:35.281661 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:35.281404    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwfk8_c1e0b090-dace-4704-82e6-0c756006f902/konnectivity-agent/0.log" limit=1024
Jul 15 12:11:35.348310 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:35.348266    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwfk8_c1e0b090-dace-4704-82e6-0c756006f902/konnectivity-agent/0.log" limit=1024
Jul 15 12:11:36.844491 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:36.844456    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwfk8_c1e0b090-dace-4704-82e6-0c756006f902/konnectivity-agent/0.log" limit=1024
Jul 15 12:11:36.945750 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:36.945703    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwfk8_c1e0b090-dace-4704-82e6-0c756006f902/konnectivity-agent/0.log" limit=1024
Jul 15 12:11:37.045823 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:37.045787    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwfk8_c1e0b090-dace-4704-82e6-0c756006f902/konnectivity-agent/0.log" limit=1024
Jul 15 12:11:37.862085 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:37.862057    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwfk8_c1e0b090-dace-4704-82e6-0c756006f902/konnectivity-agent/0.log" limit=1024
Jul 15 12:11:37.916334 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:37.916282    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwfk8_c1e0b090-dace-4704-82e6-0c756006f902/konnectivity-agent/0.log" limit=1024
Jul 15 12:11:38.068789 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:38.068755    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9a23fbe-f3c1-4d56-84a9-37025a59b3e4-metrics-tls\") pod \"dns-default-sfm96\" (UID: \"b9a23fbe-f3c1-4d56-84a9-37025a59b3e4\") " pod="openshift-dns/dns-default-sfm96"
Jul 15 12:11:38.068954 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:38.068799    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2b930a70-91ac-47df-abbe-c3c2ec0ac1d4-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-cs8bw\" (UID: \"2b930a70-91ac-47df-abbe-c3c2ec0ac1d4\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-cs8bw"
Jul 15 12:11:38.068954 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:38.068843    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-registry-tls\") pod \"image-registry-5dc4f89c55-8fdlw\" (UID: \"c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece\") " pod="openshift-image-registry/image-registry-5dc4f89c55-8fdlw"
Jul 15 12:11:38.068954 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:38.068926    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 12:11:38.069042 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:38.068954    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 12:11:38.069042 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:38.068966    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dc4f89c55-8fdlw: secret "image-registry-tls" not found
Jul 15 12:11:38.069042 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:38.068981    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 15 12:11:38.069042 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:38.068994    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9a23fbe-f3c1-4d56-84a9-37025a59b3e4-metrics-tls podName:b9a23fbe-f3c1-4d56-84a9-37025a59b3e4 nodeName:}" failed. No retries permitted until 2026-07-15 12:11:46.068975245 +0000 UTC m=+53.183368966 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b9a23fbe-f3c1-4d56-84a9-37025a59b3e4-metrics-tls") pod "dns-default-sfm96" (UID: "b9a23fbe-f3c1-4d56-84a9-37025a59b3e4") : secret "dns-default-metrics-tls" not found
Jul 15 12:11:38.069042 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:38.069010    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-registry-tls podName:c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece nodeName:}" failed. No retries permitted until 2026-07-15 12:11:46.069004293 +0000 UTC m=+53.183398005 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-registry-tls") pod "image-registry-5dc4f89c55-8fdlw" (UID: "c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece") : secret "image-registry-tls" not found
Jul 15 12:11:38.069042 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:38.069032    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b930a70-91ac-47df-abbe-c3c2ec0ac1d4-networking-console-plugin-cert podName:2b930a70-91ac-47df-abbe-c3c2ec0ac1d4 nodeName:}" failed. No retries permitted until 2026-07-15 12:11:46.069019605 +0000 UTC m=+53.183413319 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2b930a70-91ac-47df-abbe-c3c2ec0ac1d4-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-cs8bw" (UID: "2b930a70-91ac-47df-abbe-c3c2ec0ac1d4") : secret "networking-console-plugin-cert" not found
Jul 15 12:11:38.115383 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:38.115307    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwfk8_c1e0b090-dace-4704-82e6-0c756006f902/konnectivity-agent/0.log" limit=1024
Jul 15 12:11:46.131503 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:46.131463    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9a23fbe-f3c1-4d56-84a9-37025a59b3e4-metrics-tls\") pod \"dns-default-sfm96\" (UID: \"b9a23fbe-f3c1-4d56-84a9-37025a59b3e4\") " pod="openshift-dns/dns-default-sfm96"
Jul 15 12:11:46.131979 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:46.131509    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2b930a70-91ac-47df-abbe-c3c2ec0ac1d4-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-cs8bw\" (UID: \"2b930a70-91ac-47df-abbe-c3c2ec0ac1d4\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-cs8bw"
Jul 15 12:11:46.131979 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:46.131577    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-registry-tls\") pod \"image-registry-5dc4f89c55-8fdlw\" (UID: \"c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece\") " pod="openshift-image-registry/image-registry-5dc4f89c55-8fdlw"
Jul 15 12:11:46.131979 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:46.131619    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 12:11:46.131979 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:46.131668    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 12:11:46.131979 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:46.131676    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9a23fbe-f3c1-4d56-84a9-37025a59b3e4-metrics-tls podName:b9a23fbe-f3c1-4d56-84a9-37025a59b3e4 nodeName:}" failed. No retries permitted until 2026-07-15 12:12:02.131662019 +0000 UTC m=+69.246055729 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b9a23fbe-f3c1-4d56-84a9-37025a59b3e4-metrics-tls") pod "dns-default-sfm96" (UID: "b9a23fbe-f3c1-4d56-84a9-37025a59b3e4") : secret "dns-default-metrics-tls" not found
Jul 15 12:11:46.131979 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:46.131680    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dc4f89c55-8fdlw: secret "image-registry-tls" not found
Jul 15 12:11:46.131979 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:46.131730    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-registry-tls podName:c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece nodeName:}" failed. No retries permitted until 2026-07-15 12:12:02.131717976 +0000 UTC m=+69.246111686 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-registry-tls") pod "image-registry-5dc4f89c55-8fdlw" (UID: "c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece") : secret "image-registry-tls" not found
Jul 15 12:11:46.131979 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:46.131745    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 15 12:11:46.131979 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:46.131809    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b930a70-91ac-47df-abbe-c3c2ec0ac1d4-networking-console-plugin-cert podName:2b930a70-91ac-47df-abbe-c3c2ec0ac1d4 nodeName:}" failed. No retries permitted until 2026-07-15 12:12:02.131793334 +0000 UTC m=+69.246187047 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2b930a70-91ac-47df-abbe-c3c2ec0ac1d4-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-cs8bw" (UID: "2b930a70-91ac-47df-abbe-c3c2ec0ac1d4") : secret "networking-console-plugin-cert" not found
Jul 15 12:11:54.614648 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:54.614615    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xh4rs"
Jul 15 12:11:59.130102 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:59.130052    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19938f5e-4b2c-45f8-9077-4fb510687262-metrics-certs\") pod \"network-metrics-daemon-spl8b\" (UID: \"19938f5e-4b2c-45f8-9077-4fb510687262\") " pod="openshift-multus/network-metrics-daemon-spl8b"
Jul 15 12:11:59.130524 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:59.130261    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/48797460-a1a5-43f2-9841-61f8adce425d-original-pull-secret\") pod \"global-pull-secret-syncer-b2c8x\" (UID: \"48797460-a1a5-43f2-9841-61f8adce425d\") " pod="kube-system/global-pull-secret-syncer-b2c8x"
Jul 15 12:11:59.132921 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:59.132900    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 12:11:59.133026 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:59.133011    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 12:11:59.141217 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:59.141198    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 15 12:11:59.141280 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:11:59.141250    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19938f5e-4b2c-45f8-9077-4fb510687262-metrics-certs podName:19938f5e-4b2c-45f8-9077-4fb510687262 nodeName:}" failed. No retries permitted until 2026-07-15 12:13:03.14123571 +0000 UTC m=+130.255629421 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19938f5e-4b2c-45f8-9077-4fb510687262-metrics-certs") pod "network-metrics-daemon-spl8b" (UID: "19938f5e-4b2c-45f8-9077-4fb510687262") : secret "metrics-daemon-secret" not found
Jul 15 12:11:59.144860 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:59.144845    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/48797460-a1a5-43f2-9841-61f8adce425d-original-pull-secret\") pod \"global-pull-secret-syncer-b2c8x\" (UID: \"48797460-a1a5-43f2-9841-61f8adce425d\") " pod="kube-system/global-pull-secret-syncer-b2c8x"
Jul 15 12:11:59.257492 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:59.257451    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2c8x"
Jul 15 12:11:59.332404 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:59.332310    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnrjk\" (UniqueName: \"kubernetes.io/projected/17bfcad0-727f-42da-b33d-64a2d4cad92a-kube-api-access-qnrjk\") pod \"network-check-target-4mhn5\" (UID: \"17bfcad0-727f-42da-b33d-64a2d4cad92a\") " pod="openshift-network-diagnostics/network-check-target-4mhn5"
Jul 15 12:11:59.346035 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:59.346009    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 12:11:59.355713 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:59.355692    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 12:11:59.366143 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:59.366118    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnrjk\" (UniqueName: \"kubernetes.io/projected/17bfcad0-727f-42da-b33d-64a2d4cad92a-kube-api-access-qnrjk\") pod \"network-check-target-4mhn5\" (UID: \"17bfcad0-727f-42da-b33d-64a2d4cad92a\") " pod="openshift-network-diagnostics/network-check-target-4mhn5"
Jul 15 12:11:59.372359 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:59.372315    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-b2c8x"]
Jul 15 12:11:59.375686 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:11:59.375666    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48797460_a1a5_43f2_9841_61f8adce425d.slice/crio-e506d76e24c0fd2f098e6205ad23d1e9e6407f161163f3745743037522dd398c WatchSource:0}: Error finding container e506d76e24c0fd2f098e6205ad23d1e9e6407f161163f3745743037522dd398c: Status 404 returned error can't find the container with id e506d76e24c0fd2f098e6205ad23d1e9e6407f161163f3745743037522dd398c
Jul 15 12:11:59.567471 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:59.567443    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tcn8s\""
Jul 15 12:11:59.575687 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:59.575669    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mhn5"
Jul 15 12:11:59.690117 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:59.690088    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4mhn5"]
Jul 15 12:11:59.692240 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:11:59.692214    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17bfcad0_727f_42da_b33d_64a2d4cad92a.slice/crio-e022e4a8a816c87275664b442f98b3d4dab6f39a4837cbb87a54aa93edf1ec63 WatchSource:0}: Error finding container e022e4a8a816c87275664b442f98b3d4dab6f39a4837cbb87a54aa93edf1ec63: Status 404 returned error can't find the container with id e022e4a8a816c87275664b442f98b3d4dab6f39a4837cbb87a54aa93edf1ec63
Jul 15 12:11:59.703910 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:59.703887    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-b2c8x" event={"ID":"48797460-a1a5-43f2-9841-61f8adce425d","Type":"ContainerStarted","Data":"e506d76e24c0fd2f098e6205ad23d1e9e6407f161163f3745743037522dd398c"}
Jul 15 12:11:59.704853 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:11:59.704831    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4mhn5" event={"ID":"17bfcad0-727f-42da-b33d-64a2d4cad92a","Type":"ContainerStarted","Data":"e022e4a8a816c87275664b442f98b3d4dab6f39a4837cbb87a54aa93edf1ec63"}
Jul 15 12:12:02.153606 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:12:02.153569    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9a23fbe-f3c1-4d56-84a9-37025a59b3e4-metrics-tls\") pod \"dns-default-sfm96\" (UID: \"b9a23fbe-f3c1-4d56-84a9-37025a59b3e4\") " pod="openshift-dns/dns-default-sfm96"
Jul 15 12:12:02.154134 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:12:02.153623    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2b930a70-91ac-47df-abbe-c3c2ec0ac1d4-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-cs8bw\" (UID: \"2b930a70-91ac-47df-abbe-c3c2ec0ac1d4\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-cs8bw"
Jul 15 12:12:02.154134 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:12:02.153670    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-registry-tls\") pod \"image-registry-5dc4f89c55-8fdlw\" (UID: \"c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece\") " pod="openshift-image-registry/image-registry-5dc4f89c55-8fdlw"
Jul 15 12:12:02.154134 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:12:02.153745    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 12:12:02.154134 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:12:02.153815    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 12:12:02.154134 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:12:02.153831    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dc4f89c55-8fdlw: secret "image-registry-tls" not found
Jul 15 12:12:02.154134 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:12:02.153880    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 15 12:12:02.154134 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:12:02.153895    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-registry-tls podName:c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece nodeName:}" failed. No retries permitted until 2026-07-15 12:12:34.153874427 +0000 UTC m=+101.268268142 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-registry-tls") pod "image-registry-5dc4f89c55-8fdlw" (UID: "c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece") : secret "image-registry-tls" not found
Jul 15 12:12:02.154134 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:12:02.153960    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b930a70-91ac-47df-abbe-c3c2ec0ac1d4-networking-console-plugin-cert podName:2b930a70-91ac-47df-abbe-c3c2ec0ac1d4 nodeName:}" failed. No retries permitted until 2026-07-15 12:12:34.153939088 +0000 UTC m=+101.268332801 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2b930a70-91ac-47df-abbe-c3c2ec0ac1d4-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-cs8bw" (UID: "2b930a70-91ac-47df-abbe-c3c2ec0ac1d4") : secret "networking-console-plugin-cert" not found
Jul 15 12:12:02.154134 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:12:02.154006    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9a23fbe-f3c1-4d56-84a9-37025a59b3e4-metrics-tls podName:b9a23fbe-f3c1-4d56-84a9-37025a59b3e4 nodeName:}" failed. No retries permitted until 2026-07-15 12:12:34.153989981 +0000 UTC m=+101.268383693 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b9a23fbe-f3c1-4d56-84a9-37025a59b3e4-metrics-tls") pod "dns-default-sfm96" (UID: "b9a23fbe-f3c1-4d56-84a9-37025a59b3e4") : secret "dns-default-metrics-tls" not found
Jul 15 12:12:04.718348 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:12:04.718315    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4mhn5" event={"ID":"17bfcad0-727f-42da-b33d-64a2d4cad92a","Type":"ContainerStarted","Data":"cf91ae65b5699d5b3a0b2a7b791bd070a293bfc1b6e05f0db29ce4db476e01a0"}
Jul 15 12:12:05.722246 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:12:05.722211    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-b2c8x" event={"ID":"48797460-a1a5-43f2-9841-61f8adce425d","Type":"ContainerStarted","Data":"02beb0df7ddc7bf81fcf0868285658146810c4239fcb2e207c03a838b60a2d07"}
Jul 15 12:12:05.738949 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:12:05.738899    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-b2c8x" podStartSLOduration=66.180746935 podStartE2EDuration="1m11.738885463s" totalImagesPullingTime="5.558138528s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:10:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:12:05.73827124 +0000 UTC m=+72.852664963" watchObservedRunningTime="2026-07-15 12:12:05.738885463 +0000 UTC m=+72.853279173"
Jul 15 12:12:05.753223 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:12:05.753176    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4mhn5" podStartSLOduration=66.825115189 podStartE2EDuration="1m11.753163719s" totalImagesPullingTime="4.92804853s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:10:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:12:05.752098839 +0000 UTC m=+72.866492573" watchObservedRunningTime="2026-07-15 12:12:05.753163719 +0000 UTC m=+72.867557450"
Jul 15 12:12:15.722554 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:12:15.722435    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4mhn5"
Jul 15 12:12:34.180538 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:12:34.180435    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9a23fbe-f3c1-4d56-84a9-37025a59b3e4-metrics-tls\") pod \"dns-default-sfm96\" (UID: \"b9a23fbe-f3c1-4d56-84a9-37025a59b3e4\") " pod="openshift-dns/dns-default-sfm96"
Jul 15 12:12:34.180538 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:12:34.180491    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2b930a70-91ac-47df-abbe-c3c2ec0ac1d4-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-cs8bw\" (UID: \"2b930a70-91ac-47df-abbe-c3c2ec0ac1d4\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-cs8bw"
Jul 15 12:12:34.180538 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:12:34.180518    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-registry-tls\") pod \"image-registry-5dc4f89c55-8fdlw\" (UID: \"c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece\") " pod="openshift-image-registry/image-registry-5dc4f89c55-8fdlw"
Jul 15 12:12:34.181049 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:12:34.180582    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 12:12:34.181049 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:12:34.180653    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 15 12:12:34.181049 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:12:34.180603    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 12:12:34.181049 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:12:34.180686    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dc4f89c55-8fdlw: secret "image-registry-tls" not found
Jul 15 12:12:34.181049 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:12:34.180661    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9a23fbe-f3c1-4d56-84a9-37025a59b3e4-metrics-tls podName:b9a23fbe-f3c1-4d56-84a9-37025a59b3e4 nodeName:}" failed. No retries permitted until 2026-07-15 12:13:38.180644069 +0000 UTC m=+165.295037779 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b9a23fbe-f3c1-4d56-84a9-37025a59b3e4-metrics-tls") pod "dns-default-sfm96" (UID: "b9a23fbe-f3c1-4d56-84a9-37025a59b3e4") : secret "dns-default-metrics-tls" not found
Jul 15 12:12:34.181049 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:12:34.180735    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-registry-tls podName:c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece nodeName:}" failed. No retries permitted until 2026-07-15 12:13:38.180717129 +0000 UTC m=+165.295110842 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-registry-tls") pod "image-registry-5dc4f89c55-8fdlw" (UID: "c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece") : secret "image-registry-tls" not found
Jul 15 12:12:34.181049 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:12:34.180752    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b930a70-91ac-47df-abbe-c3c2ec0ac1d4-networking-console-plugin-cert podName:2b930a70-91ac-47df-abbe-c3c2ec0ac1d4 nodeName:}" failed. No retries permitted until 2026-07-15 12:13:38.180742664 +0000 UTC m=+165.295136374 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2b930a70-91ac-47df-abbe-c3c2ec0ac1d4-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-cs8bw" (UID: "2b930a70-91ac-47df-abbe-c3c2ec0ac1d4") : secret "networking-console-plugin-cert" not found
Jul 15 12:12:35.725119 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:12:35.725091    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4mhn5"
Jul 15 12:13:03.180422 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:13:03.180381    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19938f5e-4b2c-45f8-9077-4fb510687262-metrics-certs\") pod \"network-metrics-daemon-spl8b\" (UID: \"19938f5e-4b2c-45f8-9077-4fb510687262\") " pod="openshift-multus/network-metrics-daemon-spl8b"
Jul 15 12:13:03.180861 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:13:03.180519    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 15 12:13:03.180861 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:13:03.180587    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19938f5e-4b2c-45f8-9077-4fb510687262-metrics-certs podName:19938f5e-4b2c-45f8-9077-4fb510687262 nodeName:}" failed. No retries permitted until 2026-07-15 12:15:05.180571306 +0000 UTC m=+252.294965016 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19938f5e-4b2c-45f8-9077-4fb510687262-metrics-certs") pod "network-metrics-daemon-spl8b" (UID: "19938f5e-4b2c-45f8-9077-4fb510687262") : secret "metrics-daemon-secret" not found
Jul 15 12:13:33.238577 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:13:33.238536    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5dc4f89c55-8fdlw" podUID="c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece"
Jul 15 12:13:33.250779 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:13:33.250759    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6cf856758c-cs8bw" podUID="2b930a70-91ac-47df-abbe-c3c2ec0ac1d4"
Jul 15 12:13:33.259945 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:13:33.259919    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-sfm96" podUID="b9a23fbe-f3c1-4d56-84a9-37025a59b3e4"
Jul 15 12:13:33.450520 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:13:33.450485    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-spl8b" podUID="19938f5e-4b2c-45f8-9077-4fb510687262"
Jul 15 12:13:33.924547 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:13:33.924522    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sfm96"
Jul 15 12:13:33.924666 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:13:33.924521    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5dc4f89c55-8fdlw"
Jul 15 12:13:33.924703 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:13:33.924529    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-cs8bw"
Jul 15 12:13:38.227336 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:13:38.227262    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9a23fbe-f3c1-4d56-84a9-37025a59b3e4-metrics-tls\") pod \"dns-default-sfm96\" (UID: \"b9a23fbe-f3c1-4d56-84a9-37025a59b3e4\") " pod="openshift-dns/dns-default-sfm96"
Jul 15 12:13:38.227906 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:13:38.227365    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2b930a70-91ac-47df-abbe-c3c2ec0ac1d4-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-cs8bw\" (UID: \"2b930a70-91ac-47df-abbe-c3c2ec0ac1d4\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-cs8bw"
Jul 15 12:13:38.227906 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:13:38.227418    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-registry-tls\") pod \"image-registry-5dc4f89c55-8fdlw\" (UID: \"c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece\") " pod="openshift-image-registry/image-registry-5dc4f89c55-8fdlw"
Jul 15 12:13:38.227906 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:13:38.227589    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 12:13:38.227906 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:13:38.227605    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dc4f89c55-8fdlw: secret "image-registry-tls" not found
Jul 15 12:13:38.227906 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:13:38.227678    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-registry-tls podName:c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece nodeName:}" failed. No retries permitted until 2026-07-15 12:15:40.227660185 +0000 UTC m=+287.342053899 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-registry-tls") pod "image-registry-5dc4f89c55-8fdlw" (UID: "c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece") : secret "image-registry-tls" not found
Jul 15 12:13:38.228182 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:13:38.228161    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 12:13:38.228446 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:13:38.228401    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9a23fbe-f3c1-4d56-84a9-37025a59b3e4-metrics-tls podName:b9a23fbe-f3c1-4d56-84a9-37025a59b3e4 nodeName:}" failed. No retries permitted until 2026-07-15 12:15:40.228382362 +0000 UTC m=+287.342776074 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b9a23fbe-f3c1-4d56-84a9-37025a59b3e4-metrics-tls") pod "dns-default-sfm96" (UID: "b9a23fbe-f3c1-4d56-84a9-37025a59b3e4") : secret "dns-default-metrics-tls" not found
Jul 15 12:13:38.228643 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:13:38.228629    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 15 12:13:38.228761 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:13:38.228752    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b930a70-91ac-47df-abbe-c3c2ec0ac1d4-networking-console-plugin-cert podName:2b930a70-91ac-47df-abbe-c3c2ec0ac1d4 nodeName:}" failed. No retries permitted until 2026-07-15 12:15:40.228732589 +0000 UTC m=+287.343126300 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2b930a70-91ac-47df-abbe-c3c2ec0ac1d4-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-cs8bw" (UID: "2b930a70-91ac-47df-abbe-c3c2ec0ac1d4") : secret "networking-console-plugin-cert" not found
Jul 15 12:13:46.438081 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:13:46.437999    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spl8b"
Jul 15 12:14:58.075992 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.075961    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pgjww"]
Jul 15 12:14:58.077676 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.077660    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pgjww"
Jul 15 12:14:58.082500 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.082473    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 15 12:14:58.082682 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.082569    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-znpt7\""
Jul 15 12:14:58.082796 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.082774    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 15 12:14:58.082857 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.082831    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 15 12:14:58.083280 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.083258    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 15 12:14:58.098116 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.098092    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pgjww"]
Jul 15 12:14:58.144757 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.144731    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f428cec4-6a61-47e3-b3bc-0ebed3a86af4-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-pgjww\" (UID: \"f428cec4-6a61-47e3-b3bc-0ebed3a86af4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pgjww"
Jul 15 12:14:58.144897 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.144796    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhtwf\" (UniqueName: \"kubernetes.io/projected/f428cec4-6a61-47e3-b3bc-0ebed3a86af4-kube-api-access-vhtwf\") pod \"kube-storage-version-migrator-operator-799cb7f958-pgjww\" (UID: \"f428cec4-6a61-47e3-b3bc-0ebed3a86af4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pgjww"
Jul 15 12:14:58.144897 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.144826    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f428cec4-6a61-47e3-b3bc-0ebed3a86af4-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-pgjww\" (UID: \"f428cec4-6a61-47e3-b3bc-0ebed3a86af4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pgjww"
Jul 15 12:14:58.157987 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.157966    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-htjqx"]
Jul 15 12:14:58.159717 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.159703    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-htjqx"
Jul 15 12:14:58.161708 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.161685    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nb955"]
Jul 15 12:14:58.162642 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.162624    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-lqs82\""
Jul 15 12:14:58.163277 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.163257    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-vl5tg"]
Jul 15 12:14:58.163385 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.163362    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nb955"
Jul 15 12:14:58.164967 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.164948    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-xkvbf"]
Jul 15 12:14:58.165101 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.165085    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-vl5tg"
Jul 15 12:14:58.165622 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.165606    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 15 12:14:58.165939 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.165916    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 15 12:14:58.166021 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.165996    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 15 12:14:58.166178 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.166157    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 15 12:14:58.166324 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.166308    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-skc2b\""
Jul 15 12:14:58.166682 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.166662    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-xkvbf"
Jul 15 12:14:58.167579 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.167546    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-phv5x\""
Jul 15 12:14:58.168036 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.168022    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 15 12:14:58.168246 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.168226    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 15 12:14:58.168377 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.168358    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 15 12:14:58.171174 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.170779    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-8r7z5\""
Jul 15 12:14:58.171174 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.171159    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 15 12:14:58.173561 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.171552    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 15 12:14:58.173561 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.172053    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 15 12:14:58.173561 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.172098    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 15 12:14:58.173561 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.172345    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-htjqx"]
Jul 15 12:14:58.173561 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.172438    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 15 12:14:58.178574 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.178556    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nb955"]
Jul 15 12:14:58.178777 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.178755    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 15 12:14:58.179465 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.179439    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-vl5tg"]
Jul 15 12:14:58.180802 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.180771    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 15 12:14:58.188912 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.188893    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-xkvbf"]
Jul 15 12:14:58.245356 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.245329    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhtwf\" (UniqueName: \"kubernetes.io/projected/f428cec4-6a61-47e3-b3bc-0ebed3a86af4-kube-api-access-vhtwf\") pod \"kube-storage-version-migrator-operator-799cb7f958-pgjww\" (UID: \"f428cec4-6a61-47e3-b3bc-0ebed3a86af4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pgjww"
Jul 15 12:14:58.245481 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.245364    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/72392327-8bf2-4751-a503-370287b57cbb-serving-cert\") pod \"insights-operator-68d9dd94cf-vl5tg\" (UID: \"72392327-8bf2-4751-a503-370287b57cbb\") " pod="openshift-insights/insights-operator-68d9dd94cf-vl5tg"
Jul 15 12:14:58.245481 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.245388    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/641b0ffa-0450-4198-8066-0241ab179822-serving-cert\") pod \"console-operator-7866497494-xkvbf\" (UID: \"641b0ffa-0450-4198-8066-0241ab179822\") " pod="openshift-console-operator/console-operator-7866497494-xkvbf"
Jul 15 12:14:58.245481 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.245405    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f428cec4-6a61-47e3-b3bc-0ebed3a86af4-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-pgjww\" (UID: \"f428cec4-6a61-47e3-b3bc-0ebed3a86af4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pgjww"
Jul 15 12:14:58.245481 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.245429    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsjlm\" (UniqueName: \"kubernetes.io/projected/72392327-8bf2-4751-a503-370287b57cbb-kube-api-access-rsjlm\") pod \"insights-operator-68d9dd94cf-vl5tg\" (UID: \"72392327-8bf2-4751-a503-370287b57cbb\") " pod="openshift-insights/insights-operator-68d9dd94cf-vl5tg"
Jul 15 12:14:58.245632 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.245492    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8l9wt\" (UniqueName: \"kubernetes.io/projected/2680af55-84b9-40bf-a06e-de77387a3e33-kube-api-access-8l9wt\") pod \"service-ca-operator-7695fc6c8c-nb955\" (UID: \"2680af55-84b9-40bf-a06e-de77387a3e33\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nb955"
Jul 15 12:14:58.245632 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.245527    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2680af55-84b9-40bf-a06e-de77387a3e33-config\") pod \"service-ca-operator-7695fc6c8c-nb955\" (UID: \"2680af55-84b9-40bf-a06e-de77387a3e33\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nb955"
Jul 15 12:14:58.245632 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.245551    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72392327-8bf2-4751-a503-370287b57cbb-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-vl5tg\" (UID: \"72392327-8bf2-4751-a503-370287b57cbb\") " pod="openshift-insights/insights-operator-68d9dd94cf-vl5tg"
Jul 15 12:14:58.245632 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.245608    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72392327-8bf2-4751-a503-370287b57cbb-tmp\") pod \"insights-operator-68d9dd94cf-vl5tg\" (UID: \"72392327-8bf2-4751-a503-370287b57cbb\") " pod="openshift-insights/insights-operator-68d9dd94cf-vl5tg"
Jul 15 12:14:58.245632 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.245630    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/641b0ffa-0450-4198-8066-0241ab179822-config\") pod \"console-operator-7866497494-xkvbf\" (UID: \"641b0ffa-0450-4198-8066-0241ab179822\") " pod="openshift-console-operator/console-operator-7866497494-xkvbf"
Jul 15 12:14:58.245798 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.245659    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/641b0ffa-0450-4198-8066-0241ab179822-trusted-ca\") pod \"console-operator-7866497494-xkvbf\" (UID: \"641b0ffa-0450-4198-8066-0241ab179822\") " pod="openshift-console-operator/console-operator-7866497494-xkvbf"
Jul 15 12:14:58.245798 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.245692    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f428cec4-6a61-47e3-b3bc-0ebed3a86af4-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-pgjww\" (UID: \"f428cec4-6a61-47e3-b3bc-0ebed3a86af4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pgjww"
Jul 15 12:14:58.245798 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.245737    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m28bj\" (UniqueName: \"kubernetes.io/projected/2696a718-be0c-4c8c-b69e-3407561ddff8-kube-api-access-m28bj\") pod \"network-check-source-869dcfcdcd-htjqx\" (UID: \"2696a718-be0c-4c8c-b69e-3407561ddff8\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-htjqx"
Jul 15 12:14:58.245798 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.245760    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/72392327-8bf2-4751-a503-370287b57cbb-snapshots\") pod \"insights-operator-68d9dd94cf-vl5tg\" (UID: \"72392327-8bf2-4751-a503-370287b57cbb\") " pod="openshift-insights/insights-operator-68d9dd94cf-vl5tg"
Jul 15 12:14:58.245798 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.245783    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72392327-8bf2-4751-a503-370287b57cbb-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-vl5tg\" (UID: \"72392327-8bf2-4751-a503-370287b57cbb\") " pod="openshift-insights/insights-operator-68d9dd94cf-vl5tg"
Jul 15 12:14:58.245981 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.245815    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2680af55-84b9-40bf-a06e-de77387a3e33-serving-cert\") pod \"service-ca-operator-7695fc6c8c-nb955\" (UID: \"2680af55-84b9-40bf-a06e-de77387a3e33\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nb955"
Jul 15 12:14:58.245981 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.245844    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jplf6\" (UniqueName: \"kubernetes.io/projected/641b0ffa-0450-4198-8066-0241ab179822-kube-api-access-jplf6\") pod \"console-operator-7866497494-xkvbf\" (UID: \"641b0ffa-0450-4198-8066-0241ab179822\") " pod="openshift-console-operator/console-operator-7866497494-xkvbf"
Jul 15 12:14:58.246190 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.246174    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f428cec4-6a61-47e3-b3bc-0ebed3a86af4-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-pgjww\" (UID: \"f428cec4-6a61-47e3-b3bc-0ebed3a86af4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pgjww"
Jul 15 12:14:58.247693 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.247678    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f428cec4-6a61-47e3-b3bc-0ebed3a86af4-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-pgjww\" (UID: \"f428cec4-6a61-47e3-b3bc-0ebed3a86af4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pgjww"
Jul 15 12:14:58.255013 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.254992    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhtwf\" (UniqueName: \"kubernetes.io/projected/f428cec4-6a61-47e3-b3bc-0ebed3a86af4-kube-api-access-vhtwf\") pod \"kube-storage-version-migrator-operator-799cb7f958-pgjww\" (UID: \"f428cec4-6a61-47e3-b3bc-0ebed3a86af4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pgjww"
Jul 15 12:14:58.346479 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.346397    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/72392327-8bf2-4751-a503-370287b57cbb-serving-cert\") pod \"insights-operator-68d9dd94cf-vl5tg\" (UID: \"72392327-8bf2-4751-a503-370287b57cbb\") " pod="openshift-insights/insights-operator-68d9dd94cf-vl5tg"
Jul 15 12:14:58.346479 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.346440    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/641b0ffa-0450-4198-8066-0241ab179822-serving-cert\") pod \"console-operator-7866497494-xkvbf\" (UID: \"641b0ffa-0450-4198-8066-0241ab179822\") " pod="openshift-console-operator/console-operator-7866497494-xkvbf"
Jul 15 12:14:58.346479 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.346473    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsjlm\" (UniqueName: \"kubernetes.io/projected/72392327-8bf2-4751-a503-370287b57cbb-kube-api-access-rsjlm\") pod \"insights-operator-68d9dd94cf-vl5tg\" (UID: \"72392327-8bf2-4751-a503-370287b57cbb\") " pod="openshift-insights/insights-operator-68d9dd94cf-vl5tg"
Jul 15 12:14:58.346707 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.346507    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8l9wt\" (UniqueName: \"kubernetes.io/projected/2680af55-84b9-40bf-a06e-de77387a3e33-kube-api-access-8l9wt\") pod \"service-ca-operator-7695fc6c8c-nb955\" (UID: \"2680af55-84b9-40bf-a06e-de77387a3e33\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nb955"
Jul 15 12:14:58.346707 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.346525    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2680af55-84b9-40bf-a06e-de77387a3e33-config\") pod \"service-ca-operator-7695fc6c8c-nb955\" (UID: \"2680af55-84b9-40bf-a06e-de77387a3e33\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nb955"
Jul 15 12:14:58.346707 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.346541    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72392327-8bf2-4751-a503-370287b57cbb-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-vl5tg\" (UID: \"72392327-8bf2-4751-a503-370287b57cbb\") " pod="openshift-insights/insights-operator-68d9dd94cf-vl5tg"
Jul 15 12:14:58.346707 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.346565    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72392327-8bf2-4751-a503-370287b57cbb-tmp\") pod \"insights-operator-68d9dd94cf-vl5tg\" (UID: \"72392327-8bf2-4751-a503-370287b57cbb\") " pod="openshift-insights/insights-operator-68d9dd94cf-vl5tg"
Jul 15 12:14:58.346707 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.346591    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/641b0ffa-0450-4198-8066-0241ab179822-config\") pod \"console-operator-7866497494-xkvbf\" (UID: \"641b0ffa-0450-4198-8066-0241ab179822\") " pod="openshift-console-operator/console-operator-7866497494-xkvbf"
Jul 15 12:14:58.346707 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.346614    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/641b0ffa-0450-4198-8066-0241ab179822-trusted-ca\") pod \"console-operator-7866497494-xkvbf\" (UID: \"641b0ffa-0450-4198-8066-0241ab179822\") " pod="openshift-console-operator/console-operator-7866497494-xkvbf"
Jul 15 12:14:58.346707 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.346639    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m28bj\" (UniqueName: \"kubernetes.io/projected/2696a718-be0c-4c8c-b69e-3407561ddff8-kube-api-access-m28bj\") pod \"network-check-source-869dcfcdcd-htjqx\" (UID: \"2696a718-be0c-4c8c-b69e-3407561ddff8\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-htjqx"
Jul 15 12:14:58.346707 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.346670    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/72392327-8bf2-4751-a503-370287b57cbb-snapshots\") pod \"insights-operator-68d9dd94cf-vl5tg\" (UID: \"72392327-8bf2-4751-a503-370287b57cbb\") " pod="openshift-insights/insights-operator-68d9dd94cf-vl5tg"
Jul 15 12:14:58.346707 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.346701    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72392327-8bf2-4751-a503-370287b57cbb-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-vl5tg\" (UID: \"72392327-8bf2-4751-a503-370287b57cbb\") " pod="openshift-insights/insights-operator-68d9dd94cf-vl5tg"
Jul 15 12:14:58.347143 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.346750    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2680af55-84b9-40bf-a06e-de77387a3e33-serving-cert\") pod \"service-ca-operator-7695fc6c8c-nb955\" (UID: \"2680af55-84b9-40bf-a06e-de77387a3e33\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nb955"
Jul 15 12:14:58.347143 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.346771    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jplf6\" (UniqueName: \"kubernetes.io/projected/641b0ffa-0450-4198-8066-0241ab179822-kube-api-access-jplf6\") pod \"console-operator-7866497494-xkvbf\" (UID: \"641b0ffa-0450-4198-8066-0241ab179822\") " pod="openshift-console-operator/console-operator-7866497494-xkvbf"
Jul 15 12:14:58.347272 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.347244    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72392327-8bf2-4751-a503-370287b57cbb-tmp\") pod \"insights-operator-68d9dd94cf-vl5tg\" (UID: \"72392327-8bf2-4751-a503-370287b57cbb\") " pod="openshift-insights/insights-operator-68d9dd94cf-vl5tg"
Jul 15 12:14:58.347372 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.347321    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2680af55-84b9-40bf-a06e-de77387a3e33-config\") pod \"service-ca-operator-7695fc6c8c-nb955\" (UID: \"2680af55-84b9-40bf-a06e-de77387a3e33\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nb955"
Jul 15 12:14:58.347619 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.347597    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/641b0ffa-0450-4198-8066-0241ab179822-config\") pod \"console-operator-7866497494-xkvbf\" (UID: \"641b0ffa-0450-4198-8066-0241ab179822\") " pod="openshift-console-operator/console-operator-7866497494-xkvbf"
Jul 15 12:14:58.347731 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.347712    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/72392327-8bf2-4751-a503-370287b57cbb-snapshots\") pod \"insights-operator-68d9dd94cf-vl5tg\" (UID: \"72392327-8bf2-4751-a503-370287b57cbb\") " pod="openshift-insights/insights-operator-68d9dd94cf-vl5tg"
Jul 15 12:14:58.347789 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.347722    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/641b0ffa-0450-4198-8066-0241ab179822-trusted-ca\") pod \"console-operator-7866497494-xkvbf\" (UID: \"641b0ffa-0450-4198-8066-0241ab179822\") " pod="openshift-console-operator/console-operator-7866497494-xkvbf"
Jul 15 12:14:58.347789 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.347743    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72392327-8bf2-4751-a503-370287b57cbb-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-vl5tg\" (UID: \"72392327-8bf2-4751-a503-370287b57cbb\") " pod="openshift-insights/insights-operator-68d9dd94cf-vl5tg"
Jul 15 12:14:58.347887 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.347815    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72392327-8bf2-4751-a503-370287b57cbb-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-vl5tg\" (UID: \"72392327-8bf2-4751-a503-370287b57cbb\") " pod="openshift-insights/insights-operator-68d9dd94cf-vl5tg"
Jul 15 12:14:58.349029 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.349009    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/72392327-8bf2-4751-a503-370287b57cbb-serving-cert\") pod \"insights-operator-68d9dd94cf-vl5tg\" (UID: \"72392327-8bf2-4751-a503-370287b57cbb\") " pod="openshift-insights/insights-operator-68d9dd94cf-vl5tg"
Jul 15 12:14:58.349306 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.349273    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2680af55-84b9-40bf-a06e-de77387a3e33-serving-cert\") pod \"service-ca-operator-7695fc6c8c-nb955\" (UID: \"2680af55-84b9-40bf-a06e-de77387a3e33\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nb955"
Jul 15 12:14:58.349813 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.349798    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/641b0ffa-0450-4198-8066-0241ab179822-serving-cert\") pod \"console-operator-7866497494-xkvbf\" (UID: \"641b0ffa-0450-4198-8066-0241ab179822\") " pod="openshift-console-operator/console-operator-7866497494-xkvbf"
Jul 15 12:14:58.355522 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.355481    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsjlm\" (UniqueName: \"kubernetes.io/projected/72392327-8bf2-4751-a503-370287b57cbb-kube-api-access-rsjlm\") pod \"insights-operator-68d9dd94cf-vl5tg\" (UID: \"72392327-8bf2-4751-a503-370287b57cbb\") " pod="openshift-insights/insights-operator-68d9dd94cf-vl5tg"
Jul 15 12:14:58.355522 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.355480    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8l9wt\" (UniqueName: \"kubernetes.io/projected/2680af55-84b9-40bf-a06e-de77387a3e33-kube-api-access-8l9wt\") pod \"service-ca-operator-7695fc6c8c-nb955\" (UID: \"2680af55-84b9-40bf-a06e-de77387a3e33\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nb955"
Jul 15 12:14:58.355823 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.355803    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m28bj\" (UniqueName: \"kubernetes.io/projected/2696a718-be0c-4c8c-b69e-3407561ddff8-kube-api-access-m28bj\") pod \"network-check-source-869dcfcdcd-htjqx\" (UID: \"2696a718-be0c-4c8c-b69e-3407561ddff8\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-htjqx"
Jul 15 12:14:58.355982 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.355960    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jplf6\" (UniqueName: \"kubernetes.io/projected/641b0ffa-0450-4198-8066-0241ab179822-kube-api-access-jplf6\") pod \"console-operator-7866497494-xkvbf\" (UID: \"641b0ffa-0450-4198-8066-0241ab179822\") " pod="openshift-console-operator/console-operator-7866497494-xkvbf"
Jul 15 12:14:58.386659 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.386638    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pgjww"
Jul 15 12:14:58.471521 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.471495    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-htjqx"
Jul 15 12:14:58.480476 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.480447    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nb955"
Jul 15 12:14:58.487401 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.487376    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-vl5tg"
Jul 15 12:14:58.492264 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.492238    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-xkvbf"
Jul 15 12:14:58.508172 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.508142    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pgjww"]
Jul 15 12:14:58.511173 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:14:58.511140    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf428cec4_6a61_47e3_b3bc_0ebed3a86af4.slice/crio-1f806d3419d89f80ff6b84c2677691e153895873dc513e0f0c8bb462e162620f WatchSource:0}: Error finding container 1f806d3419d89f80ff6b84c2677691e153895873dc513e0f0c8bb462e162620f: Status 404 returned error can't find the container with id 1f806d3419d89f80ff6b84c2677691e153895873dc513e0f0c8bb462e162620f
Jul 15 12:14:58.617097 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.617071    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-htjqx"]
Jul 15 12:14:58.619225 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:14:58.619193    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2696a718_be0c_4c8c_b69e_3407561ddff8.slice/crio-cd3654f3673904970fb2186ab0a6d837f6a42a441e9b6c37f445787e70799120 WatchSource:0}: Error finding container cd3654f3673904970fb2186ab0a6d837f6a42a441e9b6c37f445787e70799120: Status 404 returned error can't find the container with id cd3654f3673904970fb2186ab0a6d837f6a42a441e9b6c37f445787e70799120
Jul 15 12:14:58.631088 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.631058    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nb955"]
Jul 15 12:14:58.634119 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:14:58.634093    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2680af55_84b9_40bf_a06e_de77387a3e33.slice/crio-333b160f301ecf44696d77cbc874fbd2cf2c7e8b3dabb338a82ffcb60646833b WatchSource:0}: Error finding container 333b160f301ecf44696d77cbc874fbd2cf2c7e8b3dabb338a82ffcb60646833b: Status 404 returned error can't find the container with id 333b160f301ecf44696d77cbc874fbd2cf2c7e8b3dabb338a82ffcb60646833b
Jul 15 12:14:58.649886 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.649861    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-vl5tg"]
Jul 15 12:14:58.653819 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:14:58.653797    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72392327_8bf2_4751_a503_370287b57cbb.slice/crio-57f945d5b71b4ee402f5e7c2f3576459f3b0095b174b04e89126a98d0f04688f WatchSource:0}: Error finding container 57f945d5b71b4ee402f5e7c2f3576459f3b0095b174b04e89126a98d0f04688f: Status 404 returned error can't find the container with id 57f945d5b71b4ee402f5e7c2f3576459f3b0095b174b04e89126a98d0f04688f
Jul 15 12:14:58.666045 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:58.666022    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-xkvbf"]
Jul 15 12:14:58.670153 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:14:58.670131    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod641b0ffa_0450_4198_8066_0241ab179822.slice/crio-3295da7d3960bd1e853d19a4bd682d7ee3bddede8c475cdb47c7f9e5e2fe6aaa WatchSource:0}: Error finding container 3295da7d3960bd1e853d19a4bd682d7ee3bddede8c475cdb47c7f9e5e2fe6aaa: Status 404 returned error can't find the container with id 3295da7d3960bd1e853d19a4bd682d7ee3bddede8c475cdb47c7f9e5e2fe6aaa
Jul 15 12:14:59.116908 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:59.116872    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-vl5tg" event={"ID":"72392327-8bf2-4751-a503-370287b57cbb","Type":"ContainerStarted","Data":"57f945d5b71b4ee402f5e7c2f3576459f3b0095b174b04e89126a98d0f04688f"}
Jul 15 12:14:59.117956 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:59.117928    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nb955" event={"ID":"2680af55-84b9-40bf-a06e-de77387a3e33","Type":"ContainerStarted","Data":"333b160f301ecf44696d77cbc874fbd2cf2c7e8b3dabb338a82ffcb60646833b"}
Jul 15 12:14:59.119361 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:59.119326    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-htjqx" event={"ID":"2696a718-be0c-4c8c-b69e-3407561ddff8","Type":"ContainerStarted","Data":"11f2ac6a2c377f47b2d072cbb6518c448df55ca04f130934692389da9d30e5e2"}
Jul 15 12:14:59.119447 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:59.119379    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-htjqx" event={"ID":"2696a718-be0c-4c8c-b69e-3407561ddff8","Type":"ContainerStarted","Data":"cd3654f3673904970fb2186ab0a6d837f6a42a441e9b6c37f445787e70799120"}
Jul 15 12:14:59.120456 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:59.120436    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pgjww" event={"ID":"f428cec4-6a61-47e3-b3bc-0ebed3a86af4","Type":"ContainerStarted","Data":"1f806d3419d89f80ff6b84c2677691e153895873dc513e0f0c8bb462e162620f"}
Jul 15 12:14:59.121445 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:59.121425    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-xkvbf" event={"ID":"641b0ffa-0450-4198-8066-0241ab179822","Type":"ContainerStarted","Data":"3295da7d3960bd1e853d19a4bd682d7ee3bddede8c475cdb47c7f9e5e2fe6aaa"}
Jul 15 12:14:59.135533 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:14:59.135484    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-htjqx" podStartSLOduration=1.135471069 podStartE2EDuration="1.135471069s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:14:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:14:59.134407112 +0000 UTC m=+246.248800834" watchObservedRunningTime="2026-07-15 12:14:59.135471069 +0000 UTC m=+246.249864800"
Jul 15 12:15:03.134392 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:03.134348    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pgjww" event={"ID":"f428cec4-6a61-47e3-b3bc-0ebed3a86af4","Type":"ContainerStarted","Data":"4617a8b666c64a01b6a027a4ce2409b4b60317544a01f9b5d94926bd1a50847e"}
Jul 15 12:15:03.136039 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:03.136015    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xkvbf_641b0ffa-0450-4198-8066-0241ab179822/console-operator/0.log"
Jul 15 12:15:03.136180 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:03.136059    2560 generic.go:356] "Generic (PLEG): container finished" podID="641b0ffa-0450-4198-8066-0241ab179822" containerID="f3416ed35c4841933bd8cad3fe509117a3d199ff982b8ba0ec54d6bb41f2e9b6" exitCode=255
Jul 15 12:15:03.136180 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:03.136145    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-xkvbf" event={"ID":"641b0ffa-0450-4198-8066-0241ab179822","Type":"ContainerDied","Data":"f3416ed35c4841933bd8cad3fe509117a3d199ff982b8ba0ec54d6bb41f2e9b6"}
Jul 15 12:15:03.136370 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:03.136352    2560 scope.go:117] "RemoveContainer" containerID="f3416ed35c4841933bd8cad3fe509117a3d199ff982b8ba0ec54d6bb41f2e9b6"
Jul 15 12:15:03.137753 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:03.137730    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-vl5tg" event={"ID":"72392327-8bf2-4751-a503-370287b57cbb","Type":"ContainerStarted","Data":"ebfda290a0481dca9a4d54791d72211a14f1aae2542aa7c43157b9d82b945766"}
Jul 15 12:15:03.139333 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:03.139311    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nb955" event={"ID":"2680af55-84b9-40bf-a06e-de77387a3e33","Type":"ContainerStarted","Data":"ef841b59fdc1bc28e35a3b656376923a85aa00154952aa47ddbdf0a6978f2c64"}
Jul 15 12:15:03.151114 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:03.151071    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pgjww" podStartSLOduration=1.356693526 podStartE2EDuration="5.151060827s" totalImagesPullingTime="3.794367301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:14:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:15:03.149725587 +0000 UTC m=+250.264119320" watchObservedRunningTime="2026-07-15 12:15:03.151060827 +0000 UTC m=+250.265454558"
Jul 15 12:15:03.208553 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:03.207729    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nb955" podStartSLOduration=1.530424953 podStartE2EDuration="5.207709118s" totalImagesPullingTime="3.677284165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:14:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:15:03.181744485 +0000 UTC m=+250.296138218" watchObservedRunningTime="2026-07-15 12:15:03.207709118 +0000 UTC m=+250.322102854"
Jul 15 12:15:03.209472 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:03.209430    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-vl5tg" podStartSLOduration=1.550994623 podStartE2EDuration="5.209411843s" totalImagesPullingTime="3.65841722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:14:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:15:03.207928312 +0000 UTC m=+250.322322045" watchObservedRunningTime="2026-07-15 12:15:03.209411843 +0000 UTC m=+250.323805577"
Jul 15 12:15:03.405425 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:03.401110    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5knhr"]
Jul 15 12:15:03.405606 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:03.405592    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5knhr"
Jul 15 12:15:03.408830 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:03.408374    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 15 12:15:03.408830 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:03.408487    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jn585\""
Jul 15 12:15:03.408830 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:03.408689    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 15 12:15:03.420389 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:03.420315    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5knhr"]
Jul 15 12:15:03.499885 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:03.499852    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e2048642-6a69-4294-b0e4-cc80432a8625-crio-socket\") pod \"insights-runtime-extractor-5knhr\" (UID: \"e2048642-6a69-4294-b0e4-cc80432a8625\") " pod="openshift-insights/insights-runtime-extractor-5knhr"
Jul 15 12:15:03.500083 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:03.499900    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e2048642-6a69-4294-b0e4-cc80432a8625-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5knhr\" (UID: \"e2048642-6a69-4294-b0e4-cc80432a8625\") " pod="openshift-insights/insights-runtime-extractor-5knhr"
Jul 15 12:15:03.500083 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:03.499952    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzq6v\" (UniqueName: \"kubernetes.io/projected/e2048642-6a69-4294-b0e4-cc80432a8625-kube-api-access-tzq6v\") pod \"insights-runtime-extractor-5knhr\" (UID: \"e2048642-6a69-4294-b0e4-cc80432a8625\") " pod="openshift-insights/insights-runtime-extractor-5knhr"
Jul 15 12:15:03.500083 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:03.499987    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e2048642-6a69-4294-b0e4-cc80432a8625-data-volume\") pod \"insights-runtime-extractor-5knhr\" (UID: \"e2048642-6a69-4294-b0e4-cc80432a8625\") " pod="openshift-insights/insights-runtime-extractor-5knhr"
Jul 15 12:15:03.500083 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:03.500032    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2048642-6a69-4294-b0e4-cc80432a8625-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5knhr\" (UID: \"e2048642-6a69-4294-b0e4-cc80432a8625\") " pod="openshift-insights/insights-runtime-extractor-5knhr"
Jul 15 12:15:03.601201 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:03.601164    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e2048642-6a69-4294-b0e4-cc80432a8625-crio-socket\") pod \"insights-runtime-extractor-5knhr\" (UID: \"e2048642-6a69-4294-b0e4-cc80432a8625\") " pod="openshift-insights/insights-runtime-extractor-5knhr"
Jul 15 12:15:03.601379 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:03.601209    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e2048642-6a69-4294-b0e4-cc80432a8625-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5knhr\" (UID: \"e2048642-6a69-4294-b0e4-cc80432a8625\") " pod="openshift-insights/insights-runtime-extractor-5knhr"
Jul 15 12:15:03.601379 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:03.601236    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzq6v\" (UniqueName: \"kubernetes.io/projected/e2048642-6a69-4294-b0e4-cc80432a8625-kube-api-access-tzq6v\") pod \"insights-runtime-extractor-5knhr\" (UID: \"e2048642-6a69-4294-b0e4-cc80432a8625\") " pod="openshift-insights/insights-runtime-extractor-5knhr"
Jul 15 12:15:03.601379 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:03.601261    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e2048642-6a69-4294-b0e4-cc80432a8625-data-volume\") pod \"insights-runtime-extractor-5knhr\" (UID: \"e2048642-6a69-4294-b0e4-cc80432a8625\") " pod="openshift-insights/insights-runtime-extractor-5knhr"
Jul 15 12:15:03.601379 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:15:03.601318    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 12:15:03.601588 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:15:03.601389    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e2048642-6a69-4294-b0e4-cc80432a8625-kube-rbac-proxy-cm podName:e2048642-6a69-4294-b0e4-cc80432a8625 nodeName:}" failed. No retries permitted until 2026-07-15 12:15:04.101371482 +0000 UTC m=+251.215765209 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e2048642-6a69-4294-b0e4-cc80432a8625-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5knhr" (UID: "e2048642-6a69-4294-b0e4-cc80432a8625") : configmap "kube-rbac-proxy" not found
Jul 15 12:15:03.601588 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:03.601389    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e2048642-6a69-4294-b0e4-cc80432a8625-crio-socket\") pod \"insights-runtime-extractor-5knhr\" (UID: \"e2048642-6a69-4294-b0e4-cc80432a8625\") " pod="openshift-insights/insights-runtime-extractor-5knhr"
Jul 15 12:15:03.601588 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:03.601409    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2048642-6a69-4294-b0e4-cc80432a8625-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5knhr\" (UID: \"e2048642-6a69-4294-b0e4-cc80432a8625\") " pod="openshift-insights/insights-runtime-extractor-5knhr"
Jul 15 12:15:03.601588 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:15:03.601524    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 12:15:03.601588 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:15:03.601563    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2048642-6a69-4294-b0e4-cc80432a8625-insights-runtime-extractor-tls podName:e2048642-6a69-4294-b0e4-cc80432a8625 nodeName:}" failed. No retries permitted until 2026-07-15 12:15:04.101549871 +0000 UTC m=+251.215943581 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e2048642-6a69-4294-b0e4-cc80432a8625-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5knhr" (UID: "e2048642-6a69-4294-b0e4-cc80432a8625") : secret "insights-runtime-extractor-tls" not found
Jul 15 12:15:03.601776 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:03.601605    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e2048642-6a69-4294-b0e4-cc80432a8625-data-volume\") pod \"insights-runtime-extractor-5knhr\" (UID: \"e2048642-6a69-4294-b0e4-cc80432a8625\") " pod="openshift-insights/insights-runtime-extractor-5knhr"
Jul 15 12:15:03.611544 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:03.611517    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzq6v\" (UniqueName: \"kubernetes.io/projected/e2048642-6a69-4294-b0e4-cc80432a8625-kube-api-access-tzq6v\") pod \"insights-runtime-extractor-5knhr\" (UID: \"e2048642-6a69-4294-b0e4-cc80432a8625\") " pod="openshift-insights/insights-runtime-extractor-5knhr"
Jul 15 12:15:04.104814 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:04.104775    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2048642-6a69-4294-b0e4-cc80432a8625-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5knhr\" (UID: \"e2048642-6a69-4294-b0e4-cc80432a8625\") " pod="openshift-insights/insights-runtime-extractor-5knhr"
Jul 15 12:15:04.104993 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:04.104893    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e2048642-6a69-4294-b0e4-cc80432a8625-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5knhr\" (UID: \"e2048642-6a69-4294-b0e4-cc80432a8625\") " pod="openshift-insights/insights-runtime-extractor-5knhr"
Jul 15 12:15:04.104993 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:15:04.104953    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 12:15:04.104993 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:15:04.104973    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 12:15:04.105150 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:15:04.105040    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2048642-6a69-4294-b0e4-cc80432a8625-insights-runtime-extractor-tls podName:e2048642-6a69-4294-b0e4-cc80432a8625 nodeName:}" failed. No retries permitted until 2026-07-15 12:15:05.105017197 +0000 UTC m=+252.219410910 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e2048642-6a69-4294-b0e4-cc80432a8625-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5knhr" (UID: "e2048642-6a69-4294-b0e4-cc80432a8625") : secret "insights-runtime-extractor-tls" not found
Jul 15 12:15:04.105150 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:15:04.105061    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e2048642-6a69-4294-b0e4-cc80432a8625-kube-rbac-proxy-cm podName:e2048642-6a69-4294-b0e4-cc80432a8625 nodeName:}" failed. No retries permitted until 2026-07-15 12:15:05.105051229 +0000 UTC m=+252.219444960 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e2048642-6a69-4294-b0e4-cc80432a8625-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5knhr" (UID: "e2048642-6a69-4294-b0e4-cc80432a8625") : configmap "kube-rbac-proxy" not found
Jul 15 12:15:04.144781 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:04.144755    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xkvbf_641b0ffa-0450-4198-8066-0241ab179822/console-operator/1.log"
Jul 15 12:15:04.145231 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:04.145215    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xkvbf_641b0ffa-0450-4198-8066-0241ab179822/console-operator/0.log"
Jul 15 12:15:04.145283 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:04.145251    2560 generic.go:356] "Generic (PLEG): container finished" podID="641b0ffa-0450-4198-8066-0241ab179822" containerID="8d05c38966e09b97a6c360cffabfade912d7aa28b043b4610ebfe91568db84d9" exitCode=255
Jul 15 12:15:04.145375 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:04.145353    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-xkvbf" event={"ID":"641b0ffa-0450-4198-8066-0241ab179822","Type":"ContainerDied","Data":"8d05c38966e09b97a6c360cffabfade912d7aa28b043b4610ebfe91568db84d9"}
Jul 15 12:15:04.145422 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:04.145405    2560 scope.go:117] "RemoveContainer" containerID="f3416ed35c4841933bd8cad3fe509117a3d199ff982b8ba0ec54d6bb41f2e9b6"
Jul 15 12:15:04.145664 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:04.145642    2560 scope.go:117] "RemoveContainer" containerID="8d05c38966e09b97a6c360cffabfade912d7aa28b043b4610ebfe91568db84d9"
Jul 15 12:15:04.145893 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:15:04.145866    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-xkvbf_openshift-console-operator(641b0ffa-0450-4198-8066-0241ab179822)\"" pod="openshift-console-operator/console-operator-7866497494-xkvbf" podUID="641b0ffa-0450-4198-8066-0241ab179822"
Jul 15 12:15:05.114165 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:05.114136    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e2048642-6a69-4294-b0e4-cc80432a8625-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5knhr\" (UID: \"e2048642-6a69-4294-b0e4-cc80432a8625\") " pod="openshift-insights/insights-runtime-extractor-5knhr"
Jul 15 12:15:05.114340 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:05.114189    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2048642-6a69-4294-b0e4-cc80432a8625-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5knhr\" (UID: \"e2048642-6a69-4294-b0e4-cc80432a8625\") " pod="openshift-insights/insights-runtime-extractor-5knhr"
Jul 15 12:15:05.114340 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:15:05.114256    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 12:15:05.114340 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:15:05.114321    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 12:15:05.114340 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:15:05.114336    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e2048642-6a69-4294-b0e4-cc80432a8625-kube-rbac-proxy-cm podName:e2048642-6a69-4294-b0e4-cc80432a8625 nodeName:}" failed. No retries permitted until 2026-07-15 12:15:07.114319411 +0000 UTC m=+254.228713121 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e2048642-6a69-4294-b0e4-cc80432a8625-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5knhr" (UID: "e2048642-6a69-4294-b0e4-cc80432a8625") : configmap "kube-rbac-proxy" not found
Jul 15 12:15:05.114493 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:15:05.114367    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2048642-6a69-4294-b0e4-cc80432a8625-insights-runtime-extractor-tls podName:e2048642-6a69-4294-b0e4-cc80432a8625 nodeName:}" failed. No retries permitted until 2026-07-15 12:15:07.114356509 +0000 UTC m=+254.228750219 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e2048642-6a69-4294-b0e4-cc80432a8625-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5knhr" (UID: "e2048642-6a69-4294-b0e4-cc80432a8625") : secret "insights-runtime-extractor-tls" not found
Jul 15 12:15:05.149055 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:05.149032    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xkvbf_641b0ffa-0450-4198-8066-0241ab179822/console-operator/1.log"
Jul 15 12:15:05.149386 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:05.149359    2560 scope.go:117] "RemoveContainer" containerID="8d05c38966e09b97a6c360cffabfade912d7aa28b043b4610ebfe91568db84d9"
Jul 15 12:15:05.149522 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:15:05.149504    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-xkvbf_openshift-console-operator(641b0ffa-0450-4198-8066-0241ab179822)\"" pod="openshift-console-operator/console-operator-7866497494-xkvbf" podUID="641b0ffa-0450-4198-8066-0241ab179822"
Jul 15 12:15:05.215366 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:05.215330    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19938f5e-4b2c-45f8-9077-4fb510687262-metrics-certs\") pod \"network-metrics-daemon-spl8b\" (UID: \"19938f5e-4b2c-45f8-9077-4fb510687262\") " pod="openshift-multus/network-metrics-daemon-spl8b"
Jul 15 12:15:05.215552 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:15:05.215437    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 15 12:15:05.215552 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:15:05.215526    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19938f5e-4b2c-45f8-9077-4fb510687262-metrics-certs podName:19938f5e-4b2c-45f8-9077-4fb510687262 nodeName:}" failed. No retries permitted until 2026-07-15 12:17:07.215505813 +0000 UTC m=+374.329899536 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19938f5e-4b2c-45f8-9077-4fb510687262-metrics-certs") pod "network-metrics-daemon-spl8b" (UID: "19938f5e-4b2c-45f8-9077-4fb510687262") : secret "metrics-daemon-secret" not found
Jul 15 12:15:05.435395 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:05.435322    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rggjh"]
Jul 15 12:15:05.438026 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:05.438003    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rggjh"
Jul 15 12:15:05.440947 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:05.440920    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 15 12:15:05.441072 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:05.441015    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 15 12:15:05.441318 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:05.441286    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-cqmks\""
Jul 15 12:15:05.450994 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:05.450973    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rggjh"]
Jul 15 12:15:05.516868 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:05.516838    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nx2dx\" (UniqueName: \"kubernetes.io/projected/59863960-64df-4b84-bd4f-40d3be3982a6-kube-api-access-nx2dx\") pod \"migrator-7f59b54f6c-rggjh\" (UID: \"59863960-64df-4b84-bd4f-40d3be3982a6\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rggjh"
Jul 15 12:15:05.584810 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:05.584786    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zcdxd_fe1a8d7e-70d9-4b84-8ccd-64e1fc8f803b/dns-node-resolver/0.log"
Jul 15 12:15:05.618244 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:05.618215    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nx2dx\" (UniqueName: \"kubernetes.io/projected/59863960-64df-4b84-bd4f-40d3be3982a6-kube-api-access-nx2dx\") pod \"migrator-7f59b54f6c-rggjh\" (UID: \"59863960-64df-4b84-bd4f-40d3be3982a6\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rggjh"
Jul 15 12:15:05.625664 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:05.625640    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nx2dx\" (UniqueName: \"kubernetes.io/projected/59863960-64df-4b84-bd4f-40d3be3982a6-kube-api-access-nx2dx\") pod \"migrator-7f59b54f6c-rggjh\" (UID: \"59863960-64df-4b84-bd4f-40d3be3982a6\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rggjh"
Jul 15 12:15:05.751442 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:05.751413    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rggjh"
Jul 15 12:15:05.871570 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:05.871531    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rggjh"]
Jul 15 12:15:05.873673 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:15:05.873640    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59863960_64df_4b84_bd4f_40d3be3982a6.slice/crio-45818255e02b7017d941e6868d725d49822eb2a0ebeda123b33f86d90f1ab315 WatchSource:0}: Error finding container 45818255e02b7017d941e6868d725d49822eb2a0ebeda123b33f86d90f1ab315: Status 404 returned error can't find the container with id 45818255e02b7017d941e6868d725d49822eb2a0ebeda123b33f86d90f1ab315
Jul 15 12:15:06.153415 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:06.153336    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rggjh" event={"ID":"59863960-64df-4b84-bd4f-40d3be3982a6","Type":"ContainerStarted","Data":"45818255e02b7017d941e6868d725d49822eb2a0ebeda123b33f86d90f1ab315"}
Jul 15 12:15:06.185259 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:06.185234    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4tr78_aab771cb-07af-462f-ac09-166b75eaab99/node-ca/0.log"
Jul 15 12:15:06.984704 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:06.984674    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7ktfc_636b4e9e-64bd-41fb-a053-18d469b82593/serve-healthcheck-canary/0.log"
Jul 15 12:15:07.129818 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:07.129784    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e2048642-6a69-4294-b0e4-cc80432a8625-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5knhr\" (UID: \"e2048642-6a69-4294-b0e4-cc80432a8625\") " pod="openshift-insights/insights-runtime-extractor-5knhr"
Jul 15 12:15:07.129991 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:15:07.129896    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 12:15:07.129991 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:15:07.129950    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e2048642-6a69-4294-b0e4-cc80432a8625-kube-rbac-proxy-cm podName:e2048642-6a69-4294-b0e4-cc80432a8625 nodeName:}" failed. No retries permitted until 2026-07-15 12:15:11.129936217 +0000 UTC m=+258.244329927 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e2048642-6a69-4294-b0e4-cc80432a8625-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5knhr" (UID: "e2048642-6a69-4294-b0e4-cc80432a8625") : configmap "kube-rbac-proxy" not found
Jul 15 12:15:07.130143 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:07.129997    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2048642-6a69-4294-b0e4-cc80432a8625-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5knhr\" (UID: \"e2048642-6a69-4294-b0e4-cc80432a8625\") " pod="openshift-insights/insights-runtime-extractor-5knhr"
Jul 15 12:15:07.130143 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:15:07.130113    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 12:15:07.130240 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:15:07.130193    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2048642-6a69-4294-b0e4-cc80432a8625-insights-runtime-extractor-tls podName:e2048642-6a69-4294-b0e4-cc80432a8625 nodeName:}" failed. No retries permitted until 2026-07-15 12:15:11.130163964 +0000 UTC m=+258.244557675 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e2048642-6a69-4294-b0e4-cc80432a8625-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5knhr" (UID: "e2048642-6a69-4294-b0e4-cc80432a8625") : secret "insights-runtime-extractor-tls" not found
Jul 15 12:15:08.160793 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:08.160762    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rggjh" event={"ID":"59863960-64df-4b84-bd4f-40d3be3982a6","Type":"ContainerStarted","Data":"ecf63201786985321ea818c8ad550c19c23abc6eff6defb070aa0544085e81bd"}
Jul 15 12:15:08.161136 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:08.160811    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rggjh" event={"ID":"59863960-64df-4b84-bd4f-40d3be3982a6","Type":"ContainerStarted","Data":"80e2485cf60ca0d39e2c889bdb770c838489b1b2eb3edd892763c15b41523941"}
Jul 15 12:15:08.178143 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:08.178102    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rggjh" podStartSLOduration=1.880200303 podStartE2EDuration="3.178087345s" totalImagesPullingTime="1.297887042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:15:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:15:08.17773737 +0000 UTC m=+255.292131104" watchObservedRunningTime="2026-07-15 12:15:08.178087345 +0000 UTC m=+255.292481076"
Jul 15 12:15:08.492792 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:08.492761    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-xkvbf"
Jul 15 12:15:08.492926 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:08.492842    2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-xkvbf"
Jul 15 12:15:08.493158 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:08.493146    2560 scope.go:117] "RemoveContainer" containerID="8d05c38966e09b97a6c360cffabfade912d7aa28b043b4610ebfe91568db84d9"
Jul 15 12:15:08.493319 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:15:08.493282    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-xkvbf_openshift-console-operator(641b0ffa-0450-4198-8066-0241ab179822)\"" pod="openshift-console-operator/console-operator-7866497494-xkvbf" podUID="641b0ffa-0450-4198-8066-0241ab179822"
Jul 15 12:15:09.163904 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:09.163877    2560 scope.go:117] "RemoveContainer" containerID="8d05c38966e09b97a6c360cffabfade912d7aa28b043b4610ebfe91568db84d9"
Jul 15 12:15:09.164273 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:15:09.164024    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-xkvbf_openshift-console-operator(641b0ffa-0450-4198-8066-0241ab179822)\"" pod="openshift-console-operator/console-operator-7866497494-xkvbf" podUID="641b0ffa-0450-4198-8066-0241ab179822"
Jul 15 12:15:11.157357 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:11.157316    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e2048642-6a69-4294-b0e4-cc80432a8625-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5knhr\" (UID: \"e2048642-6a69-4294-b0e4-cc80432a8625\") " pod="openshift-insights/insights-runtime-extractor-5knhr"
Jul 15 12:15:11.157769 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:11.157378    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2048642-6a69-4294-b0e4-cc80432a8625-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5knhr\" (UID: \"e2048642-6a69-4294-b0e4-cc80432a8625\") " pod="openshift-insights/insights-runtime-extractor-5knhr"
Jul 15 12:15:11.157769 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:15:11.157452    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 12:15:11.157769 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:15:11.157503    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 12:15:11.157769 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:15:11.157523    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e2048642-6a69-4294-b0e4-cc80432a8625-kube-rbac-proxy-cm podName:e2048642-6a69-4294-b0e4-cc80432a8625 nodeName:}" failed. No retries permitted until 2026-07-15 12:15:19.157505786 +0000 UTC m=+266.271899496 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e2048642-6a69-4294-b0e4-cc80432a8625-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5knhr" (UID: "e2048642-6a69-4294-b0e4-cc80432a8625") : configmap "kube-rbac-proxy" not found
Jul 15 12:15:11.157769 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:15:11.157552    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2048642-6a69-4294-b0e4-cc80432a8625-insights-runtime-extractor-tls podName:e2048642-6a69-4294-b0e4-cc80432a8625 nodeName:}" failed. No retries permitted until 2026-07-15 12:15:19.157540408 +0000 UTC m=+266.271934119 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e2048642-6a69-4294-b0e4-cc80432a8625-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5knhr" (UID: "e2048642-6a69-4294-b0e4-cc80432a8625") : secret "insights-runtime-extractor-tls" not found
Jul 15 12:15:19.223059 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:19.222978    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e2048642-6a69-4294-b0e4-cc80432a8625-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5knhr\" (UID: \"e2048642-6a69-4294-b0e4-cc80432a8625\") " pod="openshift-insights/insights-runtime-extractor-5knhr"
Jul 15 12:15:19.223059 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:19.223032    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2048642-6a69-4294-b0e4-cc80432a8625-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5knhr\" (UID: \"e2048642-6a69-4294-b0e4-cc80432a8625\") " pod="openshift-insights/insights-runtime-extractor-5knhr"
Jul 15 12:15:19.223491 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:15:19.223165    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 12:15:19.223491 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:15:19.223212    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2048642-6a69-4294-b0e4-cc80432a8625-insights-runtime-extractor-tls podName:e2048642-6a69-4294-b0e4-cc80432a8625 nodeName:}" failed. No retries permitted until 2026-07-15 12:15:35.223199061 +0000 UTC m=+282.337592771 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e2048642-6a69-4294-b0e4-cc80432a8625-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5knhr" (UID: "e2048642-6a69-4294-b0e4-cc80432a8625") : secret "insights-runtime-extractor-tls" not found
Jul 15 12:15:19.223564 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:19.223523    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e2048642-6a69-4294-b0e4-cc80432a8625-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5knhr\" (UID: \"e2048642-6a69-4294-b0e4-cc80432a8625\") " pod="openshift-insights/insights-runtime-extractor-5knhr"
Jul 15 12:15:21.438409 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:21.438384    2560 scope.go:117] "RemoveContainer" containerID="8d05c38966e09b97a6c360cffabfade912d7aa28b043b4610ebfe91568db84d9"
Jul 15 12:15:22.202019 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:22.201989    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xkvbf_641b0ffa-0450-4198-8066-0241ab179822/console-operator/2.log"
Jul 15 12:15:22.202435 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:22.202420    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xkvbf_641b0ffa-0450-4198-8066-0241ab179822/console-operator/1.log"
Jul 15 12:15:22.202480 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:22.202452    2560 generic.go:356] "Generic (PLEG): container finished" podID="641b0ffa-0450-4198-8066-0241ab179822" containerID="8ec41de9d90fec224ae463256e06d5d504a2332877342f355ca9537ff978a69a" exitCode=255
Jul 15 12:15:22.202545 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:22.202524    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-xkvbf" event={"ID":"641b0ffa-0450-4198-8066-0241ab179822","Type":"ContainerDied","Data":"8ec41de9d90fec224ae463256e06d5d504a2332877342f355ca9537ff978a69a"}
Jul 15 12:15:22.202619 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:22.202609    2560 scope.go:117] "RemoveContainer" containerID="8d05c38966e09b97a6c360cffabfade912d7aa28b043b4610ebfe91568db84d9"
Jul 15 12:15:22.202902 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:22.202879    2560 scope.go:117] "RemoveContainer" containerID="8ec41de9d90fec224ae463256e06d5d504a2332877342f355ca9537ff978a69a"
Jul 15 12:15:22.203058 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:15:22.203037    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-xkvbf_openshift-console-operator(641b0ffa-0450-4198-8066-0241ab179822)\"" pod="openshift-console-operator/console-operator-7866497494-xkvbf" podUID="641b0ffa-0450-4198-8066-0241ab179822"
Jul 15 12:15:23.206762 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:23.206733    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xkvbf_641b0ffa-0450-4198-8066-0241ab179822/console-operator/2.log"
Jul 15 12:15:28.493130 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:28.493079    2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-xkvbf"
Jul 15 12:15:28.493130 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:28.493146    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-xkvbf"
Jul 15 12:15:28.493732 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:28.493448    2560 scope.go:117] "RemoveContainer" containerID="8ec41de9d90fec224ae463256e06d5d504a2332877342f355ca9537ff978a69a"
Jul 15 12:15:28.493732 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:15:28.493591    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-xkvbf_openshift-console-operator(641b0ffa-0450-4198-8066-0241ab179822)\"" pod="openshift-console-operator/console-operator-7866497494-xkvbf" podUID="641b0ffa-0450-4198-8066-0241ab179822"
Jul 15 12:15:35.241766 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:35.241710    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2048642-6a69-4294-b0e4-cc80432a8625-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5knhr\" (UID: \"e2048642-6a69-4294-b0e4-cc80432a8625\") " pod="openshift-insights/insights-runtime-extractor-5knhr"
Jul 15 12:15:35.244099 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:35.244072    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2048642-6a69-4294-b0e4-cc80432a8625-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5knhr\" (UID: \"e2048642-6a69-4294-b0e4-cc80432a8625\") " pod="openshift-insights/insights-runtime-extractor-5knhr"
Jul 15 12:15:35.518993 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:35.518923    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5knhr"
Jul 15 12:15:35.640021 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:35.639992    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5knhr"]
Jul 15 12:15:35.642866 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:15:35.642837    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2048642_6a69_4294_b0e4_cc80432a8625.slice/crio-b8afa29e64e95f83a8c84be82fdb5b2c28f8ffca35ce826e28364e280559e8d5 WatchSource:0}: Error finding container b8afa29e64e95f83a8c84be82fdb5b2c28f8ffca35ce826e28364e280559e8d5: Status 404 returned error can't find the container with id b8afa29e64e95f83a8c84be82fdb5b2c28f8ffca35ce826e28364e280559e8d5
Jul 15 12:15:35.801749 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:35.801669    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-hvqgh"]
Jul 15 12:15:35.804132 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:35.804113    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-hvqgh"
Jul 15 12:15:35.806930 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:35.806898    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 15 12:15:35.807039 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:35.806906    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 15 12:15:35.807039 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:35.807005    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-tnprh\""
Jul 15 12:15:35.807039 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:35.807031    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 15 12:15:35.808169 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:35.808148    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 15 12:15:35.808270 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:35.808156    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 15 12:15:35.813542 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:35.813524    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-hvqgh"]
Jul 15 12:15:35.946286 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:35.946248    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/cbd017f6-cc49-41c7-bf54-e608baa47768-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-hvqgh\" (UID: \"cbd017f6-cc49-41c7-bf54-e608baa47768\") " pod="openshift-monitoring/prometheus-operator-64785b6675-hvqgh"
Jul 15 12:15:35.946286 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:35.946289    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cbd017f6-cc49-41c7-bf54-e608baa47768-metrics-client-ca\") pod \"prometheus-operator-64785b6675-hvqgh\" (UID: \"cbd017f6-cc49-41c7-bf54-e608baa47768\") " pod="openshift-monitoring/prometheus-operator-64785b6675-hvqgh"
Jul 15 12:15:35.946499 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:35.946373    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cbd017f6-cc49-41c7-bf54-e608baa47768-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-hvqgh\" (UID: \"cbd017f6-cc49-41c7-bf54-e608baa47768\") " pod="openshift-monitoring/prometheus-operator-64785b6675-hvqgh"
Jul 15 12:15:35.946499 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:35.946414    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsf68\" (UniqueName: \"kubernetes.io/projected/cbd017f6-cc49-41c7-bf54-e608baa47768-kube-api-access-zsf68\") pod \"prometheus-operator-64785b6675-hvqgh\" (UID: \"cbd017f6-cc49-41c7-bf54-e608baa47768\") " pod="openshift-monitoring/prometheus-operator-64785b6675-hvqgh"
Jul 15 12:15:36.047078 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:36.047050    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cbd017f6-cc49-41c7-bf54-e608baa47768-metrics-client-ca\") pod \"prometheus-operator-64785b6675-hvqgh\" (UID: \"cbd017f6-cc49-41c7-bf54-e608baa47768\") " pod="openshift-monitoring/prometheus-operator-64785b6675-hvqgh"
Jul 15 12:15:36.047186 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:36.047083    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cbd017f6-cc49-41c7-bf54-e608baa47768-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-hvqgh\" (UID: \"cbd017f6-cc49-41c7-bf54-e608baa47768\") " pod="openshift-monitoring/prometheus-operator-64785b6675-hvqgh"
Jul 15 12:15:36.047186 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:36.047102    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsf68\" (UniqueName: \"kubernetes.io/projected/cbd017f6-cc49-41c7-bf54-e608baa47768-kube-api-access-zsf68\") pod \"prometheus-operator-64785b6675-hvqgh\" (UID: \"cbd017f6-cc49-41c7-bf54-e608baa47768\") " pod="openshift-monitoring/prometheus-operator-64785b6675-hvqgh"
Jul 15 12:15:36.047321 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:36.047215    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/cbd017f6-cc49-41c7-bf54-e608baa47768-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-hvqgh\" (UID: \"cbd017f6-cc49-41c7-bf54-e608baa47768\") " pod="openshift-monitoring/prometheus-operator-64785b6675-hvqgh"
Jul 15 12:15:36.047321 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:15:36.047311    2560 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 15 12:15:36.047394 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:15:36.047372    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbd017f6-cc49-41c7-bf54-e608baa47768-prometheus-operator-tls podName:cbd017f6-cc49-41c7-bf54-e608baa47768 nodeName:}" failed. No retries permitted until 2026-07-15 12:15:36.547353673 +0000 UTC m=+283.661747384 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/cbd017f6-cc49-41c7-bf54-e608baa47768-prometheus-operator-tls") pod "prometheus-operator-64785b6675-hvqgh" (UID: "cbd017f6-cc49-41c7-bf54-e608baa47768") : secret "prometheus-operator-tls" not found
Jul 15 12:15:36.047714 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:36.047693    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cbd017f6-cc49-41c7-bf54-e608baa47768-metrics-client-ca\") pod \"prometheus-operator-64785b6675-hvqgh\" (UID: \"cbd017f6-cc49-41c7-bf54-e608baa47768\") " pod="openshift-monitoring/prometheus-operator-64785b6675-hvqgh"
Jul 15 12:15:36.049416 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:36.049399    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cbd017f6-cc49-41c7-bf54-e608baa47768-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-hvqgh\" (UID: \"cbd017f6-cc49-41c7-bf54-e608baa47768\") " pod="openshift-monitoring/prometheus-operator-64785b6675-hvqgh"
Jul 15 12:15:36.056212 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:36.056162    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsf68\" (UniqueName: \"kubernetes.io/projected/cbd017f6-cc49-41c7-bf54-e608baa47768-kube-api-access-zsf68\") pod \"prometheus-operator-64785b6675-hvqgh\" (UID: \"cbd017f6-cc49-41c7-bf54-e608baa47768\") " pod="openshift-monitoring/prometheus-operator-64785b6675-hvqgh"
Jul 15 12:15:36.249793 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:36.249764    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5knhr" event={"ID":"e2048642-6a69-4294-b0e4-cc80432a8625","Type":"ContainerStarted","Data":"b8afa29e64e95f83a8c84be82fdb5b2c28f8ffca35ce826e28364e280559e8d5"}
Jul 15 12:15:36.552111 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:36.552071    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/cbd017f6-cc49-41c7-bf54-e608baa47768-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-hvqgh\" (UID: \"cbd017f6-cc49-41c7-bf54-e608baa47768\") " pod="openshift-monitoring/prometheus-operator-64785b6675-hvqgh"
Jul 15 12:15:36.555349 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:36.555319    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/cbd017f6-cc49-41c7-bf54-e608baa47768-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-hvqgh\" (UID: \"cbd017f6-cc49-41c7-bf54-e608baa47768\") " pod="openshift-monitoring/prometheus-operator-64785b6675-hvqgh"
Jul 15 12:15:36.713655 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:36.713589    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-hvqgh"
Jul 15 12:15:36.857321 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:36.857284    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-hvqgh"]
Jul 15 12:15:36.859260 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:15:36.859226    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbd017f6_cc49_41c7_bf54_e608baa47768.slice/crio-2e3abd9dffd571fce3ac8f9e9cfc4e7783c8c9716c97988b0dff849d3d69f49d WatchSource:0}: Error finding container 2e3abd9dffd571fce3ac8f9e9cfc4e7783c8c9716c97988b0dff849d3d69f49d: Status 404 returned error can't find the container with id 2e3abd9dffd571fce3ac8f9e9cfc4e7783c8c9716c97988b0dff849d3d69f49d
Jul 15 12:15:36.925795 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:15:36.925754    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6cf856758c-cs8bw" podUID="2b930a70-91ac-47df-abbe-c3c2ec0ac1d4"
Jul 15 12:15:36.925795 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:15:36.925754    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5dc4f89c55-8fdlw" podUID="c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece"
Jul 15 12:15:36.926009 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:15:36.925753    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-sfm96" podUID="b9a23fbe-f3c1-4d56-84a9-37025a59b3e4"
Jul 15 12:15:37.254868 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:37.254792    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-cs8bw"
Jul 15 12:15:37.254868 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:37.254799    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-hvqgh" event={"ID":"cbd017f6-cc49-41c7-bf54-e608baa47768","Type":"ContainerStarted","Data":"2e3abd9dffd571fce3ac8f9e9cfc4e7783c8c9716c97988b0dff849d3d69f49d"}
Jul 15 12:15:37.254868 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:37.254834    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sfm96"
Jul 15 12:15:37.254868 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:37.254803    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5dc4f89c55-8fdlw"
Jul 15 12:15:40.284151 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:40.284116    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2b930a70-91ac-47df-abbe-c3c2ec0ac1d4-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-cs8bw\" (UID: \"2b930a70-91ac-47df-abbe-c3c2ec0ac1d4\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-cs8bw"
Jul 15 12:15:40.284537 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:40.284157    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-registry-tls\") pod \"image-registry-5dc4f89c55-8fdlw\" (UID: \"c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece\") " pod="openshift-image-registry/image-registry-5dc4f89c55-8fdlw"
Jul 15 12:15:40.284537 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:40.284209    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9a23fbe-f3c1-4d56-84a9-37025a59b3e4-metrics-tls\") pod \"dns-default-sfm96\" (UID: \"b9a23fbe-f3c1-4d56-84a9-37025a59b3e4\") " pod="openshift-dns/dns-default-sfm96"
Jul 15 12:15:40.286444 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:40.286421    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9a23fbe-f3c1-4d56-84a9-37025a59b3e4-metrics-tls\") pod \"dns-default-sfm96\" (UID: \"b9a23fbe-f3c1-4d56-84a9-37025a59b3e4\") " pod="openshift-dns/dns-default-sfm96"
Jul 15 12:15:40.286578 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:40.286496    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2b930a70-91ac-47df-abbe-c3c2ec0ac1d4-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-cs8bw\" (UID: \"2b930a70-91ac-47df-abbe-c3c2ec0ac1d4\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-cs8bw"
Jul 15 12:15:40.286686 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:40.286669    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-registry-tls\") pod \"image-registry-5dc4f89c55-8fdlw\" (UID: \"c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece\") " pod="openshift-image-registry/image-registry-5dc4f89c55-8fdlw"
Jul 15 12:15:40.559863 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:40.559780    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gfjwd\""
Jul 15 12:15:40.559863 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:40.559829    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6jhfg\""
Jul 15 12:15:40.560089 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:40.559782    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-b8vbs\""
Jul 15 12:15:40.566245 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:40.566222    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-cs8bw"
Jul 15 12:15:40.566394 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:40.566265    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5dc4f89c55-8fdlw"
Jul 15 12:15:40.566452 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:40.566428    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sfm96"
Jul 15 12:15:41.105512 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:41.105484    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5dc4f89c55-8fdlw"]
Jul 15 12:15:41.123532 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:41.123507    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-cs8bw"]
Jul 15 12:15:41.129359 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:15:41.129152    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b930a70_91ac_47df_abbe_c3c2ec0ac1d4.slice/crio-b6c41562cf632ed1a7a381d16791304a6328ca1b3380c40ee02316849e2e0f4a WatchSource:0}: Error finding container b6c41562cf632ed1a7a381d16791304a6328ca1b3380c40ee02316849e2e0f4a: Status 404 returned error can't find the container with id b6c41562cf632ed1a7a381d16791304a6328ca1b3380c40ee02316849e2e0f4a
Jul 15 12:15:41.147459 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:41.147323    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sfm96"]
Jul 15 12:15:41.150768 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:15:41.150703    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9a23fbe_f3c1_4d56_84a9_37025a59b3e4.slice/crio-d307df27a9408b5149102cc1538ad0a752d440f215f6e90d265babc0953aa276 WatchSource:0}: Error finding container d307df27a9408b5149102cc1538ad0a752d440f215f6e90d265babc0953aa276: Status 404 returned error can't find the container with id d307df27a9408b5149102cc1538ad0a752d440f215f6e90d265babc0953aa276
Jul 15 12:15:41.269717 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:41.269617    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-hvqgh" event={"ID":"cbd017f6-cc49-41c7-bf54-e608baa47768","Type":"ContainerStarted","Data":"729bd90f551f971e2ff4665c841f3b4c202a7965e6349a3788110fa59c6b157f"}
Jul 15 12:15:41.269717 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:41.269687    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-hvqgh" event={"ID":"cbd017f6-cc49-41c7-bf54-e608baa47768","Type":"ContainerStarted","Data":"550c2d367ba15eb266f2ad0885863df584a12d263263c2c79132bf42836d4d64"}
Jul 15 12:15:41.271154 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:41.271122    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5dc4f89c55-8fdlw" event={"ID":"c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece","Type":"ContainerStarted","Data":"f94d4499dafc11aed4521a9a289f9c18e8035a7dcb2457c2b2975c764fbdd200"}
Jul 15 12:15:41.271330 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:41.271175    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5dc4f89c55-8fdlw" event={"ID":"c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece","Type":"ContainerStarted","Data":"5b3d5023ae5e7cf2fcd67d16895310084893c23d6388ea163a502e2699b3b265"}
Jul 15 12:15:41.271330 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:41.271205    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5dc4f89c55-8fdlw"
Jul 15 12:15:41.272266 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:41.272246    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sfm96" event={"ID":"b9a23fbe-f3c1-4d56-84a9-37025a59b3e4","Type":"ContainerStarted","Data":"d307df27a9408b5149102cc1538ad0a752d440f215f6e90d265babc0953aa276"}
Jul 15 12:15:41.273780 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:41.273750    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5knhr" event={"ID":"e2048642-6a69-4294-b0e4-cc80432a8625","Type":"ContainerStarted","Data":"6fe76b2ef541ea7d4d5dcc30506a9b4ded093d1b86facb42103437f2c7c503d8"}
Jul 15 12:15:41.274856 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:41.274835    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-cs8bw" event={"ID":"2b930a70-91ac-47df-abbe-c3c2ec0ac1d4","Type":"ContainerStarted","Data":"b6c41562cf632ed1a7a381d16791304a6328ca1b3380c40ee02316849e2e0f4a"}
Jul 15 12:15:41.308795 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:41.308744    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-hvqgh" podStartSLOduration=2.218147694 podStartE2EDuration="6.30872949s" totalImagesPullingTime="4.090581796s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:15:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:15:41.287022823 +0000 UTC m=+288.401416556" watchObservedRunningTime="2026-07-15 12:15:41.30872949 +0000 UTC m=+288.423123213"
Jul 15 12:15:41.309197 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:41.309147    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5dc4f89c55-8fdlw" podStartSLOduration=287.309138722 podStartE2EDuration="4m47.309138722s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:10:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:15:41.30843298 +0000 UTC m=+288.422826712" watchObservedRunningTime="2026-07-15 12:15:41.309138722 +0000 UTC m=+288.423532454"
Jul 15 12:15:41.438405 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:41.438372    2560 scope.go:117] "RemoveContainer" containerID="8ec41de9d90fec224ae463256e06d5d504a2332877342f355ca9537ff978a69a"
Jul 15 12:15:41.438549 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:15:41.438519    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-xkvbf_openshift-console-operator(641b0ffa-0450-4198-8066-0241ab179822)\"" pod="openshift-console-operator/console-operator-7866497494-xkvbf" podUID="641b0ffa-0450-4198-8066-0241ab179822"
Jul 15 12:15:43.192049 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.192012    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-xhbdq"]
Jul 15 12:15:43.195451 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.195424    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-xhbdq"
Jul 15 12:15:43.198084 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.198058    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 15 12:15:43.198192 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.198083    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-5mjlh\""
Jul 15 12:15:43.199333 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.199312    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 15 12:15:43.199441 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.199335    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 15 12:15:43.206636 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.206616    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-xhbdq"]
Jul 15 12:15:43.214675 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.214656    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pr5kb"]
Jul 15 12:15:43.217756 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.217741    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pr5kb"
Jul 15 12:15:43.221388 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.220840    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 15 12:15:43.221388 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.220906    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-n2sgv\""
Jul 15 12:15:43.221388 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.220842    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 15 12:15:43.221388 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.221156    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 15 12:15:43.284437 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.284400    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-cs8bw" event={"ID":"2b930a70-91ac-47df-abbe-c3c2ec0ac1d4","Type":"ContainerStarted","Data":"8ba83de7c93ffe1bf66f0daa4e3fd04531c223d07e163ad102551a05cc982622"}
Jul 15 12:15:43.303760 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.303705    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-cs8bw" podStartSLOduration=282.800057219 podStartE2EDuration="4m44.3036831s" totalImagesPullingTime="1.503625881s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:10:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:15:43.30258475 +0000 UTC m=+290.416978485" watchObservedRunningTime="2026-07-15 12:15:43.3036831 +0000 UTC m=+290.418076833"
Jul 15 12:15:43.313004 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.312977    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/131ed49e-dd84-420f-b401-d8632035f0e8-root\") pod \"node-exporter-pr5kb\" (UID: \"131ed49e-dd84-420f-b401-d8632035f0e8\") " pod="openshift-monitoring/node-exporter-pr5kb"
Jul 15 12:15:43.313145 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.313028    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58b72f47-2df3-465d-9676-2c78f1af5579-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-xhbdq\" (UID: \"58b72f47-2df3-465d-9676-2c78f1af5579\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xhbdq"
Jul 15 12:15:43.313145 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.313116    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9dbb\" (UniqueName: \"kubernetes.io/projected/131ed49e-dd84-420f-b401-d8632035f0e8-kube-api-access-v9dbb\") pod \"node-exporter-pr5kb\" (UID: \"131ed49e-dd84-420f-b401-d8632035f0e8\") " pod="openshift-monitoring/node-exporter-pr5kb"
Jul 15 12:15:43.313260 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.313151    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/131ed49e-dd84-420f-b401-d8632035f0e8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pr5kb\" (UID: \"131ed49e-dd84-420f-b401-d8632035f0e8\") " pod="openshift-monitoring/node-exporter-pr5kb"
Jul 15 12:15:43.313260 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.313183    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/131ed49e-dd84-420f-b401-d8632035f0e8-node-exporter-accelerators-collector-config\") pod \"node-exporter-pr5kb\" (UID: \"131ed49e-dd84-420f-b401-d8632035f0e8\") " pod="openshift-monitoring/node-exporter-pr5kb"
Jul 15 12:15:43.313260 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.313212    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqnnl\" (UniqueName: \"kubernetes.io/projected/58b72f47-2df3-465d-9676-2c78f1af5579-kube-api-access-nqnnl\") pod \"kube-state-metrics-785778ff74-xhbdq\" (UID: \"58b72f47-2df3-465d-9676-2c78f1af5579\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xhbdq"
Jul 15 12:15:43.313399 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.313257    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/58b72f47-2df3-465d-9676-2c78f1af5579-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-xhbdq\" (UID: \"58b72f47-2df3-465d-9676-2c78f1af5579\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xhbdq"
Jul 15 12:15:43.313399 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.313282    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/131ed49e-dd84-420f-b401-d8632035f0e8-node-exporter-wtmp\") pod \"node-exporter-pr5kb\" (UID: \"131ed49e-dd84-420f-b401-d8632035f0e8\") " pod="openshift-monitoring/node-exporter-pr5kb"
Jul 15 12:15:43.313399 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.313351    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/58b72f47-2df3-465d-9676-2c78f1af5579-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-xhbdq\" (UID: \"58b72f47-2df3-465d-9676-2c78f1af5579\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xhbdq"
Jul 15 12:15:43.313399 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.313381    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58b72f47-2df3-465d-9676-2c78f1af5579-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-xhbdq\" (UID: \"58b72f47-2df3-465d-9676-2c78f1af5579\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xhbdq"
Jul 15 12:15:43.313574 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.313407    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/131ed49e-dd84-420f-b401-d8632035f0e8-node-exporter-textfile\") pod \"node-exporter-pr5kb\" (UID: \"131ed49e-dd84-420f-b401-d8632035f0e8\") " pod="openshift-monitoring/node-exporter-pr5kb"
Jul 15 12:15:43.313574 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.313446    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/58b72f47-2df3-465d-9676-2c78f1af5579-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-xhbdq\" (UID: \"58b72f47-2df3-465d-9676-2c78f1af5579\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xhbdq"
Jul 15 12:15:43.313574 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.313471    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/131ed49e-dd84-420f-b401-d8632035f0e8-sys\") pod \"node-exporter-pr5kb\" (UID: \"131ed49e-dd84-420f-b401-d8632035f0e8\") " pod="openshift-monitoring/node-exporter-pr5kb"
Jul 15 12:15:43.313574 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.313498    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/131ed49e-dd84-420f-b401-d8632035f0e8-metrics-client-ca\") pod \"node-exporter-pr5kb\" (UID: \"131ed49e-dd84-420f-b401-d8632035f0e8\") " pod="openshift-monitoring/node-exporter-pr5kb"
Jul 15 12:15:43.313574 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.313524    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/131ed49e-dd84-420f-b401-d8632035f0e8-node-exporter-tls\") pod \"node-exporter-pr5kb\" (UID: \"131ed49e-dd84-420f-b401-d8632035f0e8\") " pod="openshift-monitoring/node-exporter-pr5kb"
Jul 15 12:15:43.413978 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.413929    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/131ed49e-dd84-420f-b401-d8632035f0e8-node-exporter-tls\") pod \"node-exporter-pr5kb\" (UID: \"131ed49e-dd84-420f-b401-d8632035f0e8\") " pod="openshift-monitoring/node-exporter-pr5kb"
Jul 15 12:15:43.414134 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.413999    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/131ed49e-dd84-420f-b401-d8632035f0e8-root\") pod \"node-exporter-pr5kb\" (UID: \"131ed49e-dd84-420f-b401-d8632035f0e8\") " pod="openshift-monitoring/node-exporter-pr5kb"
Jul 15 12:15:43.414134 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.414054    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58b72f47-2df3-465d-9676-2c78f1af5579-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-xhbdq\" (UID: \"58b72f47-2df3-465d-9676-2c78f1af5579\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xhbdq"
Jul 15 12:15:43.414134 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.414105    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9dbb\" (UniqueName: \"kubernetes.io/projected/131ed49e-dd84-420f-b401-d8632035f0e8-kube-api-access-v9dbb\") pod \"node-exporter-pr5kb\" (UID: \"131ed49e-dd84-420f-b401-d8632035f0e8\") " pod="openshift-monitoring/node-exporter-pr5kb"
Jul 15 12:15:43.414134 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.414109    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/131ed49e-dd84-420f-b401-d8632035f0e8-root\") pod \"node-exporter-pr5kb\" (UID: \"131ed49e-dd84-420f-b401-d8632035f0e8\") " pod="openshift-monitoring/node-exporter-pr5kb"
Jul 15 12:15:43.414366 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.414137    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/131ed49e-dd84-420f-b401-d8632035f0e8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pr5kb\" (UID: \"131ed49e-dd84-420f-b401-d8632035f0e8\") " pod="openshift-monitoring/node-exporter-pr5kb"
Jul 15 12:15:43.414366 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.414169    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/131ed49e-dd84-420f-b401-d8632035f0e8-node-exporter-accelerators-collector-config\") pod \"node-exporter-pr5kb\" (UID: \"131ed49e-dd84-420f-b401-d8632035f0e8\") " pod="openshift-monitoring/node-exporter-pr5kb"
Jul 15 12:15:43.414366 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.414201    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqnnl\" (UniqueName: \"kubernetes.io/projected/58b72f47-2df3-465d-9676-2c78f1af5579-kube-api-access-nqnnl\") pod \"kube-state-metrics-785778ff74-xhbdq\" (UID: \"58b72f47-2df3-465d-9676-2c78f1af5579\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xhbdq"
Jul 15 12:15:43.414366 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.414246    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/58b72f47-2df3-465d-9676-2c78f1af5579-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-xhbdq\" (UID: \"58b72f47-2df3-465d-9676-2c78f1af5579\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xhbdq"
Jul 15 12:15:43.414366 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.414271    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/131ed49e-dd84-420f-b401-d8632035f0e8-node-exporter-wtmp\") pod \"node-exporter-pr5kb\" (UID: \"131ed49e-dd84-420f-b401-d8632035f0e8\") " pod="openshift-monitoring/node-exporter-pr5kb"
Jul 15 12:15:43.414366 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.414363    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/58b72f47-2df3-465d-9676-2c78f1af5579-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-xhbdq\" (UID: \"58b72f47-2df3-465d-9676-2c78f1af5579\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xhbdq"
Jul 15 12:15:43.414639 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.414393    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58b72f47-2df3-465d-9676-2c78f1af5579-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-xhbdq\" (UID: \"58b72f47-2df3-465d-9676-2c78f1af5579\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xhbdq"
Jul 15 12:15:43.414639 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.414424    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/131ed49e-dd84-420f-b401-d8632035f0e8-node-exporter-textfile\") pod \"node-exporter-pr5kb\" (UID: \"131ed49e-dd84-420f-b401-d8632035f0e8\") " pod="openshift-monitoring/node-exporter-pr5kb"
Jul 15 12:15:43.414639 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.414460    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/58b72f47-2df3-465d-9676-2c78f1af5579-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-xhbdq\" (UID: \"58b72f47-2df3-465d-9676-2c78f1af5579\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xhbdq"
Jul 15 12:15:43.414639 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.414487    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/131ed49e-dd84-420f-b401-d8632035f0e8-sys\") pod \"node-exporter-pr5kb\" (UID: \"131ed49e-dd84-420f-b401-d8632035f0e8\") " pod="openshift-monitoring/node-exporter-pr5kb"
Jul 15 12:15:43.414639 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.414521    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/131ed49e-dd84-420f-b401-d8632035f0e8-metrics-client-ca\") pod \"node-exporter-pr5kb\" (UID: \"131ed49e-dd84-420f-b401-d8632035f0e8\") " pod="openshift-monitoring/node-exporter-pr5kb"
Jul 15 12:15:43.415921 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.415094    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/131ed49e-dd84-420f-b401-d8632035f0e8-metrics-client-ca\") pod \"node-exporter-pr5kb\" (UID: \"131ed49e-dd84-420f-b401-d8632035f0e8\") " pod="openshift-monitoring/node-exporter-pr5kb"
Jul 15 12:15:43.415921 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.415416    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/131ed49e-dd84-420f-b401-d8632035f0e8-node-exporter-textfile\") pod \"node-exporter-pr5kb\" (UID: \"131ed49e-dd84-420f-b401-d8632035f0e8\") " pod="openshift-monitoring/node-exporter-pr5kb"
Jul 15 12:15:43.415921 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.415437    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/131ed49e-dd84-420f-b401-d8632035f0e8-node-exporter-accelerators-collector-config\") pod \"node-exporter-pr5kb\" (UID: \"131ed49e-dd84-420f-b401-d8632035f0e8\") " pod="openshift-monitoring/node-exporter-pr5kb"
Jul 15 12:15:43.415921 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.415507    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/131ed49e-dd84-420f-b401-d8632035f0e8-sys\") pod \"node-exporter-pr5kb\" (UID: \"131ed49e-dd84-420f-b401-d8632035f0e8\") " pod="openshift-monitoring/node-exporter-pr5kb"
Jul 15 12:15:43.415921 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:15:43.415535    2560 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 15 12:15:43.415921 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.415552    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58b72f47-2df3-465d-9676-2c78f1af5579-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-xhbdq\" (UID: \"58b72f47-2df3-465d-9676-2c78f1af5579\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xhbdq"
Jul 15 12:15:43.415921 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:15:43.415598    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58b72f47-2df3-465d-9676-2c78f1af5579-kube-state-metrics-tls podName:58b72f47-2df3-465d-9676-2c78f1af5579 nodeName:}" failed. No retries permitted until 2026-07-15 12:15:43.915577821 +0000 UTC m=+291.029971543 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/58b72f47-2df3-465d-9676-2c78f1af5579-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-xhbdq" (UID: "58b72f47-2df3-465d-9676-2c78f1af5579") : secret "kube-state-metrics-tls" not found
Jul 15 12:15:43.415921 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.415636    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/131ed49e-dd84-420f-b401-d8632035f0e8-node-exporter-wtmp\") pod \"node-exporter-pr5kb\" (UID: \"131ed49e-dd84-420f-b401-d8632035f0e8\") " pod="openshift-monitoring/node-exporter-pr5kb"
Jul 15 12:15:43.415921 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.415852    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/58b72f47-2df3-465d-9676-2c78f1af5579-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-xhbdq\" (UID: \"58b72f47-2df3-465d-9676-2c78f1af5579\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xhbdq"
Jul 15 12:15:43.416516 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.416204    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/58b72f47-2df3-465d-9676-2c78f1af5579-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-xhbdq\" (UID: \"58b72f47-2df3-465d-9676-2c78f1af5579\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xhbdq"
Jul 15 12:15:43.417223 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.417197    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58b72f47-2df3-465d-9676-2c78f1af5579-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-xhbdq\" (UID: \"58b72f47-2df3-465d-9676-2c78f1af5579\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xhbdq"
Jul 15 12:15:43.417457 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.417439    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/131ed49e-dd84-420f-b401-d8632035f0e8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pr5kb\" (UID: \"131ed49e-dd84-420f-b401-d8632035f0e8\") " pod="openshift-monitoring/node-exporter-pr5kb"
Jul 15 12:15:43.418313 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.418269    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/131ed49e-dd84-420f-b401-d8632035f0e8-node-exporter-tls\") pod \"node-exporter-pr5kb\" (UID: \"131ed49e-dd84-420f-b401-d8632035f0e8\") " pod="openshift-monitoring/node-exporter-pr5kb"
Jul 15 12:15:43.422399 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.422372    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9dbb\" (UniqueName: \"kubernetes.io/projected/131ed49e-dd84-420f-b401-d8632035f0e8-kube-api-access-v9dbb\") pod \"node-exporter-pr5kb\" (UID: \"131ed49e-dd84-420f-b401-d8632035f0e8\") " pod="openshift-monitoring/node-exporter-pr5kb"
Jul 15 12:15:43.426153 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.426133    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqnnl\" (UniqueName: \"kubernetes.io/projected/58b72f47-2df3-465d-9676-2c78f1af5579-kube-api-access-nqnnl\") pod \"kube-state-metrics-785778ff74-xhbdq\" (UID: \"58b72f47-2df3-465d-9676-2c78f1af5579\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xhbdq"
Jul 15 12:15:43.531287 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.531248    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pr5kb"
Jul 15 12:15:43.918822 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.918710    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/58b72f47-2df3-465d-9676-2c78f1af5579-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-xhbdq\" (UID: \"58b72f47-2df3-465d-9676-2c78f1af5579\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xhbdq"
Jul 15 12:15:43.921443 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:43.921417    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/58b72f47-2df3-465d-9676-2c78f1af5579-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-xhbdq\" (UID: \"58b72f47-2df3-465d-9676-2c78f1af5579\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xhbdq"
Jul 15 12:15:44.105660 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:44.105626    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-xhbdq"
Jul 15 12:15:45.177905 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:15:45.177765    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod131ed49e_dd84_420f_b401_d8632035f0e8.slice/crio-fd2264fb734e09cfd76a63f2d5bd7de0c2f13515d34eb23dc7620bd1aa53a328 WatchSource:0}: Error finding container fd2264fb734e09cfd76a63f2d5bd7de0c2f13515d34eb23dc7620bd1aa53a328: Status 404 returned error can't find the container with id fd2264fb734e09cfd76a63f2d5bd7de0c2f13515d34eb23dc7620bd1aa53a328
Jul 15 12:15:45.294471 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:45.294440    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pr5kb" event={"ID":"131ed49e-dd84-420f-b401-d8632035f0e8","Type":"ContainerStarted","Data":"fd2264fb734e09cfd76a63f2d5bd7de0c2f13515d34eb23dc7620bd1aa53a328"}
Jul 15 12:15:45.296870 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:45.296836    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sfm96" event={"ID":"b9a23fbe-f3c1-4d56-84a9-37025a59b3e4","Type":"ContainerStarted","Data":"7aae609f220a112064295446d7e68394d25ee8cf7aad253bfcf6269757143ab2"}
Jul 15 12:15:45.315456 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:45.315427    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-xhbdq"]
Jul 15 12:15:45.317049 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:15:45.317017    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58b72f47_2df3_465d_9676_2c78f1af5579.slice/crio-ea497c441d79e5fbb1bf72f7ab01413d1ac1368228cfa4f609410fc02f94cb93 WatchSource:0}: Error finding container ea497c441d79e5fbb1bf72f7ab01413d1ac1368228cfa4f609410fc02f94cb93: Status 404 returned error can't find the container with id ea497c441d79e5fbb1bf72f7ab01413d1ac1368228cfa4f609410fc02f94cb93
Jul 15 12:15:46.303711 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:46.303540    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-xhbdq" event={"ID":"58b72f47-2df3-465d-9676-2c78f1af5579","Type":"ContainerStarted","Data":"ea497c441d79e5fbb1bf72f7ab01413d1ac1368228cfa4f609410fc02f94cb93"}
Jul 15 12:15:46.305858 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:46.305826    2560 generic.go:356] "Generic (PLEG): container finished" podID="131ed49e-dd84-420f-b401-d8632035f0e8" containerID="8ba8f534b95c3ea20541afe918bc0d4c84aacd798715c3235a16b03edbaba179" exitCode=0
Jul 15 12:15:46.306540 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:46.306492    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pr5kb" event={"ID":"131ed49e-dd84-420f-b401-d8632035f0e8","Type":"ContainerDied","Data":"8ba8f534b95c3ea20541afe918bc0d4c84aacd798715c3235a16b03edbaba179"}
Jul 15 12:15:46.314157 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:46.314132    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sfm96" event={"ID":"b9a23fbe-f3c1-4d56-84a9-37025a59b3e4","Type":"ContainerStarted","Data":"3156a2cba15cb1aa33a4f5da35ea81e866f7e68cf69207186765cbb098df018d"}
Jul 15 12:15:46.314558 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:46.314536    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-sfm96"
Jul 15 12:15:46.317288 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:46.317265    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5knhr" event={"ID":"e2048642-6a69-4294-b0e4-cc80432a8625","Type":"ContainerStarted","Data":"c1e09f00368d5dac579fb6041ea10aeac2058e3edf9a32f8ca6c46a8b52c791a"}
Jul 15 12:15:47.323409 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:47.323228    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-xhbdq" event={"ID":"58b72f47-2df3-465d-9676-2c78f1af5579","Type":"ContainerStarted","Data":"63f8212f650ed773c5b779b3bdac06c0b74b6978dc01cc75bc06745a7f6d7cc7"}
Jul 15 12:15:47.323409 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:47.323286    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-xhbdq" event={"ID":"58b72f47-2df3-465d-9676-2c78f1af5579","Type":"ContainerStarted","Data":"2ebfb9dc1b064709e8ba629bbe34084af5c021a636288c0a50436de7471fc09f"}
Jul 15 12:15:47.323409 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:47.323329    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-xhbdq" event={"ID":"58b72f47-2df3-465d-9676-2c78f1af5579","Type":"ContainerStarted","Data":"7f204742ebf136556330c2ba371e15ce94ba099f25f5ea7f763efc5982314a38"}
Jul 15 12:15:47.325730 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:47.325638    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pr5kb" event={"ID":"131ed49e-dd84-420f-b401-d8632035f0e8","Type":"ContainerStarted","Data":"0cf5a07b133313434b7d29ce02e7ad33cf84ec32ff552ded62277bb2794e5f66"}
Jul 15 12:15:47.325730 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:47.325702    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pr5kb" event={"ID":"131ed49e-dd84-420f-b401-d8632035f0e8","Type":"ContainerStarted","Data":"6aa1dcf0d169ee0acea0806a2279bea2feb63a4210fd418a1cfb4bd7df3d212f"}
Jul 15 12:15:47.344108 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:47.344062    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-xhbdq" podStartSLOduration=2.6465937029999997 podStartE2EDuration="4.34404712s" totalImagesPullingTime="1.697453417s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:15:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:15:47.342060869 +0000 UTC m=+294.456454602" watchObservedRunningTime="2026-07-15 12:15:47.34404712 +0000 UTC m=+294.458440852"
Jul 15 12:15:47.344329 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:47.344280    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-sfm96" podStartSLOduration=253.32521936 podStartE2EDuration="4m17.344270551s" totalImagesPullingTime="4.019051191s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:11:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:15:46.347335018 +0000 UTC m=+293.461728749" watchObservedRunningTime="2026-07-15 12:15:47.344270551 +0000 UTC m=+294.458664292"
Jul 15 12:15:47.360144 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:47.360108    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pr5kb" podStartSLOduration=3.4135866200000002 podStartE2EDuration="4.360090507s" totalImagesPullingTime="871.647775ms" totalInitContainerRuntime="74.856112ms" isStatefulPod=true podCreationTimestamp="2026-07-15 12:15:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:15:47.358793226 +0000 UTC m=+294.473186960" watchObservedRunningTime="2026-07-15 12:15:47.360090507 +0000 UTC m=+294.474484239"
Jul 15 12:15:47.452918 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:47.452829    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-785c48688d-c9ktm"]
Jul 15 12:15:47.458691 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:47.458669    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-785c48688d-c9ktm"
Jul 15 12:15:47.461024 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:47.460999    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 15 12:15:47.461336 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:47.461280    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 15 12:15:47.461713 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:47.461568    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 15 12:15:47.461806 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:47.461719    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-qdqqw\""
Jul 15 12:15:47.462315 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:47.461974    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-1q7uh2ol2d65a\""
Jul 15 12:15:47.462315 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:47.461997    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 15 12:15:47.464048 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:47.463991    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-785c48688d-c9ktm"]
Jul 15 12:15:47.553758 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:47.553725    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1edd91c2-6b3b-4fbf-8741-a8c5aef90d19-client-ca-bundle\") pod \"metrics-server-785c48688d-c9ktm\" (UID: \"1edd91c2-6b3b-4fbf-8741-a8c5aef90d19\") " pod="openshift-monitoring/metrics-server-785c48688d-c9ktm"
Jul 15 12:15:47.553919 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:47.553770    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2b4gm\" (UniqueName: \"kubernetes.io/projected/1edd91c2-6b3b-4fbf-8741-a8c5aef90d19-kube-api-access-2b4gm\") pod \"metrics-server-785c48688d-c9ktm\" (UID: \"1edd91c2-6b3b-4fbf-8741-a8c5aef90d19\") " pod="openshift-monitoring/metrics-server-785c48688d-c9ktm"
Jul 15 12:15:47.553919 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:47.553804    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1edd91c2-6b3b-4fbf-8741-a8c5aef90d19-metrics-server-audit-profiles\") pod \"metrics-server-785c48688d-c9ktm\" (UID: \"1edd91c2-6b3b-4fbf-8741-a8c5aef90d19\") " pod="openshift-monitoring/metrics-server-785c48688d-c9ktm"
Jul 15 12:15:47.553919 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:47.553867    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1edd91c2-6b3b-4fbf-8741-a8c5aef90d19-secret-metrics-server-tls\") pod \"metrics-server-785c48688d-c9ktm\" (UID: \"1edd91c2-6b3b-4fbf-8741-a8c5aef90d19\") " pod="openshift-monitoring/metrics-server-785c48688d-c9ktm"
Jul 15 12:15:47.553919 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:47.553895    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1edd91c2-6b3b-4fbf-8741-a8c5aef90d19-audit-log\") pod \"metrics-server-785c48688d-c9ktm\" (UID: \"1edd91c2-6b3b-4fbf-8741-a8c5aef90d19\") " pod="openshift-monitoring/metrics-server-785c48688d-c9ktm"
Jul 15 12:15:47.554115 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:47.553948    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1edd91c2-6b3b-4fbf-8741-a8c5aef90d19-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-785c48688d-c9ktm\" (UID: \"1edd91c2-6b3b-4fbf-8741-a8c5aef90d19\") " pod="openshift-monitoring/metrics-server-785c48688d-c9ktm"
Jul 15 12:15:47.554115 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:47.553980    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1edd91c2-6b3b-4fbf-8741-a8c5aef90d19-secret-metrics-server-client-certs\") pod \"metrics-server-785c48688d-c9ktm\" (UID: \"1edd91c2-6b3b-4fbf-8741-a8c5aef90d19\") " pod="openshift-monitoring/metrics-server-785c48688d-c9ktm"
Jul 15 12:15:47.655342 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:47.655243    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2b4gm\" (UniqueName: \"kubernetes.io/projected/1edd91c2-6b3b-4fbf-8741-a8c5aef90d19-kube-api-access-2b4gm\") pod \"metrics-server-785c48688d-c9ktm\" (UID: \"1edd91c2-6b3b-4fbf-8741-a8c5aef90d19\") " pod="openshift-monitoring/metrics-server-785c48688d-c9ktm"
Jul 15 12:15:47.655342 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:47.655323    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1edd91c2-6b3b-4fbf-8741-a8c5aef90d19-metrics-server-audit-profiles\") pod \"metrics-server-785c48688d-c9ktm\" (UID: \"1edd91c2-6b3b-4fbf-8741-a8c5aef90d19\") " pod="openshift-monitoring/metrics-server-785c48688d-c9ktm"
Jul 15 12:15:47.655556 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:47.655359    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1edd91c2-6b3b-4fbf-8741-a8c5aef90d19-secret-metrics-server-tls\") pod \"metrics-server-785c48688d-c9ktm\" (UID: \"1edd91c2-6b3b-4fbf-8741-a8c5aef90d19\") " pod="openshift-monitoring/metrics-server-785c48688d-c9ktm"
Jul 15 12:15:47.655556 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:47.655388    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1edd91c2-6b3b-4fbf-8741-a8c5aef90d19-audit-log\") pod \"metrics-server-785c48688d-c9ktm\" (UID: \"1edd91c2-6b3b-4fbf-8741-a8c5aef90d19\") " pod="openshift-monitoring/metrics-server-785c48688d-c9ktm"
Jul 15 12:15:47.655556 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:47.655438    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1edd91c2-6b3b-4fbf-8741-a8c5aef90d19-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-785c48688d-c9ktm\" (UID: \"1edd91c2-6b3b-4fbf-8741-a8c5aef90d19\") " pod="openshift-monitoring/metrics-server-785c48688d-c9ktm"
Jul 15 12:15:47.655556 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:47.655470    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1edd91c2-6b3b-4fbf-8741-a8c5aef90d19-secret-metrics-server-client-certs\") pod \"metrics-server-785c48688d-c9ktm\" (UID: \"1edd91c2-6b3b-4fbf-8741-a8c5aef90d19\") " pod="openshift-monitoring/metrics-server-785c48688d-c9ktm"
Jul 15 12:15:47.655556 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:47.655525    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1edd91c2-6b3b-4fbf-8741-a8c5aef90d19-client-ca-bundle\") pod \"metrics-server-785c48688d-c9ktm\" (UID: \"1edd91c2-6b3b-4fbf-8741-a8c5aef90d19\") " pod="openshift-monitoring/metrics-server-785c48688d-c9ktm"
Jul 15 12:15:47.655882 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:47.655849    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1edd91c2-6b3b-4fbf-8741-a8c5aef90d19-audit-log\") pod \"metrics-server-785c48688d-c9ktm\" (UID: \"1edd91c2-6b3b-4fbf-8741-a8c5aef90d19\") " pod="openshift-monitoring/metrics-server-785c48688d-c9ktm"
Jul 15 12:15:47.656268 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:47.656234    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1edd91c2-6b3b-4fbf-8741-a8c5aef90d19-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-785c48688d-c9ktm\" (UID: \"1edd91c2-6b3b-4fbf-8741-a8c5aef90d19\") " pod="openshift-monitoring/metrics-server-785c48688d-c9ktm"
Jul 15 12:15:47.656500 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:47.656472    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1edd91c2-6b3b-4fbf-8741-a8c5aef90d19-metrics-server-audit-profiles\") pod \"metrics-server-785c48688d-c9ktm\" (UID: \"1edd91c2-6b3b-4fbf-8741-a8c5aef90d19\") " pod="openshift-monitoring/metrics-server-785c48688d-c9ktm"
Jul 15 12:15:47.658187 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:47.658164    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1edd91c2-6b3b-4fbf-8741-a8c5aef90d19-secret-metrics-server-tls\") pod \"metrics-server-785c48688d-c9ktm\" (UID: \"1edd91c2-6b3b-4fbf-8741-a8c5aef90d19\") " pod="openshift-monitoring/metrics-server-785c48688d-c9ktm"
Jul 15 12:15:47.658454 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:47.658437    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1edd91c2-6b3b-4fbf-8741-a8c5aef90d19-client-ca-bundle\") pod \"metrics-server-785c48688d-c9ktm\" (UID: \"1edd91c2-6b3b-4fbf-8741-a8c5aef90d19\") " pod="openshift-monitoring/metrics-server-785c48688d-c9ktm"
Jul 15 12:15:47.658536 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:47.658440    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1edd91c2-6b3b-4fbf-8741-a8c5aef90d19-secret-metrics-server-client-certs\") pod \"metrics-server-785c48688d-c9ktm\" (UID: \"1edd91c2-6b3b-4fbf-8741-a8c5aef90d19\") " pod="openshift-monitoring/metrics-server-785c48688d-c9ktm"
Jul 15 12:15:47.664189 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:47.664144    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2b4gm\" (UniqueName: \"kubernetes.io/projected/1edd91c2-6b3b-4fbf-8741-a8c5aef90d19-kube-api-access-2b4gm\") pod \"metrics-server-785c48688d-c9ktm\" (UID: \"1edd91c2-6b3b-4fbf-8741-a8c5aef90d19\") " pod="openshift-monitoring/metrics-server-785c48688d-c9ktm"
Jul 15 12:15:47.771373 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:47.771317    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-785c48688d-c9ktm"
Jul 15 12:15:48.350595 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:48.350556    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6c949778c8-hcsbr"]
Jul 15 12:15:48.363957 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:48.363842    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6c949778c8-hcsbr"
Jul 15 12:15:48.364630 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:48.364599    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6c949778c8-hcsbr"]
Jul 15 12:15:48.366775 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:48.366579    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 15 12:15:48.366775 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:48.366579    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 15 12:15:48.366775 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:48.366692    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-mv4nt\""
Jul 15 12:15:48.367159 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:48.367138    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 15 12:15:48.367267 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:48.367170    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 15 12:15:48.367267 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:48.367198    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 15 12:15:48.372511 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:48.372194    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 15 12:15:48.463089 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:48.463058    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f5d3954-3ef3-4f63-8574-74b146786b83-metrics-client-ca\") pod \"telemeter-client-6c949778c8-hcsbr\" (UID: \"2f5d3954-3ef3-4f63-8574-74b146786b83\") " pod="openshift-monitoring/telemeter-client-6c949778c8-hcsbr"
Jul 15 12:15:48.463253 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:48.463135    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2f5d3954-3ef3-4f63-8574-74b146786b83-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6c949778c8-hcsbr\" (UID: \"2f5d3954-3ef3-4f63-8574-74b146786b83\") " pod="openshift-monitoring/telemeter-client-6c949778c8-hcsbr"
Jul 15 12:15:48.463253 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:48.463196    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2f5d3954-3ef3-4f63-8574-74b146786b83-secret-telemeter-client\") pod \"telemeter-client-6c949778c8-hcsbr\" (UID: \"2f5d3954-3ef3-4f63-8574-74b146786b83\") " pod="openshift-monitoring/telemeter-client-6c949778c8-hcsbr"
Jul 15 12:15:48.463253 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:48.463234    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2f5d3954-3ef3-4f63-8574-74b146786b83-federate-client-tls\") pod \"telemeter-client-6c949778c8-hcsbr\" (UID: \"2f5d3954-3ef3-4f63-8574-74b146786b83\") " pod="openshift-monitoring/telemeter-client-6c949778c8-hcsbr"
Jul 15 12:15:48.463450 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:48.463267    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f5d3954-3ef3-4f63-8574-74b146786b83-serving-certs-ca-bundle\") pod \"telemeter-client-6c949778c8-hcsbr\" (UID: \"2f5d3954-3ef3-4f63-8574-74b146786b83\") " pod="openshift-monitoring/telemeter-client-6c949778c8-hcsbr"
Jul 15 12:15:48.463450 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:48.463311    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f5d3954-3ef3-4f63-8574-74b146786b83-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6c949778c8-hcsbr\" (UID: \"2f5d3954-3ef3-4f63-8574-74b146786b83\") " pod="openshift-monitoring/telemeter-client-6c949778c8-hcsbr"
Jul 15 12:15:48.463450 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:48.463344    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqx2z\" (UniqueName: \"kubernetes.io/projected/2f5d3954-3ef3-4f63-8574-74b146786b83-kube-api-access-tqx2z\") pod \"telemeter-client-6c949778c8-hcsbr\" (UID: \"2f5d3954-3ef3-4f63-8574-74b146786b83\") " pod="openshift-monitoring/telemeter-client-6c949778c8-hcsbr"
Jul 15 12:15:48.463450 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:48.463406    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2f5d3954-3ef3-4f63-8574-74b146786b83-telemeter-client-tls\") pod \"telemeter-client-6c949778c8-hcsbr\" (UID: \"2f5d3954-3ef3-4f63-8574-74b146786b83\") " pod="openshift-monitoring/telemeter-client-6c949778c8-hcsbr"
Jul 15 12:15:48.563977 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:48.563940    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f5d3954-3ef3-4f63-8574-74b146786b83-serving-certs-ca-bundle\") pod \"telemeter-client-6c949778c8-hcsbr\" (UID: \"2f5d3954-3ef3-4f63-8574-74b146786b83\") " pod="openshift-monitoring/telemeter-client-6c949778c8-hcsbr"
Jul 15 12:15:48.563977 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:48.563982    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f5d3954-3ef3-4f63-8574-74b146786b83-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6c949778c8-hcsbr\" (UID: \"2f5d3954-3ef3-4f63-8574-74b146786b83\") " pod="openshift-monitoring/telemeter-client-6c949778c8-hcsbr"
Jul 15 12:15:48.564211 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:48.564107    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqx2z\" (UniqueName: \"kubernetes.io/projected/2f5d3954-3ef3-4f63-8574-74b146786b83-kube-api-access-tqx2z\") pod \"telemeter-client-6c949778c8-hcsbr\" (UID: \"2f5d3954-3ef3-4f63-8574-74b146786b83\") " pod="openshift-monitoring/telemeter-client-6c949778c8-hcsbr"
Jul 15 12:15:48.564211 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:48.564156    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2f5d3954-3ef3-4f63-8574-74b146786b83-telemeter-client-tls\") pod \"telemeter-client-6c949778c8-hcsbr\" (UID: \"2f5d3954-3ef3-4f63-8574-74b146786b83\") " pod="openshift-monitoring/telemeter-client-6c949778c8-hcsbr"
Jul 15 12:15:48.564341 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:48.564223    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f5d3954-3ef3-4f63-8574-74b146786b83-metrics-client-ca\") pod \"telemeter-client-6c949778c8-hcsbr\" (UID: \"2f5d3954-3ef3-4f63-8574-74b146786b83\") " pod="openshift-monitoring/telemeter-client-6c949778c8-hcsbr"
Jul 15 12:15:48.564341 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:48.564306    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2f5d3954-3ef3-4f63-8574-74b146786b83-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6c949778c8-hcsbr\" (UID: \"2f5d3954-3ef3-4f63-8574-74b146786b83\") " pod="openshift-monitoring/telemeter-client-6c949778c8-hcsbr"
Jul 15 12:15:48.564450 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:48.564349    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2f5d3954-3ef3-4f63-8574-74b146786b83-secret-telemeter-client\") pod \"telemeter-client-6c949778c8-hcsbr\" (UID: \"2f5d3954-3ef3-4f63-8574-74b146786b83\") " pod="openshift-monitoring/telemeter-client-6c949778c8-hcsbr"
Jul 15 12:15:48.564450 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:48.564389    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2f5d3954-3ef3-4f63-8574-74b146786b83-federate-client-tls\") pod \"telemeter-client-6c949778c8-hcsbr\" (UID: \"2f5d3954-3ef3-4f63-8574-74b146786b83\") " pod="openshift-monitoring/telemeter-client-6c949778c8-hcsbr"
Jul 15 12:15:48.564749 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:48.564727    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f5d3954-3ef3-4f63-8574-74b146786b83-serving-certs-ca-bundle\") pod \"telemeter-client-6c949778c8-hcsbr\" (UID: \"2f5d3954-3ef3-4f63-8574-74b146786b83\") " pod="openshift-monitoring/telemeter-client-6c949778c8-hcsbr"
Jul 15 12:15:48.565207 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:48.565135    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f5d3954-3ef3-4f63-8574-74b146786b83-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6c949778c8-hcsbr\" (UID: \"2f5d3954-3ef3-4f63-8574-74b146786b83\") " pod="openshift-monitoring/telemeter-client-6c949778c8-hcsbr"
Jul 15 12:15:48.565207 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:48.565185    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f5d3954-3ef3-4f63-8574-74b146786b83-metrics-client-ca\") pod \"telemeter-client-6c949778c8-hcsbr\" (UID: \"2f5d3954-3ef3-4f63-8574-74b146786b83\") " pod="openshift-monitoring/telemeter-client-6c949778c8-hcsbr"
Jul 15 12:15:48.567390 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:48.567348    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2f5d3954-3ef3-4f63-8574-74b146786b83-federate-client-tls\") pod \"telemeter-client-6c949778c8-hcsbr\" (UID: \"2f5d3954-3ef3-4f63-8574-74b146786b83\") " pod="openshift-monitoring/telemeter-client-6c949778c8-hcsbr"
Jul 15 12:15:48.567502 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:48.567481    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2f5d3954-3ef3-4f63-8574-74b146786b83-telemeter-client-tls\") pod \"telemeter-client-6c949778c8-hcsbr\" (UID: \"2f5d3954-3ef3-4f63-8574-74b146786b83\") " pod="openshift-monitoring/telemeter-client-6c949778c8-hcsbr"
Jul 15 12:15:48.567560 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:48.567483    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2f5d3954-3ef3-4f63-8574-74b146786b83-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6c949778c8-hcsbr\" (UID: \"2f5d3954-3ef3-4f63-8574-74b146786b83\") " pod="openshift-monitoring/telemeter-client-6c949778c8-hcsbr"
Jul 15 12:15:48.568011 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:48.567987    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2f5d3954-3ef3-4f63-8574-74b146786b83-secret-telemeter-client\") pod \"telemeter-client-6c949778c8-hcsbr\" (UID: \"2f5d3954-3ef3-4f63-8574-74b146786b83\") " pod="openshift-monitoring/telemeter-client-6c949778c8-hcsbr"
Jul 15 12:15:48.573177 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:48.573141    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqx2z\" (UniqueName: \"kubernetes.io/projected/2f5d3954-3ef3-4f63-8574-74b146786b83-kube-api-access-tqx2z\") pod \"telemeter-client-6c949778c8-hcsbr\" (UID: \"2f5d3954-3ef3-4f63-8574-74b146786b83\") " pod="openshift-monitoring/telemeter-client-6c949778c8-hcsbr"
Jul 15 12:15:48.676420 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:48.676340    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6c949778c8-hcsbr"
Jul 15 12:15:49.111988 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.111956    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-785c48688d-c9ktm"]
Jul 15 12:15:49.113449 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:15:49.113411    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1edd91c2_6b3b_4fbf_8741_a8c5aef90d19.slice/crio-e469309aab73c872095cb4bb030b9ca585b592d0a1e531955f038161ef2fd9a9 WatchSource:0}: Error finding container e469309aab73c872095cb4bb030b9ca585b592d0a1e531955f038161ef2fd9a9: Status 404 returned error can't find the container with id e469309aab73c872095cb4bb030b9ca585b592d0a1e531955f038161ef2fd9a9
Jul 15 12:15:49.135322 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.135278    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6c949778c8-hcsbr"]
Jul 15 12:15:49.136796 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:15:49.136773    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f5d3954_3ef3_4f63_8574_74b146786b83.slice/crio-6256c1bdc3d7dad1442b680ba170dc10c3e023015a5e4a5365aba6843fce2449 WatchSource:0}: Error finding container 6256c1bdc3d7dad1442b680ba170dc10c3e023015a5e4a5365aba6843fce2449: Status 404 returned error can't find the container with id 6256c1bdc3d7dad1442b680ba170dc10c3e023015a5e4a5365aba6843fce2449
Jul 15 12:15:49.325097 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.325017    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 12:15:49.330265 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.330237    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.333095 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.333069    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-zwzh2\""
Jul 15 12:15:49.333271 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.333135    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 15 12:15:49.333391 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.333286    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 15 12:15:49.333391 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.333258    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 15 12:15:49.333391 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.333369    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 15 12:15:49.333391 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.333219    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 15 12:15:49.333680 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.333660    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-buuso4e137bd2\""
Jul 15 12:15:49.333755 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.333703    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 15 12:15:49.334914 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.334514    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 15 12:15:49.334914 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.334566    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 15 12:15:49.334914 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.334735    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 15 12:15:49.336307 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.335935    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 15 12:15:49.336307 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.336123    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 15 12:15:49.336786 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.336506    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 15 12:15:49.336786 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.336751    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 15 12:15:49.337692 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.337656    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 15 12:15:49.338494 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.337946    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5knhr" event={"ID":"e2048642-6a69-4294-b0e4-cc80432a8625","Type":"ContainerStarted","Data":"943a21b639b84c0f61a41fbd98628e08712d425bf14960da6b6f5177b30e5f4f"}
Jul 15 12:15:49.339538 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.339518    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6c949778c8-hcsbr" event={"ID":"2f5d3954-3ef3-4f63-8574-74b146786b83","Type":"ContainerStarted","Data":"6256c1bdc3d7dad1442b680ba170dc10c3e023015a5e4a5365aba6843fce2449"}
Jul 15 12:15:49.340704 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.340683    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-785c48688d-c9ktm" event={"ID":"1edd91c2-6b3b-4fbf-8741-a8c5aef90d19","Type":"ContainerStarted","Data":"e469309aab73c872095cb4bb030b9ca585b592d0a1e531955f038161ef2fd9a9"}
Jul 15 12:15:49.345933 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.345907    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 12:15:49.372753 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.372723    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a085317e-2f97-48b4-89b1-ccc4999867ee-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.373155 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.372766    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a085317e-2f97-48b4-89b1-ccc4999867ee-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.373155 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.372801    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a085317e-2f97-48b4-89b1-ccc4999867ee-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.373155 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.372829    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a085317e-2f97-48b4-89b1-ccc4999867ee-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.373155 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.372862    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a085317e-2f97-48b4-89b1-ccc4999867ee-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.373155 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.372898    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a085317e-2f97-48b4-89b1-ccc4999867ee-config\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.373155 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.372942    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a085317e-2f97-48b4-89b1-ccc4999867ee-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.373155 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.373013    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a085317e-2f97-48b4-89b1-ccc4999867ee-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.373155 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.373047    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a085317e-2f97-48b4-89b1-ccc4999867ee-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.373155 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.373080    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a085317e-2f97-48b4-89b1-ccc4999867ee-config-out\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.373155 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.373145    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a085317e-2f97-48b4-89b1-ccc4999867ee-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.373614 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.373171    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a085317e-2f97-48b4-89b1-ccc4999867ee-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.373614 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.373246    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a085317e-2f97-48b4-89b1-ccc4999867ee-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.373614 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.373315    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lb4s6\" (UniqueName: \"kubernetes.io/projected/a085317e-2f97-48b4-89b1-ccc4999867ee-kube-api-access-lb4s6\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.373614 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.373358    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a085317e-2f97-48b4-89b1-ccc4999867ee-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.373614 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.373388    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a085317e-2f97-48b4-89b1-ccc4999867ee-web-config\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.373614 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.373450    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a085317e-2f97-48b4-89b1-ccc4999867ee-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.373614 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.373484    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a085317e-2f97-48b4-89b1-ccc4999867ee-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.373614 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.373510    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a085317e-2f97-48b4-89b1-ccc4999867ee-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.373614 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.373528    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a085317e-2f97-48b4-89b1-ccc4999867ee-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.389654 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.389603    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5knhr" podStartSLOduration=33.178599249 podStartE2EDuration="46.389584915s" totalImagesPullingTime="13.210985666s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:15:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:15:49.389124563 +0000 UTC m=+296.503518295" watchObservedRunningTime="2026-07-15 12:15:49.389584915 +0000 UTC m=+296.503978628"
Jul 15 12:15:49.439402 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:15:49.439366    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-spl8b" podUID="19938f5e-4b2c-45f8-9077-4fb510687262"
Jul 15 12:15:49.474327 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.474277    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a085317e-2f97-48b4-89b1-ccc4999867ee-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.474327 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.474330    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lb4s6\" (UniqueName: \"kubernetes.io/projected/a085317e-2f97-48b4-89b1-ccc4999867ee-kube-api-access-lb4s6\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.474534 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.474349    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a085317e-2f97-48b4-89b1-ccc4999867ee-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.474534 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.474373    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a085317e-2f97-48b4-89b1-ccc4999867ee-web-config\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.474534 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.474414    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a085317e-2f97-48b4-89b1-ccc4999867ee-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.474534 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.474437    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a085317e-2f97-48b4-89b1-ccc4999867ee-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.474534 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.474464    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a085317e-2f97-48b4-89b1-ccc4999867ee-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.474534 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.474494    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a085317e-2f97-48b4-89b1-ccc4999867ee-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.474534 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.474521    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a085317e-2f97-48b4-89b1-ccc4999867ee-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.474845 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.474549    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a085317e-2f97-48b4-89b1-ccc4999867ee-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.474845 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.474581    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a085317e-2f97-48b4-89b1-ccc4999867ee-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.474845 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.474612    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a085317e-2f97-48b4-89b1-ccc4999867ee-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.474845 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.474650    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a085317e-2f97-48b4-89b1-ccc4999867ee-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.474845 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.474689    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a085317e-2f97-48b4-89b1-ccc4999867ee-config\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.474845 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.474723    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a085317e-2f97-48b4-89b1-ccc4999867ee-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.474845 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.474761    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a085317e-2f97-48b4-89b1-ccc4999867ee-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.474845 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.474810    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a085317e-2f97-48b4-89b1-ccc4999867ee-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.474845 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.474840    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a085317e-2f97-48b4-89b1-ccc4999867ee-config-out\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.475282 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.474883    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a085317e-2f97-48b4-89b1-ccc4999867ee-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.475282 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.474907    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a085317e-2f97-48b4-89b1-ccc4999867ee-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.475282 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:15:49.475095    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a085317e-2f97-48b4-89b1-ccc4999867ee-prometheus-trusted-ca-bundle podName:a085317e-2f97-48b4-89b1-ccc4999867ee nodeName:}" failed. No retries permitted until 2026-07-15 12:15:49.975073581 +0000 UTC m=+297.089467304 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/a085317e-2f97-48b4-89b1-ccc4999867ee-prometheus-trusted-ca-bundle") pod "prometheus-k8s-0" (UID: "a085317e-2f97-48b4-89b1-ccc4999867ee") : configmap references non-existent config key: ca-bundle.crt
Jul 15 12:15:49.475282 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.475237    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a085317e-2f97-48b4-89b1-ccc4999867ee-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.477912 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.477885    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a085317e-2f97-48b4-89b1-ccc4999867ee-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.478192 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.478165    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a085317e-2f97-48b4-89b1-ccc4999867ee-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.478743 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.478684    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a085317e-2f97-48b4-89b1-ccc4999867ee-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.478743 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.478725    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a085317e-2f97-48b4-89b1-ccc4999867ee-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.479926 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.479402    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a085317e-2f97-48b4-89b1-ccc4999867ee-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.479926 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.479411    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a085317e-2f97-48b4-89b1-ccc4999867ee-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.479926 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.479872    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a085317e-2f97-48b4-89b1-ccc4999867ee-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.480261 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.480051    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a085317e-2f97-48b4-89b1-ccc4999867ee-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.480622 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.480594    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a085317e-2f97-48b4-89b1-ccc4999867ee-config\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.480798 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.480779    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a085317e-2f97-48b4-89b1-ccc4999867ee-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.481062 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.481038    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a085317e-2f97-48b4-89b1-ccc4999867ee-web-config\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.481398 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.481369    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a085317e-2f97-48b4-89b1-ccc4999867ee-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.481534 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.481418    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a085317e-2f97-48b4-89b1-ccc4999867ee-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.482069 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.482046    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a085317e-2f97-48b4-89b1-ccc4999867ee-config-out\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.482261 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.482141    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a085317e-2f97-48b4-89b1-ccc4999867ee-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.482611 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.482583    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a085317e-2f97-48b4-89b1-ccc4999867ee-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.483015 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.482995    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a085317e-2f97-48b4-89b1-ccc4999867ee-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.488261 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.488241    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lb4s6\" (UniqueName: \"kubernetes.io/projected/a085317e-2f97-48b4-89b1-ccc4999867ee-kube-api-access-lb4s6\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.979850 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.979816    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a085317e-2f97-48b4-89b1-ccc4999867ee-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:49.980654 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:49.980632    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a085317e-2f97-48b4-89b1-ccc4999867ee-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:50.242585 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:50.242490    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:15:50.399581 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:50.399501    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 12:15:50.403249 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:15:50.403218    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda085317e_2f97_48b4_89b1_ccc4999867ee.slice/crio-c2d8a447d6a12810308c3606a0f57e88c7304132106f537fbddc74ea5a362165 WatchSource:0}: Error finding container c2d8a447d6a12810308c3606a0f57e88c7304132106f537fbddc74ea5a362165: Status 404 returned error can't find the container with id c2d8a447d6a12810308c3606a0f57e88c7304132106f537fbddc74ea5a362165
Jul 15 12:15:51.357656 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:51.357605    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-785c48688d-c9ktm" event={"ID":"1edd91c2-6b3b-4fbf-8741-a8c5aef90d19","Type":"ContainerStarted","Data":"5971569c1e3d2e3437315e48ed5768343070507ef3659a7d54d3cd78e3c9e34e"}
Jul 15 12:15:51.358921 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:51.358884    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a085317e-2f97-48b4-89b1-ccc4999867ee","Type":"ContainerStarted","Data":"c2d8a447d6a12810308c3606a0f57e88c7304132106f537fbddc74ea5a362165"}
Jul 15 12:15:51.376346 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:51.376278    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-785c48688d-c9ktm" podStartSLOduration=2.604558757 podStartE2EDuration="4.376262914s" totalImagesPullingTime="1.771704157s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:15:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:15:51.376014265 +0000 UTC m=+298.490408035" watchObservedRunningTime="2026-07-15 12:15:51.376262914 +0000 UTC m=+298.490656645"
Jul 15 12:15:52.364097 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:52.364019    2560 generic.go:356] "Generic (PLEG): container finished" podID="a085317e-2f97-48b4-89b1-ccc4999867ee" containerID="137b058490fe206027cae4e2e227a05d6aa9ae710ffa62534a37e98a4e5c3f27" exitCode=0
Jul 15 12:15:52.364479 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:52.364105    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a085317e-2f97-48b4-89b1-ccc4999867ee","Type":"ContainerDied","Data":"137b058490fe206027cae4e2e227a05d6aa9ae710ffa62534a37e98a4e5c3f27"}
Jul 15 12:15:52.366288 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:52.366266    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6c949778c8-hcsbr" event={"ID":"2f5d3954-3ef3-4f63-8574-74b146786b83","Type":"ContainerStarted","Data":"b1c718843f8de67f9fe4400142f6d277be52fa7e6e2a67292655baabf8639d9c"}
Jul 15 12:15:52.366413 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:52.366328    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6c949778c8-hcsbr" event={"ID":"2f5d3954-3ef3-4f63-8574-74b146786b83","Type":"ContainerStarted","Data":"fbc0a46dd330cf462d0c01eb69431a0a48a200aa0dbc4099dae9d4e6f0ff8f0c"}
Jul 15 12:15:52.366413 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:52.366361    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6c949778c8-hcsbr" event={"ID":"2f5d3954-3ef3-4f63-8574-74b146786b83","Type":"ContainerStarted","Data":"c25e8b091f2047c1bc16cc099584cbb4a897fdd6cd14b5243f669d0e35f98d96"}
Jul 15 12:15:52.411765 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:52.411723    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6c949778c8-hcsbr" podStartSLOduration=1.511127196 podStartE2EDuration="4.411709313s" totalImagesPullingTime="2.900582117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:15:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:15:52.409620312 +0000 UTC m=+299.524014045" watchObservedRunningTime="2026-07-15 12:15:52.411709313 +0000 UTC m=+299.526103044"
Jul 15 12:15:53.326444 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:53.326414    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xkvbf_641b0ffa-0450-4198-8066-0241ab179822/console-operator/2.log"
Jul 15 12:15:53.327056 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:53.327031    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xkvbf_641b0ffa-0450-4198-8066-0241ab179822/console-operator/2.log"
Jul 15 12:15:53.337206 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:53.337187    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xh4rs_2de62ab2-7502-4c13-a6f0-5ebbd4982798/ovn-acl-logging/0.log"
Jul 15 12:15:53.337882 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:53.337856    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xh4rs_2de62ab2-7502-4c13-a6f0-5ebbd4982798/ovn-acl-logging/0.log"
Jul 15 12:15:53.341525 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:53.341356    2560 kubelet.go:1648] "Image garbage collection succeeded"
Jul 15 12:15:55.860634 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:55.860612    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 12:15:56.328491 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:56.328462    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-sfm96"
Jul 15 12:15:56.387506 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:56.387470    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a085317e-2f97-48b4-89b1-ccc4999867ee","Type":"ContainerStarted","Data":"641ce97c1546ca948a88c3139c035a26a03e5968b7d89936bbd2e1af175cb5d5"}
Jul 15 12:15:56.387682 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:56.387589    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a085317e-2f97-48b4-89b1-ccc4999867ee","Type":"ContainerStarted","Data":"c6fe5d04bff1f60c02fdf254e2516f10bf093de8f353baefdedb0002a831882f"}
Jul 15 12:15:56.438778 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:56.438750    2560 scope.go:117] "RemoveContainer" containerID="8ec41de9d90fec224ae463256e06d5d504a2332877342f355ca9537ff978a69a"
Jul 15 12:15:57.394273 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:57.394243    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xkvbf_641b0ffa-0450-4198-8066-0241ab179822/console-operator/2.log"
Jul 15 12:15:57.394717 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:57.394325    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-xkvbf" event={"ID":"641b0ffa-0450-4198-8066-0241ab179822","Type":"ContainerStarted","Data":"1579b99d13e4dc34ebac6c69d60b3b647483e746839a35d2a8970916ffe6716b"}
Jul 15 12:15:57.394717 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:57.394600    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-xkvbf"
Jul 15 12:15:57.399612 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:57.399589    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-xkvbf"
Jul 15 12:15:57.414016 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:57.413965    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-xkvbf" podStartSLOduration=55.773336708 podStartE2EDuration="59.413949954s" totalImagesPullingTime="3.640613246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:14:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:15:57.412305067 +0000 UTC m=+304.526698792" watchObservedRunningTime="2026-07-15 12:15:57.413949954 +0000 UTC m=+304.528343689"
Jul 15 12:15:58.402333 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:58.402278    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a085317e-2f97-48b4-89b1-ccc4999867ee","Type":"ContainerStarted","Data":"c2fb2fd7a0d90aa476b17a2260060874c6760819a06a2c36a961c67d4683025c"}
Jul 15 12:15:58.402854 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:58.402369    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a085317e-2f97-48b4-89b1-ccc4999867ee","Type":"ContainerStarted","Data":"c120565c169ba45a4393b26a8990876a3d385ce6ea4db8e600f515bcf05e14c8"}
Jul 15 12:15:58.402854 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:58.402399    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a085317e-2f97-48b4-89b1-ccc4999867ee","Type":"ContainerStarted","Data":"46bdfd7fa6416abfd7cf363292c5d4e8c6a2288b575fffd1f437bec3ef7b00be"}
Jul 15 12:15:58.402854 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:58.402429    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a085317e-2f97-48b4-89b1-ccc4999867ee","Type":"ContainerStarted","Data":"8cccb471f5a301b5950c3c373cebd321ae31895732c4843a08652ee2271210ca"}
Jul 15 12:15:58.433281 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:15:58.433216    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.278810413 podStartE2EDuration="9.433195437s" totalImagesPullingTime="7.133741266s" totalInitContainerRuntime="20.643758ms" isStatefulPod=false podCreationTimestamp="2026-07-15 12:15:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:15:58.431255153 +0000 UTC m=+305.545648876" watchObservedRunningTime="2026-07-15 12:15:58.433195437 +0000 UTC m=+305.547589172"
Jul 15 12:16:00.243119 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:00.243089    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:16:00.571121 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:00.571027    2560 patch_prober.go:28] interesting pod/image-registry-5dc4f89c55-8fdlw container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 15 12:16:00.571121 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:00.571090    2560 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5dc4f89c55-8fdlw" podUID="c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 12:16:02.282913 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:02.282885    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5dc4f89c55-8fdlw"
Jul 15 12:16:02.463348 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:02.463312    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5dc4f89c55-8fdlw"]
Jul 15 12:16:04.438683 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:04.438651    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spl8b"
Jul 15 12:16:07.771623 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:07.771589    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-785c48688d-c9ktm"
Jul 15 12:16:07.772187 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:07.771657    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-785c48688d-c9ktm"
Jul 15 12:16:08.444427 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:08.444341    2560 generic.go:356] "Generic (PLEG): container finished" podID="f428cec4-6a61-47e3-b3bc-0ebed3a86af4" containerID="4617a8b666c64a01b6a027a4ce2409b4b60317544a01f9b5d94926bd1a50847e" exitCode=0
Jul 15 12:16:08.444427 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:08.444412    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pgjww" event={"ID":"f428cec4-6a61-47e3-b3bc-0ebed3a86af4","Type":"ContainerDied","Data":"4617a8b666c64a01b6a027a4ce2409b4b60317544a01f9b5d94926bd1a50847e"}
Jul 15 12:16:08.444790 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:08.444771    2560 scope.go:117] "RemoveContainer" containerID="4617a8b666c64a01b6a027a4ce2409b4b60317544a01f9b5d94926bd1a50847e"
Jul 15 12:16:09.449654 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:09.449619    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pgjww" event={"ID":"f428cec4-6a61-47e3-b3bc-0ebed3a86af4","Type":"ContainerStarted","Data":"b388a4e6a845f0af7bec7d95e7e8dfd8f598a3955b0791601d8f284b774791c5"}
Jul 15 12:16:24.511158 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:24.511126    2560 generic.go:356] "Generic (PLEG): container finished" podID="2680af55-84b9-40bf-a06e-de77387a3e33" containerID="ef841b59fdc1bc28e35a3b656376923a85aa00154952aa47ddbdf0a6978f2c64" exitCode=0
Jul 15 12:16:24.511613 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:24.511166    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nb955" event={"ID":"2680af55-84b9-40bf-a06e-de77387a3e33","Type":"ContainerDied","Data":"ef841b59fdc1bc28e35a3b656376923a85aa00154952aa47ddbdf0a6978f2c64"}
Jul 15 12:16:24.511613 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:24.511477    2560 scope.go:117] "RemoveContainer" containerID="ef841b59fdc1bc28e35a3b656376923a85aa00154952aa47ddbdf0a6978f2c64"
Jul 15 12:16:25.517217 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:25.517187    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nb955" event={"ID":"2680af55-84b9-40bf-a06e-de77387a3e33","Type":"ContainerStarted","Data":"e34b9744991f9f4f384c36218d013c17ba4d8556e150e2fca134eee5be8a81ca"}
Jul 15 12:16:27.485791 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:27.485745    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5dc4f89c55-8fdlw" podUID="c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece" containerName="registry" containerID="cri-o://f94d4499dafc11aed4521a9a289f9c18e8035a7dcb2457c2b2975c764fbdd200" gracePeriod=30
Jul 15 12:16:27.727526 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:27.727502    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5dc4f89c55-8fdlw"
Jul 15 12:16:27.777174 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:27.777111    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-785c48688d-c9ktm"
Jul 15 12:16:27.781721 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:27.781702    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-785c48688d-c9ktm"
Jul 15 12:16:27.841074 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:27.841042    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-msc78\" (UniqueName: \"kubernetes.io/projected/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-kube-api-access-msc78\") pod \"c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece\" (UID: \"c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece\") "
Jul 15 12:16:27.841228 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:27.841123    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-installation-pull-secrets\") pod \"c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece\" (UID: \"c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece\") "
Jul 15 12:16:27.841228 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:27.841155    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-image-registry-private-configuration\") pod \"c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece\" (UID: \"c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece\") "
Jul 15 12:16:27.841228 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:27.841215    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-registry-tls\") pod \"c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece\" (UID: \"c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece\") "
Jul 15 12:16:27.841399 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:27.841252    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-bound-sa-token\") pod \"c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece\" (UID: \"c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece\") "
Jul 15 12:16:27.841399 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:27.841288    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-trusted-ca\") pod \"c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece\" (UID: \"c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece\") "
Jul 15 12:16:27.841517 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:27.841492    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-registry-certificates\") pod \"c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece\" (UID: \"c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece\") "
Jul 15 12:16:27.841624 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:27.841600    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-ca-trust-extracted\") pod \"c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece\" (UID: \"c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece\") "
Jul 15 12:16:27.842749 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:27.842062    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece" (UID: "c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:16:27.842953 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:27.842930    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece" (UID: "c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:16:27.844052 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:27.844023    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece" (UID: "c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:16:27.844159 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:27.844141    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece" (UID: "c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:16:27.844243 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:27.844217    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-kube-api-access-msc78" (OuterVolumeSpecName: "kube-api-access-msc78") pod "c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece" (UID: "c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece"). InnerVolumeSpecName "kube-api-access-msc78". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:16:27.844622 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:27.844596    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece" (UID: "c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:16:27.845047 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:27.845018    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece" (UID: "c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:16:27.850760 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:27.850732    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece" (UID: "c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:16:27.942465 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:27.942432    2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-registry-tls\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:16:27.942465 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:27.942458    2560 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-bound-sa-token\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:16:27.942465 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:27.942467    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-trusted-ca\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:16:27.942677 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:27.942474    2560 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-registry-certificates\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:16:27.942677 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:27.942485    2560 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-ca-trust-extracted\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:16:27.942677 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:27.942493    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-msc78\" (UniqueName: \"kubernetes.io/projected/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-kube-api-access-msc78\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:16:27.942677 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:27.942501    2560 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-installation-pull-secrets\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:16:27.942677 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:27.942512    2560 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece-image-registry-private-configuration\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:16:28.531183 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:28.531145    2560 generic.go:356] "Generic (PLEG): container finished" podID="c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece" containerID="f94d4499dafc11aed4521a9a289f9c18e8035a7dcb2457c2b2975c764fbdd200" exitCode=0
Jul 15 12:16:28.532443 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:28.532424    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5dc4f89c55-8fdlw"
Jul 15 12:16:28.532569 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:28.532416    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5dc4f89c55-8fdlw" event={"ID":"c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece","Type":"ContainerDied","Data":"f94d4499dafc11aed4521a9a289f9c18e8035a7dcb2457c2b2975c764fbdd200"}
Jul 15 12:16:28.532632 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:28.532602    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5dc4f89c55-8fdlw" event={"ID":"c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece","Type":"ContainerDied","Data":"5b3d5023ae5e7cf2fcd67d16895310084893c23d6388ea163a502e2699b3b265"}
Jul 15 12:16:28.532684 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:28.532631    2560 scope.go:117] "RemoveContainer" containerID="f94d4499dafc11aed4521a9a289f9c18e8035a7dcb2457c2b2975c764fbdd200"
Jul 15 12:16:28.542888 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:28.542870    2560 scope.go:117] "RemoveContainer" containerID="f94d4499dafc11aed4521a9a289f9c18e8035a7dcb2457c2b2975c764fbdd200"
Jul 15 12:16:28.543144 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:16:28.543122    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f94d4499dafc11aed4521a9a289f9c18e8035a7dcb2457c2b2975c764fbdd200\": container with ID starting with f94d4499dafc11aed4521a9a289f9c18e8035a7dcb2457c2b2975c764fbdd200 not found: ID does not exist" containerID="f94d4499dafc11aed4521a9a289f9c18e8035a7dcb2457c2b2975c764fbdd200"
Jul 15 12:16:28.543212 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:28.543158    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f94d4499dafc11aed4521a9a289f9c18e8035a7dcb2457c2b2975c764fbdd200"} err="failed to get container status \"f94d4499dafc11aed4521a9a289f9c18e8035a7dcb2457c2b2975c764fbdd200\": rpc error: code = NotFound desc = could not find container \"f94d4499dafc11aed4521a9a289f9c18e8035a7dcb2457c2b2975c764fbdd200\": container with ID starting with f94d4499dafc11aed4521a9a289f9c18e8035a7dcb2457c2b2975c764fbdd200 not found: ID does not exist"
Jul 15 12:16:28.554366 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:28.554345    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5dc4f89c55-8fdlw"]
Jul 15 12:16:28.556398 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:28.556376    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5dc4f89c55-8fdlw"]
Jul 15 12:16:29.443277 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:29.443239    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece" path="/var/lib/kubelet/pods/c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece/volumes"
Jul 15 12:16:33.552484 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:33.552450    2560 generic.go:356] "Generic (PLEG): container finished" podID="72392327-8bf2-4751-a503-370287b57cbb" containerID="ebfda290a0481dca9a4d54791d72211a14f1aae2542aa7c43157b9d82b945766" exitCode=0
Jul 15 12:16:33.552964 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:33.552488    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-vl5tg" event={"ID":"72392327-8bf2-4751-a503-370287b57cbb","Type":"ContainerDied","Data":"ebfda290a0481dca9a4d54791d72211a14f1aae2542aa7c43157b9d82b945766"}
Jul 15 12:16:33.552964 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:33.552864    2560 scope.go:117] "RemoveContainer" containerID="ebfda290a0481dca9a4d54791d72211a14f1aae2542aa7c43157b9d82b945766"
Jul 15 12:16:34.558183 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:34.558150    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-vl5tg" event={"ID":"72392327-8bf2-4751-a503-370287b57cbb","Type":"ContainerStarted","Data":"17de6e0786c06e8a7f27234eb920be6b9b955c57f2d693cca89557739b13649a"}
Jul 15 12:16:50.243720 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:50.243635    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:16:50.262955 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:50.262931    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:16:50.638963 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:16:50.638898    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:07.290946 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:07.290913    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19938f5e-4b2c-45f8-9077-4fb510687262-metrics-certs\") pod \"network-metrics-daemon-spl8b\" (UID: \"19938f5e-4b2c-45f8-9077-4fb510687262\") " pod="openshift-multus/network-metrics-daemon-spl8b"
Jul 15 12:17:07.293426 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:07.293391    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19938f5e-4b2c-45f8-9077-4fb510687262-metrics-certs\") pod \"network-metrics-daemon-spl8b\" (UID: \"19938f5e-4b2c-45f8-9077-4fb510687262\") " pod="openshift-multus/network-metrics-daemon-spl8b"
Jul 15 12:17:07.442355 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:07.442328    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5qgtr\""
Jul 15 12:17:07.450662 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:07.450627    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spl8b"
Jul 15 12:17:07.598386 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:07.598253    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-spl8b"]
Jul 15 12:17:07.600718 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:17:07.600690    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19938f5e_4b2c_45f8_9077_4fb510687262.slice/crio-65a7852f1854bd1cf2cf79e3acf5a98f68cb6b24766dfdf34bcf0928e00f346a WatchSource:0}: Error finding container 65a7852f1854bd1cf2cf79e3acf5a98f68cb6b24766dfdf34bcf0928e00f346a: Status 404 returned error can't find the container with id 65a7852f1854bd1cf2cf79e3acf5a98f68cb6b24766dfdf34bcf0928e00f346a
Jul 15 12:17:07.668605 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:07.668567    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 12:17:07.668914 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:07.668871    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a085317e-2f97-48b4-89b1-ccc4999867ee" containerName="prometheus" containerID="cri-o://c6fe5d04bff1f60c02fdf254e2516f10bf093de8f353baefdedb0002a831882f" gracePeriod=600
Jul 15 12:17:07.669063 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:07.668892    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a085317e-2f97-48b4-89b1-ccc4999867ee" containerName="kube-rbac-proxy" containerID="cri-o://c120565c169ba45a4393b26a8990876a3d385ce6ea4db8e600f515bcf05e14c8" gracePeriod=600
Jul 15 12:17:07.669063 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:07.668929    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a085317e-2f97-48b4-89b1-ccc4999867ee" containerName="kube-rbac-proxy-thanos" containerID="cri-o://c2fb2fd7a0d90aa476b17a2260060874c6760819a06a2c36a961c67d4683025c" gracePeriod=600
Jul 15 12:17:07.669063 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:07.668943    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a085317e-2f97-48b4-89b1-ccc4999867ee" containerName="thanos-sidecar" containerID="cri-o://8cccb471f5a301b5950c3c373cebd321ae31895732c4843a08652ee2271210ca" gracePeriod=600
Jul 15 12:17:07.669063 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:07.668935    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a085317e-2f97-48b4-89b1-ccc4999867ee" containerName="kube-rbac-proxy-web" containerID="cri-o://46bdfd7fa6416abfd7cf363292c5d4e8c6a2288b575fffd1f437bec3ef7b00be" gracePeriod=600
Jul 15 12:17:07.669063 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:07.668969    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a085317e-2f97-48b4-89b1-ccc4999867ee" containerName="config-reloader" containerID="cri-o://641ce97c1546ca948a88c3139c035a26a03e5968b7d89936bbd2e1af175cb5d5" gracePeriod=600
Jul 15 12:17:07.695565 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:07.693512    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-spl8b" event={"ID":"19938f5e-4b2c-45f8-9077-4fb510687262","Type":"ContainerStarted","Data":"65a7852f1854bd1cf2cf79e3acf5a98f68cb6b24766dfdf34bcf0928e00f346a"}
Jul 15 12:17:08.700354 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:08.700322    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-spl8b" event={"ID":"19938f5e-4b2c-45f8-9077-4fb510687262","Type":"ContainerStarted","Data":"580644594c24706935681a97ad07c13283f018048e58db5413ce041ca418a4e3"}
Jul 15 12:17:08.700721 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:08.700382    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-spl8b" event={"ID":"19938f5e-4b2c-45f8-9077-4fb510687262","Type":"ContainerStarted","Data":"2c42c59806256bf40d0167dbf28f17586b0d001aaa6d070e754ebfb29623f529"}
Jul 15 12:17:08.703822 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:08.703798    2560 generic.go:356] "Generic (PLEG): container finished" podID="a085317e-2f97-48b4-89b1-ccc4999867ee" containerID="c2fb2fd7a0d90aa476b17a2260060874c6760819a06a2c36a961c67d4683025c" exitCode=0
Jul 15 12:17:08.703822 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:08.703818    2560 generic.go:356] "Generic (PLEG): container finished" podID="a085317e-2f97-48b4-89b1-ccc4999867ee" containerID="c120565c169ba45a4393b26a8990876a3d385ce6ea4db8e600f515bcf05e14c8" exitCode=0
Jul 15 12:17:08.703985 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:08.703827    2560 generic.go:356] "Generic (PLEG): container finished" podID="a085317e-2f97-48b4-89b1-ccc4999867ee" containerID="8cccb471f5a301b5950c3c373cebd321ae31895732c4843a08652ee2271210ca" exitCode=0
Jul 15 12:17:08.703985 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:08.703833    2560 generic.go:356] "Generic (PLEG): container finished" podID="a085317e-2f97-48b4-89b1-ccc4999867ee" containerID="641ce97c1546ca948a88c3139c035a26a03e5968b7d89936bbd2e1af175cb5d5" exitCode=0
Jul 15 12:17:08.703985 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:08.703838    2560 generic.go:356] "Generic (PLEG): container finished" podID="a085317e-2f97-48b4-89b1-ccc4999867ee" containerID="c6fe5d04bff1f60c02fdf254e2516f10bf093de8f353baefdedb0002a831882f" exitCode=0
Jul 15 12:17:08.703985 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:08.703833    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a085317e-2f97-48b4-89b1-ccc4999867ee","Type":"ContainerDied","Data":"c2fb2fd7a0d90aa476b17a2260060874c6760819a06a2c36a961c67d4683025c"}
Jul 15 12:17:08.703985 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:08.703906    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a085317e-2f97-48b4-89b1-ccc4999867ee","Type":"ContainerDied","Data":"c120565c169ba45a4393b26a8990876a3d385ce6ea4db8e600f515bcf05e14c8"}
Jul 15 12:17:08.703985 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:08.703949    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a085317e-2f97-48b4-89b1-ccc4999867ee","Type":"ContainerDied","Data":"8cccb471f5a301b5950c3c373cebd321ae31895732c4843a08652ee2271210ca"}
Jul 15 12:17:08.704213 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:08.703988    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a085317e-2f97-48b4-89b1-ccc4999867ee","Type":"ContainerDied","Data":"641ce97c1546ca948a88c3139c035a26a03e5968b7d89936bbd2e1af175cb5d5"}
Jul 15 12:17:08.704213 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:08.704028    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a085317e-2f97-48b4-89b1-ccc4999867ee","Type":"ContainerDied","Data":"c6fe5d04bff1f60c02fdf254e2516f10bf093de8f353baefdedb0002a831882f"}
Jul 15 12:17:08.716764 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:08.716724    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-spl8b" podStartSLOduration=373.790401686 podStartE2EDuration="6m14.716709433s" totalImagesPullingTime="926.307747ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:10:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:17:08.714418117 +0000 UTC m=+375.828811848" watchObservedRunningTime="2026-07-15 12:17:08.716709433 +0000 UTC m=+375.831103164"
Jul 15 12:17:08.908314 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:08.908279    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.006869 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.006835    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a085317e-2f97-48b4-89b1-ccc4999867ee-prometheus-k8s-rulefiles-1\") pod \"a085317e-2f97-48b4-89b1-ccc4999867ee\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") "
Jul 15 12:17:09.006869 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.006871    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a085317e-2f97-48b4-89b1-ccc4999867ee-config-out\") pod \"a085317e-2f97-48b4-89b1-ccc4999867ee\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") "
Jul 15 12:17:09.007105 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.006889    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a085317e-2f97-48b4-89b1-ccc4999867ee-tls-assets\") pod \"a085317e-2f97-48b4-89b1-ccc4999867ee\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") "
Jul 15 12:17:09.007105 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.006907    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a085317e-2f97-48b4-89b1-ccc4999867ee-configmap-serving-certs-ca-bundle\") pod \"a085317e-2f97-48b4-89b1-ccc4999867ee\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") "
Jul 15 12:17:09.007105 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.006930    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a085317e-2f97-48b4-89b1-ccc4999867ee-thanos-prometheus-http-client-file\") pod \"a085317e-2f97-48b4-89b1-ccc4999867ee\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") "
Jul 15 12:17:09.007105 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.006946    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a085317e-2f97-48b4-89b1-ccc4999867ee-secret-metrics-client-certs\") pod \"a085317e-2f97-48b4-89b1-ccc4999867ee\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") "
Jul 15 12:17:09.007105 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.007032    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lb4s6\" (UniqueName: \"kubernetes.io/projected/a085317e-2f97-48b4-89b1-ccc4999867ee-kube-api-access-lb4s6\") pod \"a085317e-2f97-48b4-89b1-ccc4999867ee\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") "
Jul 15 12:17:09.007105 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.007081    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a085317e-2f97-48b4-89b1-ccc4999867ee-prometheus-trusted-ca-bundle\") pod \"a085317e-2f97-48b4-89b1-ccc4999867ee\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") "
Jul 15 12:17:09.007420 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.007117    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a085317e-2f97-48b4-89b1-ccc4999867ee-web-config\") pod \"a085317e-2f97-48b4-89b1-ccc4999867ee\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") "
Jul 15 12:17:09.007420 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.007167    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a085317e-2f97-48b4-89b1-ccc4999867ee-prometheus-k8s-rulefiles-2\") pod \"a085317e-2f97-48b4-89b1-ccc4999867ee\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") "
Jul 15 12:17:09.007420 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.007193    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a085317e-2f97-48b4-89b1-ccc4999867ee-prometheus-k8s-db\") pod \"a085317e-2f97-48b4-89b1-ccc4999867ee\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") "
Jul 15 12:17:09.007420 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.007238    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a085317e-2f97-48b4-89b1-ccc4999867ee-secret-kube-rbac-proxy\") pod \"a085317e-2f97-48b4-89b1-ccc4999867ee\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") "
Jul 15 12:17:09.007420 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.007278    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a085317e-2f97-48b4-89b1-ccc4999867ee-configmap-kubelet-serving-ca-bundle\") pod \"a085317e-2f97-48b4-89b1-ccc4999867ee\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") "
Jul 15 12:17:09.007420 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.007331    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a085317e-2f97-48b4-89b1-ccc4999867ee-prometheus-k8s-rulefiles-0\") pod \"a085317e-2f97-48b4-89b1-ccc4999867ee\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") "
Jul 15 12:17:09.007420 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.007351    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a085317e-2f97-48b4-89b1-ccc4999867ee-secret-grpc-tls\") pod \"a085317e-2f97-48b4-89b1-ccc4999867ee\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") "
Jul 15 12:17:09.007420 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.007367    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a085317e-2f97-48b4-89b1-ccc4999867ee-config\") pod \"a085317e-2f97-48b4-89b1-ccc4999867ee\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") "
Jul 15 12:17:09.007420 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.007391    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a085317e-2f97-48b4-89b1-ccc4999867ee-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"a085317e-2f97-48b4-89b1-ccc4999867ee\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") "
Jul 15 12:17:09.007420 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.007419    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a085317e-2f97-48b4-89b1-ccc4999867ee-secret-prometheus-k8s-tls\") pod \"a085317e-2f97-48b4-89b1-ccc4999867ee\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") "
Jul 15 12:17:09.007848 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.007447    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a085317e-2f97-48b4-89b1-ccc4999867ee-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"a085317e-2f97-48b4-89b1-ccc4999867ee\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") "
Jul 15 12:17:09.007848 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.007488    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a085317e-2f97-48b4-89b1-ccc4999867ee-configmap-metrics-client-ca\") pod \"a085317e-2f97-48b4-89b1-ccc4999867ee\" (UID: \"a085317e-2f97-48b4-89b1-ccc4999867ee\") "
Jul 15 12:17:09.007949 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.007880    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a085317e-2f97-48b4-89b1-ccc4999867ee-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "a085317e-2f97-48b4-89b1-ccc4999867ee" (UID: "a085317e-2f97-48b4-89b1-ccc4999867ee"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:17:09.008479 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.008035    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a085317e-2f97-48b4-89b1-ccc4999867ee-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "a085317e-2f97-48b4-89b1-ccc4999867ee" (UID: "a085317e-2f97-48b4-89b1-ccc4999867ee"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:17:09.008479 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.008202    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a085317e-2f97-48b4-89b1-ccc4999867ee-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "a085317e-2f97-48b4-89b1-ccc4999867ee" (UID: "a085317e-2f97-48b4-89b1-ccc4999867ee"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:17:09.008479 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.008265    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a085317e-2f97-48b4-89b1-ccc4999867ee-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "a085317e-2f97-48b4-89b1-ccc4999867ee" (UID: "a085317e-2f97-48b4-89b1-ccc4999867ee"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:17:09.008479 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.008277    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a085317e-2f97-48b4-89b1-ccc4999867ee-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "a085317e-2f97-48b4-89b1-ccc4999867ee" (UID: "a085317e-2f97-48b4-89b1-ccc4999867ee"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:17:09.009443 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.009409    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a085317e-2f97-48b4-89b1-ccc4999867ee-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "a085317e-2f97-48b4-89b1-ccc4999867ee" (UID: "a085317e-2f97-48b4-89b1-ccc4999867ee"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:17:09.009558 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.009453    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a085317e-2f97-48b4-89b1-ccc4999867ee-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "a085317e-2f97-48b4-89b1-ccc4999867ee" (UID: "a085317e-2f97-48b4-89b1-ccc4999867ee"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:17:09.010119 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.010090    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a085317e-2f97-48b4-89b1-ccc4999867ee-config-out" (OuterVolumeSpecName: "config-out") pod "a085317e-2f97-48b4-89b1-ccc4999867ee" (UID: "a085317e-2f97-48b4-89b1-ccc4999867ee"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:17:09.010213 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.010096    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a085317e-2f97-48b4-89b1-ccc4999867ee-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "a085317e-2f97-48b4-89b1-ccc4999867ee" (UID: "a085317e-2f97-48b4-89b1-ccc4999867ee"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:17:09.010386 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.010364    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a085317e-2f97-48b4-89b1-ccc4999867ee-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "a085317e-2f97-48b4-89b1-ccc4999867ee" (UID: "a085317e-2f97-48b4-89b1-ccc4999867ee"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:17:09.011032 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.010991    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a085317e-2f97-48b4-89b1-ccc4999867ee-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "a085317e-2f97-48b4-89b1-ccc4999867ee" (UID: "a085317e-2f97-48b4-89b1-ccc4999867ee"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:17:09.011121 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.011085    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a085317e-2f97-48b4-89b1-ccc4999867ee-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "a085317e-2f97-48b4-89b1-ccc4999867ee" (UID: "a085317e-2f97-48b4-89b1-ccc4999867ee"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:17:09.011691 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.011659    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a085317e-2f97-48b4-89b1-ccc4999867ee-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "a085317e-2f97-48b4-89b1-ccc4999867ee" (UID: "a085317e-2f97-48b4-89b1-ccc4999867ee"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:17:09.011918 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.011880    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a085317e-2f97-48b4-89b1-ccc4999867ee-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "a085317e-2f97-48b4-89b1-ccc4999867ee" (UID: "a085317e-2f97-48b4-89b1-ccc4999867ee"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:17:09.012183 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.012155    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a085317e-2f97-48b4-89b1-ccc4999867ee-kube-api-access-lb4s6" (OuterVolumeSpecName: "kube-api-access-lb4s6") pod "a085317e-2f97-48b4-89b1-ccc4999867ee" (UID: "a085317e-2f97-48b4-89b1-ccc4999867ee"). InnerVolumeSpecName "kube-api-access-lb4s6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:17:09.012367 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.012273    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a085317e-2f97-48b4-89b1-ccc4999867ee-config" (OuterVolumeSpecName: "config") pod "a085317e-2f97-48b4-89b1-ccc4999867ee" (UID: "a085317e-2f97-48b4-89b1-ccc4999867ee"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:17:09.012523 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.012501    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a085317e-2f97-48b4-89b1-ccc4999867ee-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "a085317e-2f97-48b4-89b1-ccc4999867ee" (UID: "a085317e-2f97-48b4-89b1-ccc4999867ee"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:17:09.012573 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.012523    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a085317e-2f97-48b4-89b1-ccc4999867ee-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "a085317e-2f97-48b4-89b1-ccc4999867ee" (UID: "a085317e-2f97-48b4-89b1-ccc4999867ee"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:17:09.012637 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.012621    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a085317e-2f97-48b4-89b1-ccc4999867ee-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "a085317e-2f97-48b4-89b1-ccc4999867ee" (UID: "a085317e-2f97-48b4-89b1-ccc4999867ee"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:17:09.021550 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.021531    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a085317e-2f97-48b4-89b1-ccc4999867ee-web-config" (OuterVolumeSpecName: "web-config") pod "a085317e-2f97-48b4-89b1-ccc4999867ee" (UID: "a085317e-2f97-48b4-89b1-ccc4999867ee"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:17:09.108838 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.108775    2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a085317e-2f97-48b4-89b1-ccc4999867ee-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:17:09.108838 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.108797    2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a085317e-2f97-48b4-89b1-ccc4999867ee-secret-prometheus-k8s-tls\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:17:09.108838 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.108808    2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a085317e-2f97-48b4-89b1-ccc4999867ee-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:17:09.108838 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.108817    2560 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a085317e-2f97-48b4-89b1-ccc4999867ee-configmap-metrics-client-ca\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:17:09.108838 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.108826    2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a085317e-2f97-48b4-89b1-ccc4999867ee-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:17:09.108838 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.108836    2560 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a085317e-2f97-48b4-89b1-ccc4999867ee-config-out\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:17:09.109091 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.108845    2560 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a085317e-2f97-48b4-89b1-ccc4999867ee-tls-assets\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:17:09.109091 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.108854    2560 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a085317e-2f97-48b4-89b1-ccc4999867ee-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:17:09.109091 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.108862    2560 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a085317e-2f97-48b4-89b1-ccc4999867ee-thanos-prometheus-http-client-file\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:17:09.109091 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.108871    2560 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a085317e-2f97-48b4-89b1-ccc4999867ee-secret-metrics-client-certs\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:17:09.109091 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.108880    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lb4s6\" (UniqueName: \"kubernetes.io/projected/a085317e-2f97-48b4-89b1-ccc4999867ee-kube-api-access-lb4s6\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:17:09.109091 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.108888    2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a085317e-2f97-48b4-89b1-ccc4999867ee-prometheus-trusted-ca-bundle\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:17:09.109091 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.108896    2560 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a085317e-2f97-48b4-89b1-ccc4999867ee-web-config\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:17:09.109091 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.108904    2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a085317e-2f97-48b4-89b1-ccc4999867ee-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:17:09.109091 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.108913    2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a085317e-2f97-48b4-89b1-ccc4999867ee-prometheus-k8s-db\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:17:09.109091 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.108923    2560 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a085317e-2f97-48b4-89b1-ccc4999867ee-secret-kube-rbac-proxy\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:17:09.109091 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.108931    2560 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a085317e-2f97-48b4-89b1-ccc4999867ee-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:17:09.109091 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.108939    2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a085317e-2f97-48b4-89b1-ccc4999867ee-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:17:09.109091 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.108947    2560 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a085317e-2f97-48b4-89b1-ccc4999867ee-secret-grpc-tls\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:17:09.109091 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.108955    2560 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/a085317e-2f97-48b4-89b1-ccc4999867ee-config\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:17:09.711713 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.711680    2560 generic.go:356] "Generic (PLEG): container finished" podID="a085317e-2f97-48b4-89b1-ccc4999867ee" containerID="46bdfd7fa6416abfd7cf363292c5d4e8c6a2288b575fffd1f437bec3ef7b00be" exitCode=0
Jul 15 12:17:09.712086 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.711758    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a085317e-2f97-48b4-89b1-ccc4999867ee","Type":"ContainerDied","Data":"46bdfd7fa6416abfd7cf363292c5d4e8c6a2288b575fffd1f437bec3ef7b00be"}
Jul 15 12:17:09.712086 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.711776    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.712086 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.711868    2560 scope.go:117] "RemoveContainer" containerID="c2fb2fd7a0d90aa476b17a2260060874c6760819a06a2c36a961c67d4683025c"
Jul 15 12:17:09.712086 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.711857    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a085317e-2f97-48b4-89b1-ccc4999867ee","Type":"ContainerDied","Data":"c2d8a447d6a12810308c3606a0f57e88c7304132106f537fbddc74ea5a362165"}
Jul 15 12:17:09.719485 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.719464    2560 scope.go:117] "RemoveContainer" containerID="c120565c169ba45a4393b26a8990876a3d385ce6ea4db8e600f515bcf05e14c8"
Jul 15 12:17:09.726103 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.726087    2560 scope.go:117] "RemoveContainer" containerID="46bdfd7fa6416abfd7cf363292c5d4e8c6a2288b575fffd1f437bec3ef7b00be"
Jul 15 12:17:09.732537 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.732520    2560 scope.go:117] "RemoveContainer" containerID="8cccb471f5a301b5950c3c373cebd321ae31895732c4843a08652ee2271210ca"
Jul 15 12:17:09.734606 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.734584    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 12:17:09.739221 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.739202    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 12:17:09.739857 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.739848    2560 scope.go:117] "RemoveContainer" containerID="641ce97c1546ca948a88c3139c035a26a03e5968b7d89936bbd2e1af175cb5d5"
Jul 15 12:17:09.746348 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.746332    2560 scope.go:117] "RemoveContainer" containerID="c6fe5d04bff1f60c02fdf254e2516f10bf093de8f353baefdedb0002a831882f"
Jul 15 12:17:09.753312 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.753280    2560 scope.go:117] "RemoveContainer" containerID="137b058490fe206027cae4e2e227a05d6aa9ae710ffa62534a37e98a4e5c3f27"
Jul 15 12:17:09.759825 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.759810    2560 scope.go:117] "RemoveContainer" containerID="c2fb2fd7a0d90aa476b17a2260060874c6760819a06a2c36a961c67d4683025c"
Jul 15 12:17:09.760079 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:17:09.760061    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2fb2fd7a0d90aa476b17a2260060874c6760819a06a2c36a961c67d4683025c\": container with ID starting with c2fb2fd7a0d90aa476b17a2260060874c6760819a06a2c36a961c67d4683025c not found: ID does not exist" containerID="c2fb2fd7a0d90aa476b17a2260060874c6760819a06a2c36a961c67d4683025c"
Jul 15 12:17:09.760148 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.760091    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2fb2fd7a0d90aa476b17a2260060874c6760819a06a2c36a961c67d4683025c"} err="failed to get container status \"c2fb2fd7a0d90aa476b17a2260060874c6760819a06a2c36a961c67d4683025c\": rpc error: code = NotFound desc = could not find container \"c2fb2fd7a0d90aa476b17a2260060874c6760819a06a2c36a961c67d4683025c\": container with ID starting with c2fb2fd7a0d90aa476b17a2260060874c6760819a06a2c36a961c67d4683025c not found: ID does not exist"
Jul 15 12:17:09.760148 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.760115    2560 scope.go:117] "RemoveContainer" containerID="c120565c169ba45a4393b26a8990876a3d385ce6ea4db8e600f515bcf05e14c8"
Jul 15 12:17:09.760368 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:17:09.760351    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c120565c169ba45a4393b26a8990876a3d385ce6ea4db8e600f515bcf05e14c8\": container with ID starting with c120565c169ba45a4393b26a8990876a3d385ce6ea4db8e600f515bcf05e14c8 not found: ID does not exist" containerID="c120565c169ba45a4393b26a8990876a3d385ce6ea4db8e600f515bcf05e14c8"
Jul 15 12:17:09.760417 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.760373    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c120565c169ba45a4393b26a8990876a3d385ce6ea4db8e600f515bcf05e14c8"} err="failed to get container status \"c120565c169ba45a4393b26a8990876a3d385ce6ea4db8e600f515bcf05e14c8\": rpc error: code = NotFound desc = could not find container \"c120565c169ba45a4393b26a8990876a3d385ce6ea4db8e600f515bcf05e14c8\": container with ID starting with c120565c169ba45a4393b26a8990876a3d385ce6ea4db8e600f515bcf05e14c8 not found: ID does not exist"
Jul 15 12:17:09.760417 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.760386    2560 scope.go:117] "RemoveContainer" containerID="46bdfd7fa6416abfd7cf363292c5d4e8c6a2288b575fffd1f437bec3ef7b00be"
Jul 15 12:17:09.760586 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:17:09.760571    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46bdfd7fa6416abfd7cf363292c5d4e8c6a2288b575fffd1f437bec3ef7b00be\": container with ID starting with 46bdfd7fa6416abfd7cf363292c5d4e8c6a2288b575fffd1f437bec3ef7b00be not found: ID does not exist" containerID="46bdfd7fa6416abfd7cf363292c5d4e8c6a2288b575fffd1f437bec3ef7b00be"
Jul 15 12:17:09.760628 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.760589    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46bdfd7fa6416abfd7cf363292c5d4e8c6a2288b575fffd1f437bec3ef7b00be"} err="failed to get container status \"46bdfd7fa6416abfd7cf363292c5d4e8c6a2288b575fffd1f437bec3ef7b00be\": rpc error: code = NotFound desc = could not find container \"46bdfd7fa6416abfd7cf363292c5d4e8c6a2288b575fffd1f437bec3ef7b00be\": container with ID starting with 46bdfd7fa6416abfd7cf363292c5d4e8c6a2288b575fffd1f437bec3ef7b00be not found: ID does not exist"
Jul 15 12:17:09.760628 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.760602    2560 scope.go:117] "RemoveContainer" containerID="8cccb471f5a301b5950c3c373cebd321ae31895732c4843a08652ee2271210ca"
Jul 15 12:17:09.760805 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:17:09.760789    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8cccb471f5a301b5950c3c373cebd321ae31895732c4843a08652ee2271210ca\": container with ID starting with 8cccb471f5a301b5950c3c373cebd321ae31895732c4843a08652ee2271210ca not found: ID does not exist" containerID="8cccb471f5a301b5950c3c373cebd321ae31895732c4843a08652ee2271210ca"
Jul 15 12:17:09.760851 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.760810    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cccb471f5a301b5950c3c373cebd321ae31895732c4843a08652ee2271210ca"} err="failed to get container status \"8cccb471f5a301b5950c3c373cebd321ae31895732c4843a08652ee2271210ca\": rpc error: code = NotFound desc = could not find container \"8cccb471f5a301b5950c3c373cebd321ae31895732c4843a08652ee2271210ca\": container with ID starting with 8cccb471f5a301b5950c3c373cebd321ae31895732c4843a08652ee2271210ca not found: ID does not exist"
Jul 15 12:17:09.760851 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.760824    2560 scope.go:117] "RemoveContainer" containerID="641ce97c1546ca948a88c3139c035a26a03e5968b7d89936bbd2e1af175cb5d5"
Jul 15 12:17:09.761015 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:17:09.761001    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"641ce97c1546ca948a88c3139c035a26a03e5968b7d89936bbd2e1af175cb5d5\": container with ID starting with 641ce97c1546ca948a88c3139c035a26a03e5968b7d89936bbd2e1af175cb5d5 not found: ID does not exist" containerID="641ce97c1546ca948a88c3139c035a26a03e5968b7d89936bbd2e1af175cb5d5"
Jul 15 12:17:09.761051 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.761018    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"641ce97c1546ca948a88c3139c035a26a03e5968b7d89936bbd2e1af175cb5d5"} err="failed to get container status \"641ce97c1546ca948a88c3139c035a26a03e5968b7d89936bbd2e1af175cb5d5\": rpc error: code = NotFound desc = could not find container \"641ce97c1546ca948a88c3139c035a26a03e5968b7d89936bbd2e1af175cb5d5\": container with ID starting with 641ce97c1546ca948a88c3139c035a26a03e5968b7d89936bbd2e1af175cb5d5 not found: ID does not exist"
Jul 15 12:17:09.761051 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.761030    2560 scope.go:117] "RemoveContainer" containerID="c6fe5d04bff1f60c02fdf254e2516f10bf093de8f353baefdedb0002a831882f"
Jul 15 12:17:09.761250 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:17:09.761232    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6fe5d04bff1f60c02fdf254e2516f10bf093de8f353baefdedb0002a831882f\": container with ID starting with c6fe5d04bff1f60c02fdf254e2516f10bf093de8f353baefdedb0002a831882f not found: ID does not exist" containerID="c6fe5d04bff1f60c02fdf254e2516f10bf093de8f353baefdedb0002a831882f"
Jul 15 12:17:09.761286 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.761254    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6fe5d04bff1f60c02fdf254e2516f10bf093de8f353baefdedb0002a831882f"} err="failed to get container status \"c6fe5d04bff1f60c02fdf254e2516f10bf093de8f353baefdedb0002a831882f\": rpc error: code = NotFound desc = could not find container \"c6fe5d04bff1f60c02fdf254e2516f10bf093de8f353baefdedb0002a831882f\": container with ID starting with c6fe5d04bff1f60c02fdf254e2516f10bf093de8f353baefdedb0002a831882f not found: ID does not exist"
Jul 15 12:17:09.761286 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.761266    2560 scope.go:117] "RemoveContainer" containerID="137b058490fe206027cae4e2e227a05d6aa9ae710ffa62534a37e98a4e5c3f27"
Jul 15 12:17:09.761529 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:17:09.761510    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"137b058490fe206027cae4e2e227a05d6aa9ae710ffa62534a37e98a4e5c3f27\": container with ID starting with 137b058490fe206027cae4e2e227a05d6aa9ae710ffa62534a37e98a4e5c3f27 not found: ID does not exist" containerID="137b058490fe206027cae4e2e227a05d6aa9ae710ffa62534a37e98a4e5c3f27"
Jul 15 12:17:09.761607 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.761531    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"137b058490fe206027cae4e2e227a05d6aa9ae710ffa62534a37e98a4e5c3f27"} err="failed to get container status \"137b058490fe206027cae4e2e227a05d6aa9ae710ffa62534a37e98a4e5c3f27\": rpc error: code = NotFound desc = could not find container \"137b058490fe206027cae4e2e227a05d6aa9ae710ffa62534a37e98a4e5c3f27\": container with ID starting with 137b058490fe206027cae4e2e227a05d6aa9ae710ffa62534a37e98a4e5c3f27 not found: ID does not exist"
Jul 15 12:17:09.765862 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.765842    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 12:17:09.766145 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.766117    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a085317e-2f97-48b4-89b1-ccc4999867ee" containerName="config-reloader"
Jul 15 12:17:09.766145 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.766131    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a085317e-2f97-48b4-89b1-ccc4999867ee" containerName="config-reloader"
Jul 15 12:17:09.766145 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.766140    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a085317e-2f97-48b4-89b1-ccc4999867ee" containerName="kube-rbac-proxy-thanos"
Jul 15 12:17:09.766257 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.766147    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a085317e-2f97-48b4-89b1-ccc4999867ee" containerName="kube-rbac-proxy-thanos"
Jul 15 12:17:09.766257 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.766156    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece" containerName="registry"
Jul 15 12:17:09.766257 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.766161    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece" containerName="registry"
Jul 15 12:17:09.766257 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.766171    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a085317e-2f97-48b4-89b1-ccc4999867ee" containerName="init-config-reloader"
Jul 15 12:17:09.766257 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.766176    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a085317e-2f97-48b4-89b1-ccc4999867ee" containerName="init-config-reloader"
Jul 15 12:17:09.766257 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.766182    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a085317e-2f97-48b4-89b1-ccc4999867ee" containerName="kube-rbac-proxy-web"
Jul 15 12:17:09.766257 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.766187    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a085317e-2f97-48b4-89b1-ccc4999867ee" containerName="kube-rbac-proxy-web"
Jul 15 12:17:09.766257 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.766193    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a085317e-2f97-48b4-89b1-ccc4999867ee" containerName="thanos-sidecar"
Jul 15 12:17:09.766257 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.766198    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a085317e-2f97-48b4-89b1-ccc4999867ee" containerName="thanos-sidecar"
Jul 15 12:17:09.766257 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.766209    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a085317e-2f97-48b4-89b1-ccc4999867ee" containerName="kube-rbac-proxy"
Jul 15 12:17:09.766257 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.766214    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a085317e-2f97-48b4-89b1-ccc4999867ee" containerName="kube-rbac-proxy"
Jul 15 12:17:09.766257 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.766219    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a085317e-2f97-48b4-89b1-ccc4999867ee" containerName="prometheus"
Jul 15 12:17:09.766257 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.766224    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a085317e-2f97-48b4-89b1-ccc4999867ee" containerName="prometheus"
Jul 15 12:17:09.766616 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.766268    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2bc8fd7-4eb5-420b-bb5d-ed2c595a0ece" containerName="registry"
Jul 15 12:17:09.766616 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.766276    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a085317e-2f97-48b4-89b1-ccc4999867ee" containerName="kube-rbac-proxy"
Jul 15 12:17:09.766616 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.766282    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a085317e-2f97-48b4-89b1-ccc4999867ee" containerName="kube-rbac-proxy-web"
Jul 15 12:17:09.766616 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.766287    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a085317e-2f97-48b4-89b1-ccc4999867ee" containerName="kube-rbac-proxy-thanos"
Jul 15 12:17:09.766616 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.766318    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a085317e-2f97-48b4-89b1-ccc4999867ee" containerName="config-reloader"
Jul 15 12:17:09.766616 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.766324    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a085317e-2f97-48b4-89b1-ccc4999867ee" containerName="prometheus"
Jul 15 12:17:09.766616 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.766330    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a085317e-2f97-48b4-89b1-ccc4999867ee" containerName="thanos-sidecar"
Jul 15 12:17:09.769484 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.769467    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.772224 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.772205    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 15 12:17:09.772224 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.772218    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 15 12:17:09.772463 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.772226    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 15 12:17:09.772463 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.772397    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 15 12:17:09.772616 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.772470    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 15 12:17:09.772616 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.772538    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-buuso4e137bd2\""
Jul 15 12:17:09.772616 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.772547    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 15 12:17:09.772616 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.772554    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 15 12:17:09.772616 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.772541    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 15 12:17:09.772887 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.772834    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 15 12:17:09.772887 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.772834    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-zwzh2\""
Jul 15 12:17:09.772887 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.772859    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 15 12:17:09.773057 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.772889    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 15 12:17:09.773489 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.773472    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 15 12:17:09.775964 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.775939    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 15 12:17:09.777764 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.777747    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 15 12:17:09.786842 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.786820    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 12:17:09.815195 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.815168    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a0d241a6-8ddc-4d97-8ed0-e26a89049442-config\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.815287 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.815197    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a0d241a6-8ddc-4d97-8ed0-e26a89049442-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.815287 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.815227    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a0d241a6-8ddc-4d97-8ed0-e26a89049442-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.815287 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.815248    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0d241a6-8ddc-4d97-8ed0-e26a89049442-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.815287 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.815274    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0d241a6-8ddc-4d97-8ed0-e26a89049442-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.815465 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.815311    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a0d241a6-8ddc-4d97-8ed0-e26a89049442-web-config\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.815465 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.815362    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a0d241a6-8ddc-4d97-8ed0-e26a89049442-config-out\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.815465 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.815378    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0d241a6-8ddc-4d97-8ed0-e26a89049442-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.815465 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.815407    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a0d241a6-8ddc-4d97-8ed0-e26a89049442-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.815465 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.815429    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a0d241a6-8ddc-4d97-8ed0-e26a89049442-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.815623 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.815475    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a0d241a6-8ddc-4d97-8ed0-e26a89049442-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.815623 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.815510    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a0d241a6-8ddc-4d97-8ed0-e26a89049442-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.815623 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.815535    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a0d241a6-8ddc-4d97-8ed0-e26a89049442-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.815623 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.815615    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a0d241a6-8ddc-4d97-8ed0-e26a89049442-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.815753 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.815649    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a0d241a6-8ddc-4d97-8ed0-e26a89049442-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.815753 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.815667    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a0d241a6-8ddc-4d97-8ed0-e26a89049442-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.815753 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.815683    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5bz9\" (UniqueName: \"kubernetes.io/projected/a0d241a6-8ddc-4d97-8ed0-e26a89049442-kube-api-access-z5bz9\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.815753 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.815744    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a0d241a6-8ddc-4d97-8ed0-e26a89049442-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.815887 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.815771    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0d241a6-8ddc-4d97-8ed0-e26a89049442-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.815887 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.815792    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a0d241a6-8ddc-4d97-8ed0-e26a89049442-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.916446 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.916409    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a0d241a6-8ddc-4d97-8ed0-e26a89049442-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.916446 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.916442    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a0d241a6-8ddc-4d97-8ed0-e26a89049442-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.916691 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.916470    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a0d241a6-8ddc-4d97-8ed0-e26a89049442-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.916691 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.916497    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a0d241a6-8ddc-4d97-8ed0-e26a89049442-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.916691 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.916513    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a0d241a6-8ddc-4d97-8ed0-e26a89049442-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.916691 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.916530    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5bz9\" (UniqueName: \"kubernetes.io/projected/a0d241a6-8ddc-4d97-8ed0-e26a89049442-kube-api-access-z5bz9\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.916691 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.916554    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a0d241a6-8ddc-4d97-8ed0-e26a89049442-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.916691 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.916579    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0d241a6-8ddc-4d97-8ed0-e26a89049442-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.916691 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.916607    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a0d241a6-8ddc-4d97-8ed0-e26a89049442-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.917129 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.917103    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a0d241a6-8ddc-4d97-8ed0-e26a89049442-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.917235 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.917129    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a0d241a6-8ddc-4d97-8ed0-e26a89049442-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.917235 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.917178    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a0d241a6-8ddc-4d97-8ed0-e26a89049442-config\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.917235 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.917212    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a0d241a6-8ddc-4d97-8ed0-e26a89049442-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.917769 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.917247    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a0d241a6-8ddc-4d97-8ed0-e26a89049442-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.917769 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.917283    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0d241a6-8ddc-4d97-8ed0-e26a89049442-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.917769 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.917338    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0d241a6-8ddc-4d97-8ed0-e26a89049442-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.917769 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.917364    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a0d241a6-8ddc-4d97-8ed0-e26a89049442-web-config\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.917769 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.917403    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a0d241a6-8ddc-4d97-8ed0-e26a89049442-config-out\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.917769 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.917428    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0d241a6-8ddc-4d97-8ed0-e26a89049442-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.917769 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.917464    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a0d241a6-8ddc-4d97-8ed0-e26a89049442-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.917769 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.917487    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a0d241a6-8ddc-4d97-8ed0-e26a89049442-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.917769 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.917518    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a0d241a6-8ddc-4d97-8ed0-e26a89049442-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.917769 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.917661    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0d241a6-8ddc-4d97-8ed0-e26a89049442-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.918286 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.917959    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0d241a6-8ddc-4d97-8ed0-e26a89049442-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.918942 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.918891    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a0d241a6-8ddc-4d97-8ed0-e26a89049442-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.919096 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.918945    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0d241a6-8ddc-4d97-8ed0-e26a89049442-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.919096 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.918971    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0d241a6-8ddc-4d97-8ed0-e26a89049442-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.920883 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.920836    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a0d241a6-8ddc-4d97-8ed0-e26a89049442-config-out\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.920883 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.920850    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a0d241a6-8ddc-4d97-8ed0-e26a89049442-config\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.921268 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.921227    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a0d241a6-8ddc-4d97-8ed0-e26a89049442-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.921639 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.921594    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a0d241a6-8ddc-4d97-8ed0-e26a89049442-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.921729 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.921673    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a0d241a6-8ddc-4d97-8ed0-e26a89049442-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.921729 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.921709    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a0d241a6-8ddc-4d97-8ed0-e26a89049442-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.922117 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.922094    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a0d241a6-8ddc-4d97-8ed0-e26a89049442-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.922184 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.922134    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a0d241a6-8ddc-4d97-8ed0-e26a89049442-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.922184 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.922174    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a0d241a6-8ddc-4d97-8ed0-e26a89049442-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.922632 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.922613    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a0d241a6-8ddc-4d97-8ed0-e26a89049442-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.922712 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.922664    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a0d241a6-8ddc-4d97-8ed0-e26a89049442-web-config\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.922783 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.922764    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a0d241a6-8ddc-4d97-8ed0-e26a89049442-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:09.928979 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:09.928957    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5bz9\" (UniqueName: \"kubernetes.io/projected/a0d241a6-8ddc-4d97-8ed0-e26a89049442-kube-api-access-z5bz9\") pod \"prometheus-k8s-0\" (UID: \"a0d241a6-8ddc-4d97-8ed0-e26a89049442\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:10.079858 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:10.079744    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:17:10.208049 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:10.208019    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 12:17:10.209487 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:17:10.209456    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0d241a6_8ddc_4d97_8ed0_e26a89049442.slice/crio-182913ab400c4401957c455af6ee49c82f4259f45fa47f1afd657f04f1c5dc75 WatchSource:0}: Error finding container 182913ab400c4401957c455af6ee49c82f4259f45fa47f1afd657f04f1c5dc75: Status 404 returned error can't find the container with id 182913ab400c4401957c455af6ee49c82f4259f45fa47f1afd657f04f1c5dc75
Jul 15 12:17:10.717874 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:10.717839    2560 generic.go:356] "Generic (PLEG): container finished" podID="a0d241a6-8ddc-4d97-8ed0-e26a89049442" containerID="a8a2f580b2888039c2e511d21cde5c786f558dd44ba395d0d11d99d9adeaff8b" exitCode=0
Jul 15 12:17:10.718360 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:10.717884    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a0d241a6-8ddc-4d97-8ed0-e26a89049442","Type":"ContainerDied","Data":"a8a2f580b2888039c2e511d21cde5c786f558dd44ba395d0d11d99d9adeaff8b"}
Jul 15 12:17:10.718360 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:10.717951    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a0d241a6-8ddc-4d97-8ed0-e26a89049442","Type":"ContainerStarted","Data":"182913ab400c4401957c455af6ee49c82f4259f45fa47f1afd657f04f1c5dc75"}
Jul 15 12:17:11.443239 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:11.443165    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a085317e-2f97-48b4-89b1-ccc4999867ee" path="/var/lib/kubelet/pods/a085317e-2f97-48b4-89b1-ccc4999867ee/volumes"
Jul 15 12:17:11.725863 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:11.725830    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a0d241a6-8ddc-4d97-8ed0-e26a89049442","Type":"ContainerStarted","Data":"eb8da95da5e966c4b1b7d3013e019f25652fe398988362edc95de9e22b6ba8dc"}
Jul 15 12:17:11.726213 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:11.725893    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a0d241a6-8ddc-4d97-8ed0-e26a89049442","Type":"ContainerStarted","Data":"cdb8c8aa3676d5d616b7050a5a0c6e7c757801fecefb79e858875902ed800a1e"}
Jul 15 12:17:11.726213 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:11.725918    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a0d241a6-8ddc-4d97-8ed0-e26a89049442","Type":"ContainerStarted","Data":"d625d89fafa97e9b178c6b979f3fd63a7783a9e91fbb088c32b49bbdc35ed992"}
Jul 15 12:17:11.726213 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:11.725944    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a0d241a6-8ddc-4d97-8ed0-e26a89049442","Type":"ContainerStarted","Data":"4f4f8a5568b48902fc9f9d32b00dff0690288403d3bebf82941ac865f26a8f2a"}
Jul 15 12:17:11.726213 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:11.725968    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a0d241a6-8ddc-4d97-8ed0-e26a89049442","Type":"ContainerStarted","Data":"68dcda4fd9ff4b2ca0886e884a037304b17a7c2698c534307b9edc445a2c8512"}
Jul 15 12:17:11.726213 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:11.725992    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a0d241a6-8ddc-4d97-8ed0-e26a89049442","Type":"ContainerStarted","Data":"53a7ef855157584b40817bce831ffffa990a4e30817fff3f988a206885ec5631"}
Jul 15 12:17:11.754421 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:11.754372    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.736112024 podStartE2EDuration="2.75435587s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.243846ms" isStatefulPod=false podCreationTimestamp="2026-07-15 12:17:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:17:11.752081465 +0000 UTC m=+378.866475198" watchObservedRunningTime="2026-07-15 12:17:11.75435587 +0000 UTC m=+378.868749601"
Jul 15 12:17:15.080047 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:17:15.080010    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:18:10.080641 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:18:10.080602    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:18:10.095835 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:18:10.095813    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:18:10.969467 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:18:10.969439    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:18:43.626708 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:18:43.626635    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-x4fwn"]
Jul 15 12:18:43.629790 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:18:43.629771    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-x4fwn"
Jul 15 12:18:43.632797 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:18:43.632773    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 15 12:18:43.632883 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:18:43.632815    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-t7psc\""
Jul 15 12:18:43.632934 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:18:43.632880    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 15 12:18:43.639619 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:18:43.639601    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-x4fwn"]
Jul 15 12:18:43.790075 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:18:43.790037    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6j2f8\" (UniqueName: \"kubernetes.io/projected/35fa762a-0a80-4ab1-92ec-4e96f4c61611-kube-api-access-6j2f8\") pod \"cert-manager-webhook-6486ffd997-x4fwn\" (UID: \"35fa762a-0a80-4ab1-92ec-4e96f4c61611\") " pod="cert-manager/cert-manager-webhook-6486ffd997-x4fwn"
Jul 15 12:18:43.790231 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:18:43.790091    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/35fa762a-0a80-4ab1-92ec-4e96f4c61611-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-x4fwn\" (UID: \"35fa762a-0a80-4ab1-92ec-4e96f4c61611\") " pod="cert-manager/cert-manager-webhook-6486ffd997-x4fwn"
Jul 15 12:18:43.891228 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:18:43.891146    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6j2f8\" (UniqueName: \"kubernetes.io/projected/35fa762a-0a80-4ab1-92ec-4e96f4c61611-kube-api-access-6j2f8\") pod \"cert-manager-webhook-6486ffd997-x4fwn\" (UID: \"35fa762a-0a80-4ab1-92ec-4e96f4c61611\") " pod="cert-manager/cert-manager-webhook-6486ffd997-x4fwn"
Jul 15 12:18:43.891228 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:18:43.891212    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/35fa762a-0a80-4ab1-92ec-4e96f4c61611-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-x4fwn\" (UID: \"35fa762a-0a80-4ab1-92ec-4e96f4c61611\") " pod="cert-manager/cert-manager-webhook-6486ffd997-x4fwn"
Jul 15 12:18:43.899246 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:18:43.899221    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/35fa762a-0a80-4ab1-92ec-4e96f4c61611-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-x4fwn\" (UID: \"35fa762a-0a80-4ab1-92ec-4e96f4c61611\") " pod="cert-manager/cert-manager-webhook-6486ffd997-x4fwn"
Jul 15 12:18:43.899471 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:18:43.899450    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6j2f8\" (UniqueName: \"kubernetes.io/projected/35fa762a-0a80-4ab1-92ec-4e96f4c61611-kube-api-access-6j2f8\") pod \"cert-manager-webhook-6486ffd997-x4fwn\" (UID: \"35fa762a-0a80-4ab1-92ec-4e96f4c61611\") " pod="cert-manager/cert-manager-webhook-6486ffd997-x4fwn"
Jul 15 12:18:43.945277 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:18:43.945243    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-x4fwn"
Jul 15 12:18:44.067976 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:18:44.067952    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-x4fwn"]
Jul 15 12:18:44.070602 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:18:44.070574    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod35fa762a_0a80_4ab1_92ec_4e96f4c61611.slice/crio-583dc4a254ff95c6e227e63c7def1ccd1387c0bd23202208c9b595df3259ac22 WatchSource:0}: Error finding container 583dc4a254ff95c6e227e63c7def1ccd1387c0bd23202208c9b595df3259ac22: Status 404 returned error can't find the container with id 583dc4a254ff95c6e227e63c7def1ccd1387c0bd23202208c9b595df3259ac22
Jul 15 12:18:44.078958 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:18:44.078934    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-x4fwn" event={"ID":"35fa762a-0a80-4ab1-92ec-4e96f4c61611","Type":"ContainerStarted","Data":"583dc4a254ff95c6e227e63c7def1ccd1387c0bd23202208c9b595df3259ac22"}
Jul 15 12:18:48.100110 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:18:48.100023    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-x4fwn" event={"ID":"35fa762a-0a80-4ab1-92ec-4e96f4c61611","Type":"ContainerStarted","Data":"6fb03b5fcc839560950f2296cdb900f518dacb33a0f45b1be5bffa1edf153830"}
Jul 15 12:18:48.100110 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:18:48.100099    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-x4fwn"
Jul 15 12:18:48.115027 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:18:48.114962    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-x4fwn" podStartSLOduration=1.456989517 podStartE2EDuration="5.114943901s" totalImagesPullingTime="3.657954384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:18:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:18:48.114443763 +0000 UTC m=+475.228837492" watchObservedRunningTime="2026-07-15 12:18:48.114943901 +0000 UTC m=+475.229337634"
Jul 15 12:18:54.106651 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:18:54.106612    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-x4fwn"
Jul 15 12:19:12.247709 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:12.247677    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85d97db8bc-h9msx"]
Jul 15 12:19:12.257264 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:12.257238    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-85d97db8bc-h9msx"
Jul 15 12:19:12.260834 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:12.260812    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 15 12:19:12.260969 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:12.260932    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 15 12:19:12.261039 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:12.261010    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-b7chz\""
Jul 15 12:19:12.261039 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:12.261011    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 15 12:19:12.261148 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:12.261083    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 15 12:19:12.267367 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:12.267347    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85d97db8bc-h9msx"]
Jul 15 12:19:12.325531 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:12.325508    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2c5cd648-2957-4f58-9db5-c9cd2c3b4f5d-tmp\") pod \"opendatahub-operator-controller-manager-85d97db8bc-h9msx\" (UID: \"2c5cd648-2957-4f58-9db5-c9cd2c3b4f5d\") " pod="opendatahub/opendatahub-operator-controller-manager-85d97db8bc-h9msx"
Jul 15 12:19:12.325661 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:12.325553    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nhrs\" (UniqueName: \"kubernetes.io/projected/2c5cd648-2957-4f58-9db5-c9cd2c3b4f5d-kube-api-access-6nhrs\") pod \"opendatahub-operator-controller-manager-85d97db8bc-h9msx\" (UID: \"2c5cd648-2957-4f58-9db5-c9cd2c3b4f5d\") " pod="opendatahub/opendatahub-operator-controller-manager-85d97db8bc-h9msx"
Jul 15 12:19:12.325661 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:12.325592    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2c5cd648-2957-4f58-9db5-c9cd2c3b4f5d-webhook-cert\") pod \"opendatahub-operator-controller-manager-85d97db8bc-h9msx\" (UID: \"2c5cd648-2957-4f58-9db5-c9cd2c3b4f5d\") " pod="opendatahub/opendatahub-operator-controller-manager-85d97db8bc-h9msx"
Jul 15 12:19:12.325661 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:12.325635    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2c5cd648-2957-4f58-9db5-c9cd2c3b4f5d-manifests\") pod \"opendatahub-operator-controller-manager-85d97db8bc-h9msx\" (UID: \"2c5cd648-2957-4f58-9db5-c9cd2c3b4f5d\") " pod="opendatahub/opendatahub-operator-controller-manager-85d97db8bc-h9msx"
Jul 15 12:19:12.325786 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:12.325662    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2c5cd648-2957-4f58-9db5-c9cd2c3b4f5d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85d97db8bc-h9msx\" (UID: \"2c5cd648-2957-4f58-9db5-c9cd2c3b4f5d\") " pod="opendatahub/opendatahub-operator-controller-manager-85d97db8bc-h9msx"
Jul 15 12:19:12.426650 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:12.426618    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2c5cd648-2957-4f58-9db5-c9cd2c3b4f5d-manifests\") pod \"opendatahub-operator-controller-manager-85d97db8bc-h9msx\" (UID: \"2c5cd648-2957-4f58-9db5-c9cd2c3b4f5d\") " pod="opendatahub/opendatahub-operator-controller-manager-85d97db8bc-h9msx"
Jul 15 12:19:12.426768 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:12.426664    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2c5cd648-2957-4f58-9db5-c9cd2c3b4f5d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85d97db8bc-h9msx\" (UID: \"2c5cd648-2957-4f58-9db5-c9cd2c3b4f5d\") " pod="opendatahub/opendatahub-operator-controller-manager-85d97db8bc-h9msx"
Jul 15 12:19:12.426768 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:12.426701    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2c5cd648-2957-4f58-9db5-c9cd2c3b4f5d-tmp\") pod \"opendatahub-operator-controller-manager-85d97db8bc-h9msx\" (UID: \"2c5cd648-2957-4f58-9db5-c9cd2c3b4f5d\") " pod="opendatahub/opendatahub-operator-controller-manager-85d97db8bc-h9msx"
Jul 15 12:19:12.426768 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:12.426750    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nhrs\" (UniqueName: \"kubernetes.io/projected/2c5cd648-2957-4f58-9db5-c9cd2c3b4f5d-kube-api-access-6nhrs\") pod \"opendatahub-operator-controller-manager-85d97db8bc-h9msx\" (UID: \"2c5cd648-2957-4f58-9db5-c9cd2c3b4f5d\") " pod="opendatahub/opendatahub-operator-controller-manager-85d97db8bc-h9msx"
Jul 15 12:19:12.426937 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:12.426794    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2c5cd648-2957-4f58-9db5-c9cd2c3b4f5d-webhook-cert\") pod \"opendatahub-operator-controller-manager-85d97db8bc-h9msx\" (UID: \"2c5cd648-2957-4f58-9db5-c9cd2c3b4f5d\") " pod="opendatahub/opendatahub-operator-controller-manager-85d97db8bc-h9msx"
Jul 15 12:19:12.427085 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:12.427061    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2c5cd648-2957-4f58-9db5-c9cd2c3b4f5d-manifests\") pod \"opendatahub-operator-controller-manager-85d97db8bc-h9msx\" (UID: \"2c5cd648-2957-4f58-9db5-c9cd2c3b4f5d\") " pod="opendatahub/opendatahub-operator-controller-manager-85d97db8bc-h9msx"
Jul 15 12:19:12.428937 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:12.428905    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2c5cd648-2957-4f58-9db5-c9cd2c3b4f5d-tmp\") pod \"opendatahub-operator-controller-manager-85d97db8bc-h9msx\" (UID: \"2c5cd648-2957-4f58-9db5-c9cd2c3b4f5d\") " pod="opendatahub/opendatahub-operator-controller-manager-85d97db8bc-h9msx"
Jul 15 12:19:12.429267 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:12.429245    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2c5cd648-2957-4f58-9db5-c9cd2c3b4f5d-webhook-cert\") pod \"opendatahub-operator-controller-manager-85d97db8bc-h9msx\" (UID: \"2c5cd648-2957-4f58-9db5-c9cd2c3b4f5d\") " pod="opendatahub/opendatahub-operator-controller-manager-85d97db8bc-h9msx"
Jul 15 12:19:12.429333 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:12.429245    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2c5cd648-2957-4f58-9db5-c9cd2c3b4f5d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85d97db8bc-h9msx\" (UID: \"2c5cd648-2957-4f58-9db5-c9cd2c3b4f5d\") " pod="opendatahub/opendatahub-operator-controller-manager-85d97db8bc-h9msx"
Jul 15 12:19:12.440061 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:12.440038    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nhrs\" (UniqueName: \"kubernetes.io/projected/2c5cd648-2957-4f58-9db5-c9cd2c3b4f5d-kube-api-access-6nhrs\") pod \"opendatahub-operator-controller-manager-85d97db8bc-h9msx\" (UID: \"2c5cd648-2957-4f58-9db5-c9cd2c3b4f5d\") " pod="opendatahub/opendatahub-operator-controller-manager-85d97db8bc-h9msx"
Jul 15 12:19:12.567600 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:12.567529    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-85d97db8bc-h9msx"
Jul 15 12:19:12.704813 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:12.704785    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85d97db8bc-h9msx"]
Jul 15 12:19:12.706570 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:19:12.706548    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c5cd648_2957_4f58_9db5_c9cd2c3b4f5d.slice/crio-594640da9c0e7b0d9d851ee9241057ea2f506ad4f9b23535edf97b67aa070158 WatchSource:0}: Error finding container 594640da9c0e7b0d9d851ee9241057ea2f506ad4f9b23535edf97b67aa070158: Status 404 returned error can't find the container with id 594640da9c0e7b0d9d851ee9241057ea2f506ad4f9b23535edf97b67aa070158
Jul 15 12:19:13.200048 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:13.200017    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85d97db8bc-h9msx" event={"ID":"2c5cd648-2957-4f58-9db5-c9cd2c3b4f5d","Type":"ContainerStarted","Data":"594640da9c0e7b0d9d851ee9241057ea2f506ad4f9b23535edf97b67aa070158"}
Jul 15 12:19:16.223005 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:16.222970    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85d97db8bc-h9msx" event={"ID":"2c5cd648-2957-4f58-9db5-c9cd2c3b4f5d","Type":"ContainerStarted","Data":"fe79bb23ddf874fbfe427d0c7ead264b0e71731d305e6868b173c87562a39c8c"}
Jul 15 12:19:17.229077 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:17.229038    2560 generic.go:356] "Generic (PLEG): container finished" podID="2c5cd648-2957-4f58-9db5-c9cd2c3b4f5d" containerID="fe79bb23ddf874fbfe427d0c7ead264b0e71731d305e6868b173c87562a39c8c" exitCode=0
Jul 15 12:19:17.229492 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:17.229093    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85d97db8bc-h9msx" event={"ID":"2c5cd648-2957-4f58-9db5-c9cd2c3b4f5d","Type":"ContainerDied","Data":"fe79bb23ddf874fbfe427d0c7ead264b0e71731d305e6868b173c87562a39c8c"}
Jul 15 12:19:18.236050 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:18.236017    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85d97db8bc-h9msx" event={"ID":"2c5cd648-2957-4f58-9db5-c9cd2c3b4f5d","Type":"ContainerStarted","Data":"49f9286387c0fdf916db85795ced279523e1f63bfc4ea5995138332d4e28593f"}
Jul 15 12:19:18.236566 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:18.236163    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-85d97db8bc-h9msx"
Jul 15 12:19:18.259961 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:18.259912    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-85d97db8bc-h9msx" podStartSLOduration=1.620871625 podStartE2EDuration="6.259897167s" totalImagesPullingTime="3.636611149s" totalInitContainerRuntime="1.002414393s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:19:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:19:18.258454493 +0000 UTC m=+505.372848226" watchObservedRunningTime="2026-07-15 12:19:18.259897167 +0000 UTC m=+505.374290898"
Jul 15 12:19:29.242858 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:29.242827    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-85d97db8bc-h9msx"
Jul 15 12:19:39.424511 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:39.424478    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-786df675f-f5pjb"]
Jul 15 12:19:39.432916 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:39.432892    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-786df675f-f5pjb"
Jul 15 12:19:39.437623 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:39.437287    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 15 12:19:39.437623 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:39.437320    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 15 12:19:39.437623 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:39.437364    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 15 12:19:39.437623 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:39.437594    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 15 12:19:39.437906 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:39.437628    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-7xzqk\""
Jul 15 12:19:39.437906 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:39.437830    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 15 12:19:39.444692 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:39.444674    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-786df675f-f5pjb"]
Jul 15 12:19:39.574512 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:39.574480    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/06a08dfe-3dff-4f02-909e-66ebcddb1ba0-manager-config\") pod \"lws-controller-manager-786df675f-f5pjb\" (UID: \"06a08dfe-3dff-4f02-909e-66ebcddb1ba0\") " pod="openshift-lws-operator/lws-controller-manager-786df675f-f5pjb"
Jul 15 12:19:39.574512 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:39.574515    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/06a08dfe-3dff-4f02-909e-66ebcddb1ba0-metrics-cert\") pod \"lws-controller-manager-786df675f-f5pjb\" (UID: \"06a08dfe-3dff-4f02-909e-66ebcddb1ba0\") " pod="openshift-lws-operator/lws-controller-manager-786df675f-f5pjb"
Jul 15 12:19:39.574705 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:39.574591    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6v6g\" (UniqueName: \"kubernetes.io/projected/06a08dfe-3dff-4f02-909e-66ebcddb1ba0-kube-api-access-f6v6g\") pod \"lws-controller-manager-786df675f-f5pjb\" (UID: \"06a08dfe-3dff-4f02-909e-66ebcddb1ba0\") " pod="openshift-lws-operator/lws-controller-manager-786df675f-f5pjb"
Jul 15 12:19:39.574705 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:39.574626    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06a08dfe-3dff-4f02-909e-66ebcddb1ba0-cert\") pod \"lws-controller-manager-786df675f-f5pjb\" (UID: \"06a08dfe-3dff-4f02-909e-66ebcddb1ba0\") " pod="openshift-lws-operator/lws-controller-manager-786df675f-f5pjb"
Jul 15 12:19:39.676064 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:39.675977    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/06a08dfe-3dff-4f02-909e-66ebcddb1ba0-manager-config\") pod \"lws-controller-manager-786df675f-f5pjb\" (UID: \"06a08dfe-3dff-4f02-909e-66ebcddb1ba0\") " pod="openshift-lws-operator/lws-controller-manager-786df675f-f5pjb"
Jul 15 12:19:39.676064 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:39.676022    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/06a08dfe-3dff-4f02-909e-66ebcddb1ba0-metrics-cert\") pod \"lws-controller-manager-786df675f-f5pjb\" (UID: \"06a08dfe-3dff-4f02-909e-66ebcddb1ba0\") " pod="openshift-lws-operator/lws-controller-manager-786df675f-f5pjb"
Jul 15 12:19:39.676281 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:39.676091    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6v6g\" (UniqueName: \"kubernetes.io/projected/06a08dfe-3dff-4f02-909e-66ebcddb1ba0-kube-api-access-f6v6g\") pod \"lws-controller-manager-786df675f-f5pjb\" (UID: \"06a08dfe-3dff-4f02-909e-66ebcddb1ba0\") " pod="openshift-lws-operator/lws-controller-manager-786df675f-f5pjb"
Jul 15 12:19:39.676281 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:39.676119    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06a08dfe-3dff-4f02-909e-66ebcddb1ba0-cert\") pod \"lws-controller-manager-786df675f-f5pjb\" (UID: \"06a08dfe-3dff-4f02-909e-66ebcddb1ba0\") " pod="openshift-lws-operator/lws-controller-manager-786df675f-f5pjb"
Jul 15 12:19:39.676857 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:39.676827    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/06a08dfe-3dff-4f02-909e-66ebcddb1ba0-manager-config\") pod \"lws-controller-manager-786df675f-f5pjb\" (UID: \"06a08dfe-3dff-4f02-909e-66ebcddb1ba0\") " pod="openshift-lws-operator/lws-controller-manager-786df675f-f5pjb"
Jul 15 12:19:39.678719 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:39.678701    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06a08dfe-3dff-4f02-909e-66ebcddb1ba0-cert\") pod \"lws-controller-manager-786df675f-f5pjb\" (UID: \"06a08dfe-3dff-4f02-909e-66ebcddb1ba0\") " pod="openshift-lws-operator/lws-controller-manager-786df675f-f5pjb"
Jul 15 12:19:39.678806 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:39.678784    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/06a08dfe-3dff-4f02-909e-66ebcddb1ba0-metrics-cert\") pod \"lws-controller-manager-786df675f-f5pjb\" (UID: \"06a08dfe-3dff-4f02-909e-66ebcddb1ba0\") " pod="openshift-lws-operator/lws-controller-manager-786df675f-f5pjb"
Jul 15 12:19:39.685055 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:39.685027    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6v6g\" (UniqueName: \"kubernetes.io/projected/06a08dfe-3dff-4f02-909e-66ebcddb1ba0-kube-api-access-f6v6g\") pod \"lws-controller-manager-786df675f-f5pjb\" (UID: \"06a08dfe-3dff-4f02-909e-66ebcddb1ba0\") " pod="openshift-lws-operator/lws-controller-manager-786df675f-f5pjb"
Jul 15 12:19:39.743544 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:39.743519    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-786df675f-f5pjb"
Jul 15 12:19:39.870380 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:39.870353    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-786df675f-f5pjb"]
Jul 15 12:19:39.872550 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:19:39.872524    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06a08dfe_3dff_4f02_909e_66ebcddb1ba0.slice/crio-3d9c6a1f8caa117db68146acdd3a39b4968d279731b34f25fd43457f62a59098 WatchSource:0}: Error finding container 3d9c6a1f8caa117db68146acdd3a39b4968d279731b34f25fd43457f62a59098: Status 404 returned error can't find the container with id 3d9c6a1f8caa117db68146acdd3a39b4968d279731b34f25fd43457f62a59098
Jul 15 12:19:40.337653 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:40.337616    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-786df675f-f5pjb" event={"ID":"06a08dfe-3dff-4f02-909e-66ebcddb1ba0","Type":"ContainerStarted","Data":"3d9c6a1f8caa117db68146acdd3a39b4968d279731b34f25fd43457f62a59098"}
Jul 15 12:19:42.371029 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:42.370994    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6795b9c646-z72mt"]
Jul 15 12:19:42.374829 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:42.374808    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6795b9c646-z72mt"
Jul 15 12:19:42.380330 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:42.380279    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 15 12:19:42.382210 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:42.382180    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 15 12:19:42.382498 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:42.382260    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 15 12:19:42.382757 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:42.382738    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 15 12:19:42.384461 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:42.384208    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-7bc6d\""
Jul 15 12:19:42.394770 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:42.394739    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6795b9c646-z72mt"]
Jul 15 12:19:42.411397 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:42.411250    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c20d6a6-94a5-4493-8c88-bf232c67ef6f-tmp\") pod \"kube-auth-proxy-6795b9c646-z72mt\" (UID: \"7c20d6a6-94a5-4493-8c88-bf232c67ef6f\") " pod="openshift-ingress/kube-auth-proxy-6795b9c646-z72mt"
Jul 15 12:19:42.411397 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:42.411356    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9msnt\" (UniqueName: \"kubernetes.io/projected/7c20d6a6-94a5-4493-8c88-bf232c67ef6f-kube-api-access-9msnt\") pod \"kube-auth-proxy-6795b9c646-z72mt\" (UID: \"7c20d6a6-94a5-4493-8c88-bf232c67ef6f\") " pod="openshift-ingress/kube-auth-proxy-6795b9c646-z72mt"
Jul 15 12:19:42.411649 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:42.411441    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c20d6a6-94a5-4493-8c88-bf232c67ef6f-tls-certs\") pod \"kube-auth-proxy-6795b9c646-z72mt\" (UID: \"7c20d6a6-94a5-4493-8c88-bf232c67ef6f\") " pod="openshift-ingress/kube-auth-proxy-6795b9c646-z72mt"
Jul 15 12:19:42.512215 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:42.512180    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c20d6a6-94a5-4493-8c88-bf232c67ef6f-tmp\") pod \"kube-auth-proxy-6795b9c646-z72mt\" (UID: \"7c20d6a6-94a5-4493-8c88-bf232c67ef6f\") " pod="openshift-ingress/kube-auth-proxy-6795b9c646-z72mt"
Jul 15 12:19:42.512424 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:42.512239    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9msnt\" (UniqueName: \"kubernetes.io/projected/7c20d6a6-94a5-4493-8c88-bf232c67ef6f-kube-api-access-9msnt\") pod \"kube-auth-proxy-6795b9c646-z72mt\" (UID: \"7c20d6a6-94a5-4493-8c88-bf232c67ef6f\") " pod="openshift-ingress/kube-auth-proxy-6795b9c646-z72mt"
Jul 15 12:19:42.512424 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:42.512268    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c20d6a6-94a5-4493-8c88-bf232c67ef6f-tls-certs\") pod \"kube-auth-proxy-6795b9c646-z72mt\" (UID: \"7c20d6a6-94a5-4493-8c88-bf232c67ef6f\") " pod="openshift-ingress/kube-auth-proxy-6795b9c646-z72mt"
Jul 15 12:19:42.514341 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:42.514317    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c20d6a6-94a5-4493-8c88-bf232c67ef6f-tmp\") pod \"kube-auth-proxy-6795b9c646-z72mt\" (UID: \"7c20d6a6-94a5-4493-8c88-bf232c67ef6f\") " pod="openshift-ingress/kube-auth-proxy-6795b9c646-z72mt"
Jul 15 12:19:42.514545 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:42.514526    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c20d6a6-94a5-4493-8c88-bf232c67ef6f-tls-certs\") pod \"kube-auth-proxy-6795b9c646-z72mt\" (UID: \"7c20d6a6-94a5-4493-8c88-bf232c67ef6f\") " pod="openshift-ingress/kube-auth-proxy-6795b9c646-z72mt"
Jul 15 12:19:42.521846 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:42.521820    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9msnt\" (UniqueName: \"kubernetes.io/projected/7c20d6a6-94a5-4493-8c88-bf232c67ef6f-kube-api-access-9msnt\") pod \"kube-auth-proxy-6795b9c646-z72mt\" (UID: \"7c20d6a6-94a5-4493-8c88-bf232c67ef6f\") " pod="openshift-ingress/kube-auth-proxy-6795b9c646-z72mt"
Jul 15 12:19:42.690002 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:42.689934    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6795b9c646-z72mt"
Jul 15 12:19:42.809074 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:42.809044    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6795b9c646-z72mt"]
Jul 15 12:19:42.812043 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:19:42.812017    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c20d6a6_94a5_4493_8c88_bf232c67ef6f.slice/crio-e0de7a7b4fee2793346279bb2a4dcea6c99a2a3bd179091816f12754ed524676 WatchSource:0}: Error finding container e0de7a7b4fee2793346279bb2a4dcea6c99a2a3bd179091816f12754ed524676: Status 404 returned error can't find the container with id e0de7a7b4fee2793346279bb2a4dcea6c99a2a3bd179091816f12754ed524676
Jul 15 12:19:43.355473 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:43.355435    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6795b9c646-z72mt" event={"ID":"7c20d6a6-94a5-4493-8c88-bf232c67ef6f","Type":"ContainerStarted","Data":"e0de7a7b4fee2793346279bb2a4dcea6c99a2a3bd179091816f12754ed524676"}
Jul 15 12:19:43.357181 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:43.357155    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-786df675f-f5pjb" event={"ID":"06a08dfe-3dff-4f02-909e-66ebcddb1ba0","Type":"ContainerStarted","Data":"0a45e677fb7e07f1824b5edc73c5c1d6f17ba91ac784b031dd2a89cf005c2ef5"}
Jul 15 12:19:43.357329 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:43.357274    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-786df675f-f5pjb"
Jul 15 12:19:43.375307 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:43.375245    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-786df675f-f5pjb" podStartSLOduration=1.690696116 podStartE2EDuration="4.375232289s" totalImagesPullingTime="2.684536173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:19:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:19:43.373797605 +0000 UTC m=+530.488191360" watchObservedRunningTime="2026-07-15 12:19:43.375232289 +0000 UTC m=+530.489626021"
Jul 15 12:19:46.373021 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:46.372989    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6795b9c646-z72mt" event={"ID":"7c20d6a6-94a5-4493-8c88-bf232c67ef6f","Type":"ContainerStarted","Data":"45be44dd7af24fd2f989c927c62adacf2e2af91e35689f887fa5ae716d3900a1"}
Jul 15 12:19:46.392830 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:46.392780    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6795b9c646-z72mt" podStartSLOduration=1.306468863 podStartE2EDuration="4.392768069s" totalImagesPullingTime="3.086299206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:19:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:19:46.391365398 +0000 UTC m=+533.505759130" watchObservedRunningTime="2026-07-15 12:19:46.392768069 +0000 UTC m=+533.507161802"
Jul 15 12:19:54.365959 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:19:54.365924    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-786df675f-f5pjb"
Jul 15 12:20:53.359246 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:20:53.359216    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xkvbf_641b0ffa-0450-4198-8066-0241ab179822/console-operator/2.log"
Jul 15 12:20:53.360020 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:20:53.360003    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xkvbf_641b0ffa-0450-4198-8066-0241ab179822/console-operator/2.log"
Jul 15 12:20:53.367936 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:20:53.367908    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xh4rs_2de62ab2-7502-4c13-a6f0-5ebbd4982798/ovn-acl-logging/0.log"
Jul 15 12:20:53.368601 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:20:53.368584    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xh4rs_2de62ab2-7502-4c13-a6f0-5ebbd4982798/ovn-acl-logging/0.log"
Jul 15 12:21:12.779233 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:21:12.779199    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-2wzgf"]
Jul 15 12:21:12.782353 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:21:12.782336    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2wzgf"
Jul 15 12:21:12.785686 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:21:12.785666    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 15 12:21:12.786908 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:21:12.786889    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 15 12:21:12.786908 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:21:12.786902    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-b4jv5\""
Jul 15 12:21:12.792895 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:21:12.792876    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-2wzgf"]
Jul 15 12:21:12.862107 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:21:12.862082    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bmwb\" (UniqueName: \"kubernetes.io/projected/47c78219-bc6b-4bce-b399-e5b00a305a82-kube-api-access-5bmwb\") pod \"authorino-operator-75cc8d5cb7-2wzgf\" (UID: \"47c78219-bc6b-4bce-b399-e5b00a305a82\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-2wzgf"
Jul 15 12:21:12.962853 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:21:12.962823    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bmwb\" (UniqueName: \"kubernetes.io/projected/47c78219-bc6b-4bce-b399-e5b00a305a82-kube-api-access-5bmwb\") pod \"authorino-operator-75cc8d5cb7-2wzgf\" (UID: \"47c78219-bc6b-4bce-b399-e5b00a305a82\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-2wzgf"
Jul 15 12:21:12.972631 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:21:12.972600    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bmwb\" (UniqueName: \"kubernetes.io/projected/47c78219-bc6b-4bce-b399-e5b00a305a82-kube-api-access-5bmwb\") pod \"authorino-operator-75cc8d5cb7-2wzgf\" (UID: \"47c78219-bc6b-4bce-b399-e5b00a305a82\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-2wzgf"
Jul 15 12:21:13.092440 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:21:13.092377    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2wzgf"
Jul 15 12:21:13.220396 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:21:13.220374    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-2wzgf"]
Jul 15 12:21:13.222910 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:21:13.222886    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47c78219_bc6b_4bce_b399_e5b00a305a82.slice/crio-a2e8e34f43b396fdc566e5aa06dafb858d24f87b76b61bcf5a688c53033267c1 WatchSource:0}: Error finding container a2e8e34f43b396fdc566e5aa06dafb858d24f87b76b61bcf5a688c53033267c1: Status 404 returned error can't find the container with id a2e8e34f43b396fdc566e5aa06dafb858d24f87b76b61bcf5a688c53033267c1
Jul 15 12:21:13.225524 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:21:13.225506    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 12:21:13.749467 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:21:13.749435    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2wzgf" event={"ID":"47c78219-bc6b-4bce-b399-e5b00a305a82","Type":"ContainerStarted","Data":"a2e8e34f43b396fdc566e5aa06dafb858d24f87b76b61bcf5a688c53033267c1"}
Jul 15 12:21:15.760749 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:21:15.760647    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2wzgf" event={"ID":"47c78219-bc6b-4bce-b399-e5b00a305a82","Type":"ContainerStarted","Data":"ee3f40908eb51b65474026c2f352f598aa8ada954e857189b3d4d28f6b123d81"}
Jul 15 12:21:15.760749 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:21:15.760740    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2wzgf"
Jul 15 12:21:15.782694 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:21:15.782648    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2wzgf" podStartSLOduration=1.541498785 podStartE2EDuration="3.782635745s" totalImagesPullingTime="2.24113696s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:21:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:21:15.781882049 +0000 UTC m=+622.896275784" watchObservedRunningTime="2026-07-15 12:21:15.782635745 +0000 UTC m=+622.897029476"
Jul 15 12:21:26.768827 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:21:26.768797    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2wzgf"
Jul 15 12:22:24.245764 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:24.245729    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-7l8q9"]
Jul 15 12:22:24.248874 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:24.248857    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-7l8q9"
Jul 15 12:22:24.251575 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:24.251551    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-lmljx\""
Jul 15 12:22:24.256111 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:24.256081    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-7l8q9"]
Jul 15 12:22:24.259541 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:24.259520    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9ttb\" (UniqueName: \"kubernetes.io/projected/61dc715c-2946-454a-bc9e-f7d083284aae-kube-api-access-g9ttb\") pod \"authorino-58cd955675-7l8q9\" (UID: \"61dc715c-2946-454a-bc9e-f7d083284aae\") " pod="kuadrant-system/authorino-58cd955675-7l8q9"
Jul 15 12:22:24.360161 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:24.360132    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9ttb\" (UniqueName: \"kubernetes.io/projected/61dc715c-2946-454a-bc9e-f7d083284aae-kube-api-access-g9ttb\") pod \"authorino-58cd955675-7l8q9\" (UID: \"61dc715c-2946-454a-bc9e-f7d083284aae\") " pod="kuadrant-system/authorino-58cd955675-7l8q9"
Jul 15 12:22:24.369604 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:24.369580    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9ttb\" (UniqueName: \"kubernetes.io/projected/61dc715c-2946-454a-bc9e-f7d083284aae-kube-api-access-g9ttb\") pod \"authorino-58cd955675-7l8q9\" (UID: \"61dc715c-2946-454a-bc9e-f7d083284aae\") " pod="kuadrant-system/authorino-58cd955675-7l8q9"
Jul 15 12:22:24.376125 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:24.376102    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-mdg99"]
Jul 15 12:22:24.379580 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:24.379558    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-mdg99"
Jul 15 12:22:24.385794 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:24.385770    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-mdg99"]
Jul 15 12:22:24.461190 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:24.461157    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ththm\" (UniqueName: \"kubernetes.io/projected/bea4f57e-5f37-4d18-ae94-bce70e92d2db-kube-api-access-ththm\") pod \"authorino-75d556bd77-mdg99\" (UID: \"bea4f57e-5f37-4d18-ae94-bce70e92d2db\") " pod="kuadrant-system/authorino-75d556bd77-mdg99"
Jul 15 12:22:24.558939 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:24.558868    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-7l8q9"
Jul 15 12:22:24.561582 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:24.561556    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ththm\" (UniqueName: \"kubernetes.io/projected/bea4f57e-5f37-4d18-ae94-bce70e92d2db-kube-api-access-ththm\") pod \"authorino-75d556bd77-mdg99\" (UID: \"bea4f57e-5f37-4d18-ae94-bce70e92d2db\") " pod="kuadrant-system/authorino-75d556bd77-mdg99"
Jul 15 12:22:24.569242 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:24.569219    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ththm\" (UniqueName: \"kubernetes.io/projected/bea4f57e-5f37-4d18-ae94-bce70e92d2db-kube-api-access-ththm\") pod \"authorino-75d556bd77-mdg99\" (UID: \"bea4f57e-5f37-4d18-ae94-bce70e92d2db\") " pod="kuadrant-system/authorino-75d556bd77-mdg99"
Jul 15 12:22:24.686914 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:24.686888    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-7l8q9"]
Jul 15 12:22:24.689025 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:22:24.689001    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod61dc715c_2946_454a_bc9e_f7d083284aae.slice/crio-8e804a116a2dffd2e3863a99ef4ba706d81fe527aacf689e0afb2ef83d788815 WatchSource:0}: Error finding container 8e804a116a2dffd2e3863a99ef4ba706d81fe527aacf689e0afb2ef83d788815: Status 404 returned error can't find the container with id 8e804a116a2dffd2e3863a99ef4ba706d81fe527aacf689e0afb2ef83d788815
Jul 15 12:22:24.689659 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:24.689640    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-mdg99"
Jul 15 12:22:24.814894 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:24.814871    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-mdg99"]
Jul 15 12:22:24.817381 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:22:24.817354    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbea4f57e_5f37_4d18_ae94_bce70e92d2db.slice/crio-244307b78f45e33f05bd1f36eb659d65af0c9d73b73cd2d896bca839fe646d71 WatchSource:0}: Error finding container 244307b78f45e33f05bd1f36eb659d65af0c9d73b73cd2d896bca839fe646d71: Status 404 returned error can't find the container with id 244307b78f45e33f05bd1f36eb659d65af0c9d73b73cd2d896bca839fe646d71
Jul 15 12:22:25.062067 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:25.062026    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-7l8q9" event={"ID":"61dc715c-2946-454a-bc9e-f7d083284aae","Type":"ContainerStarted","Data":"8e804a116a2dffd2e3863a99ef4ba706d81fe527aacf689e0afb2ef83d788815"}
Jul 15 12:22:25.063285 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:25.063253    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-mdg99" event={"ID":"bea4f57e-5f37-4d18-ae94-bce70e92d2db","Type":"ContainerStarted","Data":"244307b78f45e33f05bd1f36eb659d65af0c9d73b73cd2d896bca839fe646d71"}
Jul 15 12:22:29.086000 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:29.085963    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-7l8q9" event={"ID":"61dc715c-2946-454a-bc9e-f7d083284aae","Type":"ContainerStarted","Data":"28d12eeaf82a8a3d228b8eaff1d17b27f4d9715c8bfd8dfa3887c7401e066ec1"}
Jul 15 12:22:29.087458 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:29.087430    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-mdg99" event={"ID":"bea4f57e-5f37-4d18-ae94-bce70e92d2db","Type":"ContainerStarted","Data":"6e542f6d34e33f3484a7ceab9bf90636976074a22d1ea05275dae1cd9b566e10"}
Jul 15 12:22:29.100654 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:29.100609    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-7l8q9" podStartSLOduration=1.459225942 podStartE2EDuration="5.100595087s" totalImagesPullingTime="3.641369145s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:22:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:22:29.099722414 +0000 UTC m=+696.214116146" watchObservedRunningTime="2026-07-15 12:22:29.100595087 +0000 UTC m=+696.214988856"
Jul 15 12:22:29.118152 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:29.118104    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-mdg99" podStartSLOduration=1.594486251 podStartE2EDuration="5.118089476s" totalImagesPullingTime="3.523603225s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:22:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:22:29.117211359 +0000 UTC m=+696.231605091" watchObservedRunningTime="2026-07-15 12:22:29.118089476 +0000 UTC m=+696.232483208"
Jul 15 12:22:29.141406 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:29.141382    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-7l8q9"]
Jul 15 12:22:31.097188 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:31.097150    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-7l8q9" podUID="61dc715c-2946-454a-bc9e-f7d083284aae" containerName="authorino" containerID="cri-o://28d12eeaf82a8a3d228b8eaff1d17b27f4d9715c8bfd8dfa3887c7401e066ec1" gracePeriod=30
Jul 15 12:22:31.340447 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:31.340424    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-7l8q9"
Jul 15 12:22:31.430198 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:31.430120    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g9ttb\" (UniqueName: \"kubernetes.io/projected/61dc715c-2946-454a-bc9e-f7d083284aae-kube-api-access-g9ttb\") pod \"61dc715c-2946-454a-bc9e-f7d083284aae\" (UID: \"61dc715c-2946-454a-bc9e-f7d083284aae\") "
Jul 15 12:22:31.432217 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:31.432194    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61dc715c-2946-454a-bc9e-f7d083284aae-kube-api-access-g9ttb" (OuterVolumeSpecName: "kube-api-access-g9ttb") pod "61dc715c-2946-454a-bc9e-f7d083284aae" (UID: "61dc715c-2946-454a-bc9e-f7d083284aae"). InnerVolumeSpecName "kube-api-access-g9ttb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:22:31.531002 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:31.530972    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g9ttb\" (UniqueName: \"kubernetes.io/projected/61dc715c-2946-454a-bc9e-f7d083284aae-kube-api-access-g9ttb\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:22:32.101981 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:32.101944    2560 generic.go:356] "Generic (PLEG): container finished" podID="61dc715c-2946-454a-bc9e-f7d083284aae" containerID="28d12eeaf82a8a3d228b8eaff1d17b27f4d9715c8bfd8dfa3887c7401e066ec1" exitCode=0
Jul 15 12:22:32.102410 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:32.101985    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-7l8q9"
Jul 15 12:22:32.102410 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:32.102029    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-7l8q9" event={"ID":"61dc715c-2946-454a-bc9e-f7d083284aae","Type":"ContainerDied","Data":"28d12eeaf82a8a3d228b8eaff1d17b27f4d9715c8bfd8dfa3887c7401e066ec1"}
Jul 15 12:22:32.102410 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:32.102068    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-7l8q9" event={"ID":"61dc715c-2946-454a-bc9e-f7d083284aae","Type":"ContainerDied","Data":"8e804a116a2dffd2e3863a99ef4ba706d81fe527aacf689e0afb2ef83d788815"}
Jul 15 12:22:32.102410 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:32.102088    2560 scope.go:117] "RemoveContainer" containerID="28d12eeaf82a8a3d228b8eaff1d17b27f4d9715c8bfd8dfa3887c7401e066ec1"
Jul 15 12:22:32.110105 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:32.110089    2560 scope.go:117] "RemoveContainer" containerID="28d12eeaf82a8a3d228b8eaff1d17b27f4d9715c8bfd8dfa3887c7401e066ec1"
Jul 15 12:22:32.110352 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:22:32.110334    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28d12eeaf82a8a3d228b8eaff1d17b27f4d9715c8bfd8dfa3887c7401e066ec1\": container with ID starting with 28d12eeaf82a8a3d228b8eaff1d17b27f4d9715c8bfd8dfa3887c7401e066ec1 not found: ID does not exist" containerID="28d12eeaf82a8a3d228b8eaff1d17b27f4d9715c8bfd8dfa3887c7401e066ec1"
Jul 15 12:22:32.110402 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:32.110361    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28d12eeaf82a8a3d228b8eaff1d17b27f4d9715c8bfd8dfa3887c7401e066ec1"} err="failed to get container status \"28d12eeaf82a8a3d228b8eaff1d17b27f4d9715c8bfd8dfa3887c7401e066ec1\": rpc error: code = NotFound desc = could not find container \"28d12eeaf82a8a3d228b8eaff1d17b27f4d9715c8bfd8dfa3887c7401e066ec1\": container with ID starting with 28d12eeaf82a8a3d228b8eaff1d17b27f4d9715c8bfd8dfa3887c7401e066ec1 not found: ID does not exist"
Jul 15 12:22:32.117508 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:32.117486    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-7l8q9"]
Jul 15 12:22:32.123174 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:32.123155    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-7l8q9"]
Jul 15 12:22:33.443581 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:33.443547    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61dc715c-2946-454a-bc9e-f7d083284aae" path="/var/lib/kubelet/pods/61dc715c-2946-454a-bc9e-f7d083284aae/volumes"
Jul 15 12:22:40.875905 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:40.875873    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-k6vx7"]
Jul 15 12:22:40.876372 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:40.876204    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61dc715c-2946-454a-bc9e-f7d083284aae" containerName="authorino"
Jul 15 12:22:40.876372 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:40.876216    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="61dc715c-2946-454a-bc9e-f7d083284aae" containerName="authorino"
Jul 15 12:22:40.876372 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:40.876333    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="61dc715c-2946-454a-bc9e-f7d083284aae" containerName="authorino"
Jul 15 12:22:40.879445 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:40.879427    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-k6vx7"
Jul 15 12:22:40.882184 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:40.882161    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 12:22:40.882329 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:40.882183    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 15 12:22:40.883429 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:40.883411    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-5l2z5\""
Jul 15 12:22:40.883525 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:40.883456    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 12:22:40.886183 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:40.886164    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-k6vx7"]
Jul 15 12:22:41.004984 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:41.004946    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/bb8380c8-6d6a-4b76-a85d-ab7597cc3d19-data\") pod \"postgres-69fb4594cf-k6vx7\" (UID: \"bb8380c8-6d6a-4b76-a85d-ab7597cc3d19\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-k6vx7"
Jul 15 12:22:41.005136 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:41.005024    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbtdk\" (UniqueName: \"kubernetes.io/projected/bb8380c8-6d6a-4b76-a85d-ab7597cc3d19-kube-api-access-rbtdk\") pod \"postgres-69fb4594cf-k6vx7\" (UID: \"bb8380c8-6d6a-4b76-a85d-ab7597cc3d19\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-k6vx7"
Jul 15 12:22:41.105821 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:41.105790    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbtdk\" (UniqueName: \"kubernetes.io/projected/bb8380c8-6d6a-4b76-a85d-ab7597cc3d19-kube-api-access-rbtdk\") pod \"postgres-69fb4594cf-k6vx7\" (UID: \"bb8380c8-6d6a-4b76-a85d-ab7597cc3d19\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-k6vx7"
Jul 15 12:22:41.105985 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:41.105859    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/bb8380c8-6d6a-4b76-a85d-ab7597cc3d19-data\") pod \"postgres-69fb4594cf-k6vx7\" (UID: \"bb8380c8-6d6a-4b76-a85d-ab7597cc3d19\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-k6vx7"
Jul 15 12:22:41.106222 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:41.106204    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/bb8380c8-6d6a-4b76-a85d-ab7597cc3d19-data\") pod \"postgres-69fb4594cf-k6vx7\" (UID: \"bb8380c8-6d6a-4b76-a85d-ab7597cc3d19\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-k6vx7"
Jul 15 12:22:41.113862 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:41.113831    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbtdk\" (UniqueName: \"kubernetes.io/projected/bb8380c8-6d6a-4b76-a85d-ab7597cc3d19-kube-api-access-rbtdk\") pod \"postgres-69fb4594cf-k6vx7\" (UID: \"bb8380c8-6d6a-4b76-a85d-ab7597cc3d19\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-k6vx7"
Jul 15 12:22:41.190724 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:41.190658    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-k6vx7"
Jul 15 12:22:41.318397 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:41.318352    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-k6vx7"]
Jul 15 12:22:41.320712 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:22:41.320674    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb8380c8_6d6a_4b76_a85d_ab7597cc3d19.slice/crio-ab0d6967e14f1aec15cd15b458d89fd3c044a362fb087bd430db23bdafbc1d02 WatchSource:0}: Error finding container ab0d6967e14f1aec15cd15b458d89fd3c044a362fb087bd430db23bdafbc1d02: Status 404 returned error can't find the container with id ab0d6967e14f1aec15cd15b458d89fd3c044a362fb087bd430db23bdafbc1d02
Jul 15 12:22:42.150554 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:42.150500    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-k6vx7" event={"ID":"bb8380c8-6d6a-4b76-a85d-ab7597cc3d19","Type":"ContainerStarted","Data":"ab0d6967e14f1aec15cd15b458d89fd3c044a362fb087bd430db23bdafbc1d02"}
Jul 15 12:22:47.177623 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:47.177589    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-k6vx7" event={"ID":"bb8380c8-6d6a-4b76-a85d-ab7597cc3d19","Type":"ContainerStarted","Data":"ec48df021ead56f902f392921450d13f4ba683efb6ecc5b3e5b5b071182cf36c"}
Jul 15 12:22:47.177992 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:47.177705    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-k6vx7"
Jul 15 12:22:47.195062 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:47.195016    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-k6vx7" podStartSLOduration=2.2937141580000002 podStartE2EDuration="7.195003476s" totalImagesPullingTime="4.901289318s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:22:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:22:47.192764163 +0000 UTC m=+714.307157919" watchObservedRunningTime="2026-07-15 12:22:47.195003476 +0000 UTC m=+714.309397208"
Jul 15 12:22:53.210903 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:53.210877    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-k6vx7"
Jul 15 12:22:54.145417 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:54.145385    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-d4bc9b8d4-pmwzk"]
Jul 15 12:22:54.151570 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:54.151545    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d4bc9b8d4-pmwzk"
Jul 15 12:22:54.154486 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:54.154470    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 15 12:22:54.157454 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:54.157434    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d4bc9b8d4-pmwzk"]
Jul 15 12:22:54.330205 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:54.330173    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a31ddc6a-2df3-45c9-94ed-f47d3a1199d0-tls-cert\") pod \"authorino-d4bc9b8d4-pmwzk\" (UID: \"a31ddc6a-2df3-45c9-94ed-f47d3a1199d0\") " pod="kuadrant-system/authorino-d4bc9b8d4-pmwzk"
Jul 15 12:22:54.330205 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:54.330210    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cflf2\" (UniqueName: \"kubernetes.io/projected/a31ddc6a-2df3-45c9-94ed-f47d3a1199d0-kube-api-access-cflf2\") pod \"authorino-d4bc9b8d4-pmwzk\" (UID: \"a31ddc6a-2df3-45c9-94ed-f47d3a1199d0\") " pod="kuadrant-system/authorino-d4bc9b8d4-pmwzk"
Jul 15 12:22:54.431459 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:54.431375    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a31ddc6a-2df3-45c9-94ed-f47d3a1199d0-tls-cert\") pod \"authorino-d4bc9b8d4-pmwzk\" (UID: \"a31ddc6a-2df3-45c9-94ed-f47d3a1199d0\") " pod="kuadrant-system/authorino-d4bc9b8d4-pmwzk"
Jul 15 12:22:54.431459 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:54.431416    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cflf2\" (UniqueName: \"kubernetes.io/projected/a31ddc6a-2df3-45c9-94ed-f47d3a1199d0-kube-api-access-cflf2\") pod \"authorino-d4bc9b8d4-pmwzk\" (UID: \"a31ddc6a-2df3-45c9-94ed-f47d3a1199d0\") " pod="kuadrant-system/authorino-d4bc9b8d4-pmwzk"
Jul 15 12:22:54.433801 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:54.433775    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a31ddc6a-2df3-45c9-94ed-f47d3a1199d0-tls-cert\") pod \"authorino-d4bc9b8d4-pmwzk\" (UID: \"a31ddc6a-2df3-45c9-94ed-f47d3a1199d0\") " pod="kuadrant-system/authorino-d4bc9b8d4-pmwzk"
Jul 15 12:22:54.438787 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:54.438762    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cflf2\" (UniqueName: \"kubernetes.io/projected/a31ddc6a-2df3-45c9-94ed-f47d3a1199d0-kube-api-access-cflf2\") pod \"authorino-d4bc9b8d4-pmwzk\" (UID: \"a31ddc6a-2df3-45c9-94ed-f47d3a1199d0\") " pod="kuadrant-system/authorino-d4bc9b8d4-pmwzk"
Jul 15 12:22:54.461760 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:54.461737    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d4bc9b8d4-pmwzk"
Jul 15 12:22:54.587969 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:54.587941    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d4bc9b8d4-pmwzk"]
Jul 15 12:22:54.589459 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:22:54.589432    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda31ddc6a_2df3_45c9_94ed_f47d3a1199d0.slice/crio-df7059840b0d32dbf0f722a067e82983f5680d26498a467e5362e776bbeef98d WatchSource:0}: Error finding container df7059840b0d32dbf0f722a067e82983f5680d26498a467e5362e776bbeef98d: Status 404 returned error can't find the container with id df7059840b0d32dbf0f722a067e82983f5680d26498a467e5362e776bbeef98d
Jul 15 12:22:55.223694 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:55.223657    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d4bc9b8d4-pmwzk" event={"ID":"a31ddc6a-2df3-45c9-94ed-f47d3a1199d0","Type":"ContainerStarted","Data":"d27e6e0c8bb25057bfc7d014738342e2c6763ae822b60524f0cc4db59ad82904"}
Jul 15 12:22:55.223694 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:55.223700    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d4bc9b8d4-pmwzk" event={"ID":"a31ddc6a-2df3-45c9-94ed-f47d3a1199d0","Type":"ContainerStarted","Data":"df7059840b0d32dbf0f722a067e82983f5680d26498a467e5362e776bbeef98d"}
Jul 15 12:22:55.240683 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:55.240635    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-d4bc9b8d4-pmwzk" podStartSLOduration=0.81504448 podStartE2EDuration="1.240621179s" totalImagesPullingTime="425.576699ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:22:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:22:55.24020034 +0000 UTC m=+722.354594072" watchObservedRunningTime="2026-07-15 12:22:55.240621179 +0000 UTC m=+722.355014928"
Jul 15 12:22:55.266846 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:55.266777    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-mdg99"]
Jul 15 12:22:55.267044 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:55.267019    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-mdg99" podUID="bea4f57e-5f37-4d18-ae94-bce70e92d2db" containerName="authorino" containerID="cri-o://6e542f6d34e33f3484a7ceab9bf90636976074a22d1ea05275dae1cd9b566e10" gracePeriod=30
Jul 15 12:22:55.518230 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:55.518178    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-mdg99"
Jul 15 12:22:55.642845 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:55.642808    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ththm\" (UniqueName: \"kubernetes.io/projected/bea4f57e-5f37-4d18-ae94-bce70e92d2db-kube-api-access-ththm\") pod \"bea4f57e-5f37-4d18-ae94-bce70e92d2db\" (UID: \"bea4f57e-5f37-4d18-ae94-bce70e92d2db\") "
Jul 15 12:22:55.644932 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:55.644904    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bea4f57e-5f37-4d18-ae94-bce70e92d2db-kube-api-access-ththm" (OuterVolumeSpecName: "kube-api-access-ththm") pod "bea4f57e-5f37-4d18-ae94-bce70e92d2db" (UID: "bea4f57e-5f37-4d18-ae94-bce70e92d2db"). InnerVolumeSpecName "kube-api-access-ththm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:22:55.743895 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:55.743861    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ththm\" (UniqueName: \"kubernetes.io/projected/bea4f57e-5f37-4d18-ae94-bce70e92d2db-kube-api-access-ththm\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:22:56.231985 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:56.231941    2560 generic.go:356] "Generic (PLEG): container finished" podID="bea4f57e-5f37-4d18-ae94-bce70e92d2db" containerID="6e542f6d34e33f3484a7ceab9bf90636976074a22d1ea05275dae1cd9b566e10" exitCode=0
Jul 15 12:22:56.232221 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:56.231997    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-mdg99"
Jul 15 12:22:56.232221 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:56.232041    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-mdg99" event={"ID":"bea4f57e-5f37-4d18-ae94-bce70e92d2db","Type":"ContainerDied","Data":"6e542f6d34e33f3484a7ceab9bf90636976074a22d1ea05275dae1cd9b566e10"}
Jul 15 12:22:56.232221 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:56.232093    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-mdg99" event={"ID":"bea4f57e-5f37-4d18-ae94-bce70e92d2db","Type":"ContainerDied","Data":"244307b78f45e33f05bd1f36eb659d65af0c9d73b73cd2d896bca839fe646d71"}
Jul 15 12:22:56.232221 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:56.232117    2560 scope.go:117] "RemoveContainer" containerID="6e542f6d34e33f3484a7ceab9bf90636976074a22d1ea05275dae1cd9b566e10"
Jul 15 12:22:56.242447 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:56.242432    2560 scope.go:117] "RemoveContainer" containerID="6e542f6d34e33f3484a7ceab9bf90636976074a22d1ea05275dae1cd9b566e10"
Jul 15 12:22:56.242736 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:22:56.242712    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e542f6d34e33f3484a7ceab9bf90636976074a22d1ea05275dae1cd9b566e10\": container with ID starting with 6e542f6d34e33f3484a7ceab9bf90636976074a22d1ea05275dae1cd9b566e10 not found: ID does not exist" containerID="6e542f6d34e33f3484a7ceab9bf90636976074a22d1ea05275dae1cd9b566e10"
Jul 15 12:22:56.242795 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:56.242749    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e542f6d34e33f3484a7ceab9bf90636976074a22d1ea05275dae1cd9b566e10"} err="failed to get container status \"6e542f6d34e33f3484a7ceab9bf90636976074a22d1ea05275dae1cd9b566e10\": rpc error: code = NotFound desc = could not find container \"6e542f6d34e33f3484a7ceab9bf90636976074a22d1ea05275dae1cd9b566e10\": container with ID starting with 6e542f6d34e33f3484a7ceab9bf90636976074a22d1ea05275dae1cd9b566e10 not found: ID does not exist"
Jul 15 12:22:56.255106 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:56.255078    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-mdg99"]
Jul 15 12:22:56.258729 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:56.258701    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-mdg99"]
Jul 15 12:22:57.443982 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:22:57.443954    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bea4f57e-5f37-4d18-ae94-bce70e92d2db" path="/var/lib/kubelet/pods/bea4f57e-5f37-4d18-ae94-bce70e92d2db/volumes"
Jul 15 12:23:34.787428 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:23:34.787394    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-zwgxg"]
Jul 15 12:23:34.787891 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:23:34.787783    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bea4f57e-5f37-4d18-ae94-bce70e92d2db" containerName="authorino"
Jul 15 12:23:34.787891 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:23:34.787794    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="bea4f57e-5f37-4d18-ae94-bce70e92d2db" containerName="authorino"
Jul 15 12:23:34.787891 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:23:34.787857    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="bea4f57e-5f37-4d18-ae94-bce70e92d2db" containerName="authorino"
Jul 15 12:23:34.791020 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:23:34.791000    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-zwgxg"
Jul 15 12:23:34.793653 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:23:34.793630    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 15 12:23:34.793760 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:23:34.793638    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-vt5fj\""
Jul 15 12:23:34.801730 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:23:34.801708    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-zwgxg"]
Jul 15 12:23:34.880779 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:23:34.880754    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a15d81cf-d6e3-4a6b-a620-a84a2637e048-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-zwgxg\" (UID: \"a15d81cf-d6e3-4a6b-a620-a84a2637e048\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-zwgxg"
Jul 15 12:23:34.880926 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:23:34.880787    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64cjc\" (UniqueName: \"kubernetes.io/projected/a15d81cf-d6e3-4a6b-a620-a84a2637e048-kube-api-access-64cjc\") pod \"payload-processing-f9b8d9b9b-zwgxg\" (UID: \"a15d81cf-d6e3-4a6b-a620-a84a2637e048\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-zwgxg"
Jul 15 12:23:34.981769 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:23:34.981738    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a15d81cf-d6e3-4a6b-a620-a84a2637e048-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-zwgxg\" (UID: \"a15d81cf-d6e3-4a6b-a620-a84a2637e048\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-zwgxg"
Jul 15 12:23:34.981934 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:23:34.981774    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64cjc\" (UniqueName: \"kubernetes.io/projected/a15d81cf-d6e3-4a6b-a620-a84a2637e048-kube-api-access-64cjc\") pod \"payload-processing-f9b8d9b9b-zwgxg\" (UID: \"a15d81cf-d6e3-4a6b-a620-a84a2637e048\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-zwgxg"
Jul 15 12:23:34.982458 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:23:34.982438    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a15d81cf-d6e3-4a6b-a620-a84a2637e048-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-zwgxg\" (UID: \"a15d81cf-d6e3-4a6b-a620-a84a2637e048\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-zwgxg"
Jul 15 12:23:34.990082 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:23:34.990051    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64cjc\" (UniqueName: \"kubernetes.io/projected/a15d81cf-d6e3-4a6b-a620-a84a2637e048-kube-api-access-64cjc\") pod \"payload-processing-f9b8d9b9b-zwgxg\" (UID: \"a15d81cf-d6e3-4a6b-a620-a84a2637e048\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-zwgxg"
Jul 15 12:23:35.102541 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:23:35.102465    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-zwgxg"
Jul 15 12:23:35.229461 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:23:35.229436    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-zwgxg"]
Jul 15 12:23:35.230939 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:23:35.230908    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda15d81cf_d6e3_4a6b_a620_a84a2637e048.slice/crio-ad39a3f4cb664a7626eae9176ea80cbb18369cac8b11444fe6429b04589cbdd3 WatchSource:0}: Error finding container ad39a3f4cb664a7626eae9176ea80cbb18369cac8b11444fe6429b04589cbdd3: Status 404 returned error can't find the container with id ad39a3f4cb664a7626eae9176ea80cbb18369cac8b11444fe6429b04589cbdd3
Jul 15 12:23:35.406341 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:23:35.406242    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-zwgxg" event={"ID":"a15d81cf-d6e3-4a6b-a620-a84a2637e048","Type":"ContainerStarted","Data":"ad39a3f4cb664a7626eae9176ea80cbb18369cac8b11444fe6429b04589cbdd3"}
Jul 15 12:23:37.417652 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:23:37.417619    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-zwgxg" event={"ID":"a15d81cf-d6e3-4a6b-a620-a84a2637e048","Type":"ContainerStarted","Data":"5c87567241c8e32e273c8c5d7bc134a46e014b6f9381cee53d7d08c2389723e0"}
Jul 15 12:23:37.418042 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:23:37.417767    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-zwgxg"
Jul 15 12:23:37.435894 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:23:37.435849    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-zwgxg" podStartSLOduration=2.203172418 podStartE2EDuration="3.43583283s" totalImagesPullingTime="1.232660412s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:23:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:23:37.434683853 +0000 UTC m=+764.549077586" watchObservedRunningTime="2026-07-15 12:23:37.43583283 +0000 UTC m=+764.550226562"
Jul 15 12:23:48.425193 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:23:48.425160    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-zwgxg"
Jul 15 12:24:15.051726 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:15.051685    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-tzlm6"]
Jul 15 12:24:15.057747 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:15.057722    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tzlm6"
Jul 15 12:24:15.060595 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:15.060570    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 15 12:24:15.061713 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:15.061695    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 15 12:24:15.061871 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:15.061848    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-p4ggq\""
Jul 15 12:24:15.061969 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:15.061920    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 15 12:24:15.069097 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:15.069075    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-tzlm6"]
Jul 15 12:24:15.122224 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:15.122162    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1bb891d-9f79-47ab-965c-e9f1a034cbd9-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tzlm6\" (UID: \"c1bb891d-9f79-47ab-965c-e9f1a034cbd9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tzlm6"
Jul 15 12:24:15.122224 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:15.122203    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1bb891d-9f79-47ab-965c-e9f1a034cbd9-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tzlm6\" (UID: \"c1bb891d-9f79-47ab-965c-e9f1a034cbd9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tzlm6"
Jul 15 12:24:15.122426 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:15.122270    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1bb891d-9f79-47ab-965c-e9f1a034cbd9-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tzlm6\" (UID: \"c1bb891d-9f79-47ab-965c-e9f1a034cbd9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tzlm6"
Jul 15 12:24:15.122426 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:15.122317    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1bb891d-9f79-47ab-965c-e9f1a034cbd9-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tzlm6\" (UID: \"c1bb891d-9f79-47ab-965c-e9f1a034cbd9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tzlm6"
Jul 15 12:24:15.122426 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:15.122346    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29r7w\" (UniqueName: \"kubernetes.io/projected/c1bb891d-9f79-47ab-965c-e9f1a034cbd9-kube-api-access-29r7w\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tzlm6\" (UID: \"c1bb891d-9f79-47ab-965c-e9f1a034cbd9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tzlm6"
Jul 15 12:24:15.122426 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:15.122371    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1bb891d-9f79-47ab-965c-e9f1a034cbd9-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tzlm6\" (UID: \"c1bb891d-9f79-47ab-965c-e9f1a034cbd9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tzlm6"
Jul 15 12:24:15.223316 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:15.223262    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1bb891d-9f79-47ab-965c-e9f1a034cbd9-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tzlm6\" (UID: \"c1bb891d-9f79-47ab-965c-e9f1a034cbd9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tzlm6"
Jul 15 12:24:15.223316 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:15.223318    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1bb891d-9f79-47ab-965c-e9f1a034cbd9-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tzlm6\" (UID: \"c1bb891d-9f79-47ab-965c-e9f1a034cbd9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tzlm6"
Jul 15 12:24:15.223536 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:15.223353    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29r7w\" (UniqueName: \"kubernetes.io/projected/c1bb891d-9f79-47ab-965c-e9f1a034cbd9-kube-api-access-29r7w\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tzlm6\" (UID: \"c1bb891d-9f79-47ab-965c-e9f1a034cbd9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tzlm6"
Jul 15 12:24:15.223536 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:15.223375    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1bb891d-9f79-47ab-965c-e9f1a034cbd9-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tzlm6\" (UID: \"c1bb891d-9f79-47ab-965c-e9f1a034cbd9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tzlm6"
Jul 15 12:24:15.223536 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:15.223423    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1bb891d-9f79-47ab-965c-e9f1a034cbd9-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tzlm6\" (UID: \"c1bb891d-9f79-47ab-965c-e9f1a034cbd9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tzlm6"
Jul 15 12:24:15.223536 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:15.223462    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1bb891d-9f79-47ab-965c-e9f1a034cbd9-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tzlm6\" (UID: \"c1bb891d-9f79-47ab-965c-e9f1a034cbd9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tzlm6"
Jul 15 12:24:15.223839 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:15.223810    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1bb891d-9f79-47ab-965c-e9f1a034cbd9-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tzlm6\" (UID: \"c1bb891d-9f79-47ab-965c-e9f1a034cbd9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tzlm6"
Jul 15 12:24:15.223981 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:15.223841    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1bb891d-9f79-47ab-965c-e9f1a034cbd9-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tzlm6\" (UID: \"c1bb891d-9f79-47ab-965c-e9f1a034cbd9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tzlm6"
Jul 15 12:24:15.223981 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:15.223914    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1bb891d-9f79-47ab-965c-e9f1a034cbd9-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tzlm6\" (UID: \"c1bb891d-9f79-47ab-965c-e9f1a034cbd9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tzlm6"
Jul 15 12:24:15.225569 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:15.225544    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1bb891d-9f79-47ab-965c-e9f1a034cbd9-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tzlm6\" (UID: \"c1bb891d-9f79-47ab-965c-e9f1a034cbd9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tzlm6"
Jul 15 12:24:15.226033 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:15.226010    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1bb891d-9f79-47ab-965c-e9f1a034cbd9-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tzlm6\" (UID: \"c1bb891d-9f79-47ab-965c-e9f1a034cbd9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tzlm6"
Jul 15 12:24:15.231303 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:15.231269    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29r7w\" (UniqueName: \"kubernetes.io/projected/c1bb891d-9f79-47ab-965c-e9f1a034cbd9-kube-api-access-29r7w\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tzlm6\" (UID: \"c1bb891d-9f79-47ab-965c-e9f1a034cbd9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tzlm6"
Jul 15 12:24:15.368766 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:15.368675    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tzlm6"
Jul 15 12:24:15.507120 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:15.507099    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-tzlm6"]
Jul 15 12:24:15.509369 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:24:15.509342    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1bb891d_9f79_47ab_965c_e9f1a034cbd9.slice/crio-d2300678a45e101c4c9a30054af36871ddfaefbf2b5888fb7977bb820c8bb614 WatchSource:0}: Error finding container d2300678a45e101c4c9a30054af36871ddfaefbf2b5888fb7977bb820c8bb614: Status 404 returned error can't find the container with id d2300678a45e101c4c9a30054af36871ddfaefbf2b5888fb7977bb820c8bb614
Jul 15 12:24:15.598212 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:15.598180    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tzlm6" event={"ID":"c1bb891d-9f79-47ab-965c-e9f1a034cbd9","Type":"ContainerStarted","Data":"d2300678a45e101c4c9a30054af36871ddfaefbf2b5888fb7977bb820c8bb614"}
Jul 15 12:24:17.609794 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:17.609758    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tzlm6" event={"ID":"c1bb891d-9f79-47ab-965c-e9f1a034cbd9","Type":"ContainerStarted","Data":"62b451b084fb44a54a57808d362bb2bd46a3fe5fdf4606c0cde806048820aa19"}
Jul 15 12:24:17.627208 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:17.627163    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tzlm6" podStartSLOduration=1.574381708 podStartE2EDuration="2.627149278s" totalImagesPullingTime="1.05276757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:24:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:24:17.625414088 +0000 UTC m=+804.739807822" watchObservedRunningTime="2026-07-15 12:24:17.627149278 +0000 UTC m=+804.741543010"
Jul 15 12:24:25.369591 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:25.369555    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tzlm6"
Jul 15 12:24:25.370070 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:25.369620    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tzlm6"
Jul 15 12:24:25.381775 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:25.381749    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tzlm6"
Jul 15 12:24:25.655483 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:25.655400    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tzlm6"
Jul 15 12:24:42.658341 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:42.658310    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6884f"]
Jul 15 12:24:42.661450 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:42.661428    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6884f"
Jul 15 12:24:42.664476 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:42.664458    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 15 12:24:42.671647 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:42.671627    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6884f"]
Jul 15 12:24:42.764583 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:42.764555    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbpg5\" (UniqueName: \"kubernetes.io/projected/535603e7-58e2-4207-a31a-19bb75f95d92-kube-api-access-bbpg5\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6884f\" (UID: \"535603e7-58e2-4207-a31a-19bb75f95d92\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6884f"
Jul 15 12:24:42.764722 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:42.764603    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/535603e7-58e2-4207-a31a-19bb75f95d92-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6884f\" (UID: \"535603e7-58e2-4207-a31a-19bb75f95d92\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6884f"
Jul 15 12:24:42.764722 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:42.764624    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/535603e7-58e2-4207-a31a-19bb75f95d92-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6884f\" (UID: \"535603e7-58e2-4207-a31a-19bb75f95d92\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6884f"
Jul 15 12:24:42.764847 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:42.764725    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/535603e7-58e2-4207-a31a-19bb75f95d92-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6884f\" (UID: \"535603e7-58e2-4207-a31a-19bb75f95d92\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6884f"
Jul 15 12:24:42.764847 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:42.764801    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/535603e7-58e2-4207-a31a-19bb75f95d92-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6884f\" (UID: \"535603e7-58e2-4207-a31a-19bb75f95d92\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6884f"
Jul 15 12:24:42.764847 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:42.764831    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/535603e7-58e2-4207-a31a-19bb75f95d92-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6884f\" (UID: \"535603e7-58e2-4207-a31a-19bb75f95d92\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6884f"
Jul 15 12:24:42.865654 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:42.865624    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/535603e7-58e2-4207-a31a-19bb75f95d92-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6884f\" (UID: \"535603e7-58e2-4207-a31a-19bb75f95d92\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6884f"
Jul 15 12:24:42.865771 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:42.865660    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/535603e7-58e2-4207-a31a-19bb75f95d92-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6884f\" (UID: \"535603e7-58e2-4207-a31a-19bb75f95d92\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6884f"
Jul 15 12:24:42.865771 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:42.865690    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/535603e7-58e2-4207-a31a-19bb75f95d92-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6884f\" (UID: \"535603e7-58e2-4207-a31a-19bb75f95d92\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6884f"
Jul 15 12:24:42.865771 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:42.865725    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/535603e7-58e2-4207-a31a-19bb75f95d92-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6884f\" (UID: \"535603e7-58e2-4207-a31a-19bb75f95d92\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6884f"
Jul 15 12:24:42.865771 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:42.865742    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/535603e7-58e2-4207-a31a-19bb75f95d92-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6884f\" (UID: \"535603e7-58e2-4207-a31a-19bb75f95d92\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6884f"
Jul 15 12:24:42.865771 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:42.865772    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbpg5\" (UniqueName: \"kubernetes.io/projected/535603e7-58e2-4207-a31a-19bb75f95d92-kube-api-access-bbpg5\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6884f\" (UID: \"535603e7-58e2-4207-a31a-19bb75f95d92\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6884f"
Jul 15 12:24:42.866070 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:42.866045    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/535603e7-58e2-4207-a31a-19bb75f95d92-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6884f\" (UID: \"535603e7-58e2-4207-a31a-19bb75f95d92\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6884f"
Jul 15 12:24:42.866132 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:42.866089    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/535603e7-58e2-4207-a31a-19bb75f95d92-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6884f\" (UID: \"535603e7-58e2-4207-a31a-19bb75f95d92\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6884f"
Jul 15 12:24:42.866175 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:42.866135    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/535603e7-58e2-4207-a31a-19bb75f95d92-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6884f\" (UID: \"535603e7-58e2-4207-a31a-19bb75f95d92\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6884f"
Jul 15 12:24:42.867892 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:42.867867    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/535603e7-58e2-4207-a31a-19bb75f95d92-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6884f\" (UID: \"535603e7-58e2-4207-a31a-19bb75f95d92\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6884f"
Jul 15 12:24:42.868188 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:42.868171    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/535603e7-58e2-4207-a31a-19bb75f95d92-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6884f\" (UID: \"535603e7-58e2-4207-a31a-19bb75f95d92\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6884f"
Jul 15 12:24:42.873765 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:42.873742    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbpg5\" (UniqueName: \"kubernetes.io/projected/535603e7-58e2-4207-a31a-19bb75f95d92-kube-api-access-bbpg5\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6884f\" (UID: \"535603e7-58e2-4207-a31a-19bb75f95d92\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6884f"
Jul 15 12:24:42.971962 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:42.971935    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6884f"
Jul 15 12:24:43.098163 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:43.098140    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6884f"]
Jul 15 12:24:43.099467 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:24:43.099434    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod535603e7_58e2_4207_a31a_19bb75f95d92.slice/crio-5fb0890a7da5a67913cb285fa6b799acef8e30b7f5702f4e691e13d4bdbed19e WatchSource:0}: Error finding container 5fb0890a7da5a67913cb285fa6b799acef8e30b7f5702f4e691e13d4bdbed19e: Status 404 returned error can't find the container with id 5fb0890a7da5a67913cb285fa6b799acef8e30b7f5702f4e691e13d4bdbed19e
Jul 15 12:24:43.732843 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:43.732802    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6884f" event={"ID":"535603e7-58e2-4207-a31a-19bb75f95d92","Type":"ContainerStarted","Data":"5613798cd2e878672a24f4888262af06b7e0b0b4e91d6d6ff2d9d0f99cbe25b5"}
Jul 15 12:24:43.733197 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:43.732859    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6884f" event={"ID":"535603e7-58e2-4207-a31a-19bb75f95d92","Type":"ContainerStarted","Data":"5fb0890a7da5a67913cb285fa6b799acef8e30b7f5702f4e691e13d4bdbed19e"}
Jul 15 12:24:43.750028 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:43.749976    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6884f" podStartSLOduration=1.466358185 podStartE2EDuration="1.749961334s" totalImagesPullingTime="283.603149ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:24:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:24:43.748719138 +0000 UTC m=+830.863112871" watchObservedRunningTime="2026-07-15 12:24:43.749961334 +0000 UTC m=+830.864355066"
Jul 15 12:24:52.972230 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:52.972197    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6884f"
Jul 15 12:24:52.972625 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:52.972276    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6884f"
Jul 15 12:24:52.984496 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:52.984473    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6884f"
Jul 15 12:24:53.792902 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:24:53.792870    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6884f"
Jul 15 12:25:00.744672 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:25:00.744639    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-snspz"]
Jul 15 12:25:00.747959 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:25:00.747934    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-snspz"
Jul 15 12:25:00.750697 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:25:00.750680    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 15 12:25:00.758951 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:25:00.758930    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-snspz"]
Jul 15 12:25:00.825907 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:25:00.825883    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a1e14e3-2950-44ab-879f-88d1c2c67c5a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-snspz\" (UID: \"1a1e14e3-2950-44ab-879f-88d1c2c67c5a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-snspz"
Jul 15 12:25:00.826027 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:25:00.825935    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a1e14e3-2950-44ab-879f-88d1c2c67c5a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-snspz\" (UID: \"1a1e14e3-2950-44ab-879f-88d1c2c67c5a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-snspz"
Jul 15 12:25:00.826027 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:25:00.826008    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a1e14e3-2950-44ab-879f-88d1c2c67c5a-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-snspz\" (UID: \"1a1e14e3-2950-44ab-879f-88d1c2c67c5a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-snspz"
Jul 15 12:25:00.826102 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:25:00.826030    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpl2j\" (UniqueName: \"kubernetes.io/projected/1a1e14e3-2950-44ab-879f-88d1c2c67c5a-kube-api-access-bpl2j\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-snspz\" (UID: \"1a1e14e3-2950-44ab-879f-88d1c2c67c5a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-snspz"
Jul 15 12:25:00.826102 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:25:00.826047    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a1e14e3-2950-44ab-879f-88d1c2c67c5a-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-snspz\" (UID: \"1a1e14e3-2950-44ab-879f-88d1c2c67c5a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-snspz"
Jul 15 12:25:00.826102 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:25:00.826080    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a1e14e3-2950-44ab-879f-88d1c2c67c5a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-snspz\" (UID: \"1a1e14e3-2950-44ab-879f-88d1c2c67c5a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-snspz"
Jul 15 12:25:00.927348 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:25:00.927322    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpl2j\" (UniqueName: \"kubernetes.io/projected/1a1e14e3-2950-44ab-879f-88d1c2c67c5a-kube-api-access-bpl2j\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-snspz\" (UID: \"1a1e14e3-2950-44ab-879f-88d1c2c67c5a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-snspz"
Jul 15 12:25:00.927447 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:25:00.927354    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a1e14e3-2950-44ab-879f-88d1c2c67c5a-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-snspz\" (UID: \"1a1e14e3-2950-44ab-879f-88d1c2c67c5a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-snspz"
Jul 15 12:25:00.927447 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:25:00.927374    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a1e14e3-2950-44ab-879f-88d1c2c67c5a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-snspz\" (UID: \"1a1e14e3-2950-44ab-879f-88d1c2c67c5a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-snspz"
Jul 15 12:25:00.927447 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:25:00.927434    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a1e14e3-2950-44ab-879f-88d1c2c67c5a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-snspz\" (UID: \"1a1e14e3-2950-44ab-879f-88d1c2c67c5a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-snspz"
Jul 15 12:25:00.927547 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:25:00.927490    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a1e14e3-2950-44ab-879f-88d1c2c67c5a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-snspz\" (UID: \"1a1e14e3-2950-44ab-879f-88d1c2c67c5a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-snspz"
Jul 15 12:25:00.927586 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:25:00.927548    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a1e14e3-2950-44ab-879f-88d1c2c67c5a-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-snspz\" (UID: \"1a1e14e3-2950-44ab-879f-88d1c2c67c5a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-snspz"
Jul 15 12:25:00.927797 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:25:00.927776    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a1e14e3-2950-44ab-879f-88d1c2c67c5a-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-snspz\" (UID: \"1a1e14e3-2950-44ab-879f-88d1c2c67c5a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-snspz"
Jul 15 12:25:00.927836 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:25:00.927816    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a1e14e3-2950-44ab-879f-88d1c2c67c5a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-snspz\" (UID: \"1a1e14e3-2950-44ab-879f-88d1c2c67c5a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-snspz"
Jul 15 12:25:00.927872 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:25:00.927839    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a1e14e3-2950-44ab-879f-88d1c2c67c5a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-snspz\" (UID: \"1a1e14e3-2950-44ab-879f-88d1c2c67c5a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-snspz"
Jul 15 12:25:00.929643 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:25:00.929617    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a1e14e3-2950-44ab-879f-88d1c2c67c5a-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-snspz\" (UID: \"1a1e14e3-2950-44ab-879f-88d1c2c67c5a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-snspz"
Jul 15 12:25:00.929997 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:25:00.929979    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a1e14e3-2950-44ab-879f-88d1c2c67c5a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-snspz\" (UID: \"1a1e14e3-2950-44ab-879f-88d1c2c67c5a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-snspz"
Jul 15 12:25:00.934996 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:25:00.934973    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpl2j\" (UniqueName: \"kubernetes.io/projected/1a1e14e3-2950-44ab-879f-88d1c2c67c5a-kube-api-access-bpl2j\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-snspz\" (UID: \"1a1e14e3-2950-44ab-879f-88d1c2c67c5a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-snspz"
Jul 15 12:25:01.057063 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:25:01.056994    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-snspz"
Jul 15 12:25:01.182328 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:25:01.182280    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-snspz"]
Jul 15 12:25:01.183766 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:25:01.183729    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1a1e14e3_2950_44ab_879f_88d1c2c67c5a.slice/crio-537c1aeb80977d019c68a4be8493cde7e69f63326b0e383b7310bbf7365d1eb8 WatchSource:0}: Error finding container 537c1aeb80977d019c68a4be8493cde7e69f63326b0e383b7310bbf7365d1eb8: Status 404 returned error can't find the container with id 537c1aeb80977d019c68a4be8493cde7e69f63326b0e383b7310bbf7365d1eb8
Jul 15 12:25:01.818857 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:25:01.818822    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-snspz" event={"ID":"1a1e14e3-2950-44ab-879f-88d1c2c67c5a","Type":"ContainerStarted","Data":"734481f372a2a31d297eff62780c63af30dd0208009bf6cc449d4486609429bb"}
Jul 15 12:25:01.819213 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:25:01.818868    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-snspz" event={"ID":"1a1e14e3-2950-44ab-879f-88d1c2c67c5a","Type":"ContainerStarted","Data":"537c1aeb80977d019c68a4be8493cde7e69f63326b0e383b7310bbf7365d1eb8"}
Jul 15 12:25:01.837552 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:25:01.837500    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-snspz" podStartSLOduration=1.608019991 podStartE2EDuration="1.837484069s" totalImagesPullingTime="229.464078ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:25:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:25:01.835483283 +0000 UTC m=+848.949877029" watchObservedRunningTime="2026-07-15 12:25:01.837484069 +0000 UTC m=+848.951877828"
Jul 15 12:25:11.058017 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:25:11.057980    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-snspz"
Jul 15 12:25:11.058517 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:25:11.058185    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-snspz"
Jul 15 12:25:11.070270 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:25:11.070245    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-snspz"
Jul 15 12:25:11.877993 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:25:11.877965    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-snspz"
Jul 15 12:25:53.389237 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:25:53.389171    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xkvbf_641b0ffa-0450-4198-8066-0241ab179822/console-operator/2.log"
Jul 15 12:25:53.390289 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:25:53.390267    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xkvbf_641b0ffa-0450-4198-8066-0241ab179822/console-operator/2.log"
Jul 15 12:25:53.407259 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:25:53.407236    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xh4rs_2de62ab2-7502-4c13-a6f0-5ebbd4982798/ovn-acl-logging/0.log"
Jul 15 12:25:53.407963 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:25:53.407943    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xh4rs_2de62ab2-7502-4c13-a6f0-5ebbd4982798/ovn-acl-logging/0.log"
Jul 15 12:26:19.306150 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:26:19.306115    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-65c66d9785-79hcq"]
Jul 15 12:26:19.309277 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:26:19.309257    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65c66d9785-79hcq"
Jul 15 12:26:19.317146 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:26:19.317124    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-65c66d9785-79hcq"]
Jul 15 12:26:19.420861 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:26:19.420830    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9b097ec9-054f-4ab8-be07-683ab679141d-tls-cert\") pod \"authorino-65c66d9785-79hcq\" (UID: \"9b097ec9-054f-4ab8-be07-683ab679141d\") " pod="kuadrant-system/authorino-65c66d9785-79hcq"
Jul 15 12:26:19.420861 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:26:19.420873    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtvpr\" (UniqueName: \"kubernetes.io/projected/9b097ec9-054f-4ab8-be07-683ab679141d-kube-api-access-wtvpr\") pod \"authorino-65c66d9785-79hcq\" (UID: \"9b097ec9-054f-4ab8-be07-683ab679141d\") " pod="kuadrant-system/authorino-65c66d9785-79hcq"
Jul 15 12:26:19.522416 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:26:19.522383    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9b097ec9-054f-4ab8-be07-683ab679141d-tls-cert\") pod \"authorino-65c66d9785-79hcq\" (UID: \"9b097ec9-054f-4ab8-be07-683ab679141d\") " pod="kuadrant-system/authorino-65c66d9785-79hcq"
Jul 15 12:26:19.522581 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:26:19.522423    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtvpr\" (UniqueName: \"kubernetes.io/projected/9b097ec9-054f-4ab8-be07-683ab679141d-kube-api-access-wtvpr\") pod \"authorino-65c66d9785-79hcq\" (UID: \"9b097ec9-054f-4ab8-be07-683ab679141d\") " pod="kuadrant-system/authorino-65c66d9785-79hcq"
Jul 15 12:26:19.524790 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:26:19.524768    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9b097ec9-054f-4ab8-be07-683ab679141d-tls-cert\") pod \"authorino-65c66d9785-79hcq\" (UID: \"9b097ec9-054f-4ab8-be07-683ab679141d\") " pod="kuadrant-system/authorino-65c66d9785-79hcq"
Jul 15 12:26:19.530700 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:26:19.530675    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtvpr\" (UniqueName: \"kubernetes.io/projected/9b097ec9-054f-4ab8-be07-683ab679141d-kube-api-access-wtvpr\") pod \"authorino-65c66d9785-79hcq\" (UID: \"9b097ec9-054f-4ab8-be07-683ab679141d\") " pod="kuadrant-system/authorino-65c66d9785-79hcq"
Jul 15 12:26:19.620051 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:26:19.619983    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65c66d9785-79hcq"
Jul 15 12:26:19.756382 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:26:19.756358    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-65c66d9785-79hcq"]
Jul 15 12:26:19.758347 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:26:19.758321    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9b097ec9_054f_4ab8_be07_683ab679141d.slice/crio-859bf33cf270b36cdafffb9aef019f12572a4d27b91d600ea436470d85a939ce WatchSource:0}: Error finding container 859bf33cf270b36cdafffb9aef019f12572a4d27b91d600ea436470d85a939ce: Status 404 returned error can't find the container with id 859bf33cf270b36cdafffb9aef019f12572a4d27b91d600ea436470d85a939ce
Jul 15 12:26:19.759706 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:26:19.759679    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 12:26:20.184540 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:26:20.184502    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-65c66d9785-79hcq" event={"ID":"9b097ec9-054f-4ab8-be07-683ab679141d","Type":"ContainerStarted","Data":"859bf33cf270b36cdafffb9aef019f12572a4d27b91d600ea436470d85a939ce"}
Jul 15 12:26:21.191961 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:26:21.191920    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-65c66d9785-79hcq" event={"ID":"9b097ec9-054f-4ab8-be07-683ab679141d","Type":"ContainerStarted","Data":"ba75a6b6677a2913fe6080722c9cb83e71d1b30ce8a0d9b70b15de77482f6474"}
Jul 15 12:26:21.210945 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:26:21.210885    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-65c66d9785-79hcq" podStartSLOduration=1.779204026 podStartE2EDuration="2.210860332s" totalImagesPullingTime="431.656306ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:26:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:26:21.208936053 +0000 UTC m=+928.323329785" watchObservedRunningTime="2026-07-15 12:26:21.210860332 +0000 UTC m=+928.325254065"
Jul 15 12:26:21.248047 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:26:21.248011    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-d4bc9b8d4-pmwzk"]
Jul 15 12:26:21.248274 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:26:21.248243    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-d4bc9b8d4-pmwzk" podUID="a31ddc6a-2df3-45c9-94ed-f47d3a1199d0" containerName="authorino" containerID="cri-o://d27e6e0c8bb25057bfc7d014738342e2c6763ae822b60524f0cc4db59ad82904" gracePeriod=30
Jul 15 12:26:21.519221 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:26:21.519192    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d4bc9b8d4-pmwzk"
Jul 15 12:26:21.644993 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:26:21.644955    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a31ddc6a-2df3-45c9-94ed-f47d3a1199d0-tls-cert\") pod \"a31ddc6a-2df3-45c9-94ed-f47d3a1199d0\" (UID: \"a31ddc6a-2df3-45c9-94ed-f47d3a1199d0\") "
Jul 15 12:26:21.645157 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:26:21.645018    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cflf2\" (UniqueName: \"kubernetes.io/projected/a31ddc6a-2df3-45c9-94ed-f47d3a1199d0-kube-api-access-cflf2\") pod \"a31ddc6a-2df3-45c9-94ed-f47d3a1199d0\" (UID: \"a31ddc6a-2df3-45c9-94ed-f47d3a1199d0\") "
Jul 15 12:26:21.647013 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:26:21.646985    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a31ddc6a-2df3-45c9-94ed-f47d3a1199d0-kube-api-access-cflf2" (OuterVolumeSpecName: "kube-api-access-cflf2") pod "a31ddc6a-2df3-45c9-94ed-f47d3a1199d0" (UID: "a31ddc6a-2df3-45c9-94ed-f47d3a1199d0"). InnerVolumeSpecName "kube-api-access-cflf2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:26:21.655081 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:26:21.655053    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a31ddc6a-2df3-45c9-94ed-f47d3a1199d0-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "a31ddc6a-2df3-45c9-94ed-f47d3a1199d0" (UID: "a31ddc6a-2df3-45c9-94ed-f47d3a1199d0"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:26:21.746149 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:26:21.746115    2560 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a31ddc6a-2df3-45c9-94ed-f47d3a1199d0-tls-cert\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:26:21.746149 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:26:21.746144    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cflf2\" (UniqueName: \"kubernetes.io/projected/a31ddc6a-2df3-45c9-94ed-f47d3a1199d0-kube-api-access-cflf2\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:26:22.197619 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:26:22.197580    2560 generic.go:356] "Generic (PLEG): container finished" podID="a31ddc6a-2df3-45c9-94ed-f47d3a1199d0" containerID="d27e6e0c8bb25057bfc7d014738342e2c6763ae822b60524f0cc4db59ad82904" exitCode=0
Jul 15 12:26:22.198099 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:26:22.197630    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d4bc9b8d4-pmwzk"
Jul 15 12:26:22.198099 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:26:22.197672    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d4bc9b8d4-pmwzk" event={"ID":"a31ddc6a-2df3-45c9-94ed-f47d3a1199d0","Type":"ContainerDied","Data":"d27e6e0c8bb25057bfc7d014738342e2c6763ae822b60524f0cc4db59ad82904"}
Jul 15 12:26:22.198099 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:26:22.197710    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d4bc9b8d4-pmwzk" event={"ID":"a31ddc6a-2df3-45c9-94ed-f47d3a1199d0","Type":"ContainerDied","Data":"df7059840b0d32dbf0f722a067e82983f5680d26498a467e5362e776bbeef98d"}
Jul 15 12:26:22.198099 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:26:22.197725    2560 scope.go:117] "RemoveContainer" containerID="d27e6e0c8bb25057bfc7d014738342e2c6763ae822b60524f0cc4db59ad82904"
Jul 15 12:26:22.207534 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:26:22.207518    2560 scope.go:117] "RemoveContainer" containerID="d27e6e0c8bb25057bfc7d014738342e2c6763ae822b60524f0cc4db59ad82904"
Jul 15 12:26:22.207797 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:26:22.207777    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d27e6e0c8bb25057bfc7d014738342e2c6763ae822b60524f0cc4db59ad82904\": container with ID starting with d27e6e0c8bb25057bfc7d014738342e2c6763ae822b60524f0cc4db59ad82904 not found: ID does not exist" containerID="d27e6e0c8bb25057bfc7d014738342e2c6763ae822b60524f0cc4db59ad82904"
Jul 15 12:26:22.207875 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:26:22.207808    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d27e6e0c8bb25057bfc7d014738342e2c6763ae822b60524f0cc4db59ad82904"} err="failed to get container status \"d27e6e0c8bb25057bfc7d014738342e2c6763ae822b60524f0cc4db59ad82904\": rpc error: code = NotFound desc = could not find container \"d27e6e0c8bb25057bfc7d014738342e2c6763ae822b60524f0cc4db59ad82904\": container with ID starting with d27e6e0c8bb25057bfc7d014738342e2c6763ae822b60524f0cc4db59ad82904 not found: ID does not exist"
Jul 15 12:26:22.220560 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:26:22.220537    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-d4bc9b8d4-pmwzk"]
Jul 15 12:26:22.224889 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:26:22.224865    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-d4bc9b8d4-pmwzk"]
Jul 15 12:26:23.444239 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:26:23.444207    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a31ddc6a-2df3-45c9-94ed-f47d3a1199d0" path="/var/lib/kubelet/pods/a31ddc6a-2df3-45c9-94ed-f47d3a1199d0/volumes"
Jul 15 12:30:53.429096 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:30:53.429024    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xkvbf_641b0ffa-0450-4198-8066-0241ab179822/console-operator/2.log"
Jul 15 12:30:53.431131 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:30:53.431107    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xkvbf_641b0ffa-0450-4198-8066-0241ab179822/console-operator/2.log"
Jul 15 12:30:53.439237 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:30:53.439215    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xh4rs_2de62ab2-7502-4c13-a6f0-5ebbd4982798/ovn-acl-logging/0.log"
Jul 15 12:30:53.441480 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:30:53.441463    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xh4rs_2de62ab2-7502-4c13-a6f0-5ebbd4982798/ovn-acl-logging/0.log"
Jul 15 12:35:53.459221 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:35:53.459195    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xkvbf_641b0ffa-0450-4198-8066-0241ab179822/console-operator/2.log"
Jul 15 12:35:53.463836 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:35:53.463814    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xkvbf_641b0ffa-0450-4198-8066-0241ab179822/console-operator/2.log"
Jul 15 12:35:53.471237 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:35:53.471211    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xh4rs_2de62ab2-7502-4c13-a6f0-5ebbd4982798/ovn-acl-logging/0.log"
Jul 15 12:35:53.482588 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:35:53.482565    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xh4rs_2de62ab2-7502-4c13-a6f0-5ebbd4982798/ovn-acl-logging/0.log"
Jul 15 12:40:53.492137 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:40:53.492112    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xkvbf_641b0ffa-0450-4198-8066-0241ab179822/console-operator/2.log"
Jul 15 12:40:53.503628 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:40:53.503604    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xh4rs_2de62ab2-7502-4c13-a6f0-5ebbd4982798/ovn-acl-logging/0.log"
Jul 15 12:40:53.506314 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:40:53.506277    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xkvbf_641b0ffa-0450-4198-8066-0241ab179822/console-operator/2.log"
Jul 15 12:40:53.514805 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:40:53.514789    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xh4rs_2de62ab2-7502-4c13-a6f0-5ebbd4982798/ovn-acl-logging/0.log"
Jul 15 12:45:53.523947 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:45:53.523875    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xkvbf_641b0ffa-0450-4198-8066-0241ab179822/console-operator/2.log"
Jul 15 12:45:53.532312 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:45:53.532270    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xh4rs_2de62ab2-7502-4c13-a6f0-5ebbd4982798/ovn-acl-logging/0.log"
Jul 15 12:45:53.536223 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:45:53.536205    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xkvbf_641b0ffa-0450-4198-8066-0241ab179822/console-operator/2.log"
Jul 15 12:45:53.543954 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:45:53.543936    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xh4rs_2de62ab2-7502-4c13-a6f0-5ebbd4982798/ovn-acl-logging/0.log"
Jul 15 12:47:13.551953 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:47:13.551922    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-e1773daa/e2e-lifecycle-model-e1773daa-kserve-6b6bbfdb87-g4zzd"]
Jul 15 12:47:13.552398 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:47:13.552264    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a31ddc6a-2df3-45c9-94ed-f47d3a1199d0" containerName="authorino"
Jul 15 12:47:13.552398 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:47:13.552276    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a31ddc6a-2df3-45c9-94ed-f47d3a1199d0" containerName="authorino"
Jul 15 12:47:13.552484 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:47:13.552409    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a31ddc6a-2df3-45c9-94ed-f47d3a1199d0" containerName="authorino"
Jul 15 12:47:13.555550 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:47:13.555529    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-e1773daa/e2e-lifecycle-model-e1773daa-kserve-6b6bbfdb87-g4zzd"
Jul 15 12:47:13.559428 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:47:13.559405    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-e1773daa\"/\"openshift-service-ca.crt\""
Jul 15 12:47:13.559428 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:47:13.559423    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-e1773daa\"/\"default-dockercfg-sbbtv\""
Jul 15 12:47:13.559627 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:47:13.559408    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-e1773daa\"/\"kube-root-ca.crt\""
Jul 15 12:47:13.559627 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:47:13.559431    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-e1773daa\"/\"e2e-lifecycle-model-e1773daa-kserve-self-signed-certs\""
Jul 15 12:47:13.565713 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:47:13.565691    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-e1773daa/e2e-lifecycle-model-e1773daa-kserve-6b6bbfdb87-g4zzd"]
Jul 15 12:47:13.590263 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:47:13.590237    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b673fa1-c222-4654-81ce-acb8495d3c09-home\") pod \"e2e-lifecycle-model-e1773daa-kserve-6b6bbfdb87-g4zzd\" (UID: \"8b673fa1-c222-4654-81ce-acb8495d3c09\") " pod="ai-tenant-e2e-mt-e1773daa/e2e-lifecycle-model-e1773daa-kserve-6b6bbfdb87-g4zzd"
Jul 15 12:47:13.590411 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:47:13.590276    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b673fa1-c222-4654-81ce-acb8495d3c09-model-cache\") pod \"e2e-lifecycle-model-e1773daa-kserve-6b6bbfdb87-g4zzd\" (UID: \"8b673fa1-c222-4654-81ce-acb8495d3c09\") " pod="ai-tenant-e2e-mt-e1773daa/e2e-lifecycle-model-e1773daa-kserve-6b6bbfdb87-g4zzd"
Jul 15 12:47:13.590411 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:47:13.590332    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7nnw\" (UniqueName: \"kubernetes.io/projected/8b673fa1-c222-4654-81ce-acb8495d3c09-kube-api-access-h7nnw\") pod \"e2e-lifecycle-model-e1773daa-kserve-6b6bbfdb87-g4zzd\" (UID: \"8b673fa1-c222-4654-81ce-acb8495d3c09\") " pod="ai-tenant-e2e-mt-e1773daa/e2e-lifecycle-model-e1773daa-kserve-6b6bbfdb87-g4zzd"
Jul 15 12:47:13.590411 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:47:13.590357    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b673fa1-c222-4654-81ce-acb8495d3c09-tmp-dir\") pod \"e2e-lifecycle-model-e1773daa-kserve-6b6bbfdb87-g4zzd\" (UID: \"8b673fa1-c222-4654-81ce-acb8495d3c09\") " pod="ai-tenant-e2e-mt-e1773daa/e2e-lifecycle-model-e1773daa-kserve-6b6bbfdb87-g4zzd"
Jul 15 12:47:13.590411 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:47:13.590373    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b673fa1-c222-4654-81ce-acb8495d3c09-tls-certs\") pod \"e2e-lifecycle-model-e1773daa-kserve-6b6bbfdb87-g4zzd\" (UID: \"8b673fa1-c222-4654-81ce-acb8495d3c09\") " pod="ai-tenant-e2e-mt-e1773daa/e2e-lifecycle-model-e1773daa-kserve-6b6bbfdb87-g4zzd"
Jul 15 12:47:13.590563 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:47:13.590439    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b673fa1-c222-4654-81ce-acb8495d3c09-dshm\") pod \"e2e-lifecycle-model-e1773daa-kserve-6b6bbfdb87-g4zzd\" (UID: \"8b673fa1-c222-4654-81ce-acb8495d3c09\") " pod="ai-tenant-e2e-mt-e1773daa/e2e-lifecycle-model-e1773daa-kserve-6b6bbfdb87-g4zzd"
Jul 15 12:47:13.691032 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:47:13.691002    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b673fa1-c222-4654-81ce-acb8495d3c09-home\") pod \"e2e-lifecycle-model-e1773daa-kserve-6b6bbfdb87-g4zzd\" (UID: \"8b673fa1-c222-4654-81ce-acb8495d3c09\") " pod="ai-tenant-e2e-mt-e1773daa/e2e-lifecycle-model-e1773daa-kserve-6b6bbfdb87-g4zzd"
Jul 15 12:47:13.691166 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:47:13.691045    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b673fa1-c222-4654-81ce-acb8495d3c09-model-cache\") pod \"e2e-lifecycle-model-e1773daa-kserve-6b6bbfdb87-g4zzd\" (UID: \"8b673fa1-c222-4654-81ce-acb8495d3c09\") " pod="ai-tenant-e2e-mt-e1773daa/e2e-lifecycle-model-e1773daa-kserve-6b6bbfdb87-g4zzd"
Jul 15 12:47:13.691166 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:47:13.691066    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7nnw\" (UniqueName: \"kubernetes.io/projected/8b673fa1-c222-4654-81ce-acb8495d3c09-kube-api-access-h7nnw\") pod \"e2e-lifecycle-model-e1773daa-kserve-6b6bbfdb87-g4zzd\" (UID: \"8b673fa1-c222-4654-81ce-acb8495d3c09\") " pod="ai-tenant-e2e-mt-e1773daa/e2e-lifecycle-model-e1773daa-kserve-6b6bbfdb87-g4zzd"
Jul 15 12:47:13.691166 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:47:13.691088    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b673fa1-c222-4654-81ce-acb8495d3c09-tmp-dir\") pod \"e2e-lifecycle-model-e1773daa-kserve-6b6bbfdb87-g4zzd\" (UID: \"8b673fa1-c222-4654-81ce-acb8495d3c09\") " pod="ai-tenant-e2e-mt-e1773daa/e2e-lifecycle-model-e1773daa-kserve-6b6bbfdb87-g4zzd"
Jul 15 12:47:13.691166 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:47:13.691108    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b673fa1-c222-4654-81ce-acb8495d3c09-tls-certs\") pod \"e2e-lifecycle-model-e1773daa-kserve-6b6bbfdb87-g4zzd\" (UID: \"8b673fa1-c222-4654-81ce-acb8495d3c09\") " pod="ai-tenant-e2e-mt-e1773daa/e2e-lifecycle-model-e1773daa-kserve-6b6bbfdb87-g4zzd"
Jul 15 12:47:13.691166 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:47:13.691152    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b673fa1-c222-4654-81ce-acb8495d3c09-dshm\") pod \"e2e-lifecycle-model-e1773daa-kserve-6b6bbfdb87-g4zzd\" (UID: \"8b673fa1-c222-4654-81ce-acb8495d3c09\") " pod="ai-tenant-e2e-mt-e1773daa/e2e-lifecycle-model-e1773daa-kserve-6b6bbfdb87-g4zzd"
Jul 15 12:47:13.691540 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:47:13.691517    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b673fa1-c222-4654-81ce-acb8495d3c09-model-cache\") pod \"e2e-lifecycle-model-e1773daa-kserve-6b6bbfdb87-g4zzd\" (UID: \"8b673fa1-c222-4654-81ce-acb8495d3c09\") " pod="ai-tenant-e2e-mt-e1773daa/e2e-lifecycle-model-e1773daa-kserve-6b6bbfdb87-g4zzd"
Jul 15 12:47:13.691583 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:47:13.691553    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b673fa1-c222-4654-81ce-acb8495d3c09-home\") pod \"e2e-lifecycle-model-e1773daa-kserve-6b6bbfdb87-g4zzd\" (UID: \"8b673fa1-c222-4654-81ce-acb8495d3c09\") " pod="ai-tenant-e2e-mt-e1773daa/e2e-lifecycle-model-e1773daa-kserve-6b6bbfdb87-g4zzd"
Jul 15 12:47:13.691583 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:47:13.691569    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b673fa1-c222-4654-81ce-acb8495d3c09-tmp-dir\") pod \"e2e-lifecycle-model-e1773daa-kserve-6b6bbfdb87-g4zzd\" (UID: \"8b673fa1-c222-4654-81ce-acb8495d3c09\") " pod="ai-tenant-e2e-mt-e1773daa/e2e-lifecycle-model-e1773daa-kserve-6b6bbfdb87-g4zzd"
Jul 15 12:47:13.693400 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:47:13.693378    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b673fa1-c222-4654-81ce-acb8495d3c09-dshm\") pod \"e2e-lifecycle-model-e1773daa-kserve-6b6bbfdb87-g4zzd\" (UID: \"8b673fa1-c222-4654-81ce-acb8495d3c09\") " pod="ai-tenant-e2e-mt-e1773daa/e2e-lifecycle-model-e1773daa-kserve-6b6bbfdb87-g4zzd"
Jul 15 12:47:13.693664 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:47:13.693646    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b673fa1-c222-4654-81ce-acb8495d3c09-tls-certs\") pod \"e2e-lifecycle-model-e1773daa-kserve-6b6bbfdb87-g4zzd\" (UID: \"8b673fa1-c222-4654-81ce-acb8495d3c09\") " pod="ai-tenant-e2e-mt-e1773daa/e2e-lifecycle-model-e1773daa-kserve-6b6bbfdb87-g4zzd"
Jul 15 12:47:13.698383 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:47:13.698356    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7nnw\" (UniqueName: \"kubernetes.io/projected/8b673fa1-c222-4654-81ce-acb8495d3c09-kube-api-access-h7nnw\") pod \"e2e-lifecycle-model-e1773daa-kserve-6b6bbfdb87-g4zzd\" (UID: \"8b673fa1-c222-4654-81ce-acb8495d3c09\") " pod="ai-tenant-e2e-mt-e1773daa/e2e-lifecycle-model-e1773daa-kserve-6b6bbfdb87-g4zzd"
Jul 15 12:47:13.865496 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:47:13.865415    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-e1773daa/e2e-lifecycle-model-e1773daa-kserve-6b6bbfdb87-g4zzd"
Jul 15 12:47:13.996917 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:47:13.996893    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-e1773daa/e2e-lifecycle-model-e1773daa-kserve-6b6bbfdb87-g4zzd"]
Jul 15 12:47:13.999400 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:47:13.999374    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8b673fa1_c222_4654_81ce_acb8495d3c09.slice/crio-e183b0c20bb5979760ef591f803d999cd61dc149f82439ed14730594aff26ccc WatchSource:0}: Error finding container e183b0c20bb5979760ef591f803d999cd61dc149f82439ed14730594aff26ccc: Status 404 returned error can't find the container with id e183b0c20bb5979760ef591f803d999cd61dc149f82439ed14730594aff26ccc
Jul 15 12:47:14.086252 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:47:14.086214    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-e1773daa/e2e-lifecycle-model-e1773daa-kserve-6b6bbfdb87-g4zzd" event={"ID":"8b673fa1-c222-4654-81ce-acb8495d3c09","Type":"ContainerStarted","Data":"bfab87d8456baf6d22600dd4eb2a346ded6839691e6fbc04421df3da394d9b34"}
Jul 15 12:47:14.086406 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:47:14.086271    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-e1773daa/e2e-lifecycle-model-e1773daa-kserve-6b6bbfdb87-g4zzd" event={"ID":"8b673fa1-c222-4654-81ce-acb8495d3c09","Type":"ContainerStarted","Data":"e183b0c20bb5979760ef591f803d999cd61dc149f82439ed14730594aff26ccc"}
Jul 15 12:47:14.101922 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:47:14.101878    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-e1773daa/e2e-lifecycle-model-e1773daa-kserve-6b6bbfdb87-g4zzd" podStartSLOduration=1.101864274 podStartE2EDuration="1.101864274s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:47:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:47:14.10112372 +0000 UTC m=+2181.215517453" watchObservedRunningTime="2026-07-15 12:47:14.101864274 +0000 UTC m=+2181.216258006"
Jul 15 12:47:23.865852 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:47:23.865822    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-e1773daa/e2e-lifecycle-model-e1773daa-kserve-6b6bbfdb87-g4zzd"
Jul 15 12:47:23.866341 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:47:23.865869    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-e1773daa/e2e-lifecycle-model-e1773daa-kserve-6b6bbfdb87-g4zzd"
Jul 15 12:47:23.878400 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:47:23.878378    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-e1773daa/e2e-lifecycle-model-e1773daa-kserve-6b6bbfdb87-g4zzd"
Jul 15 12:47:24.157792 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:47:24.157711    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-e1773daa/e2e-lifecycle-model-e1773daa-kserve-6b6bbfdb87-g4zzd"
Jul 15 12:48:00.342738 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:48:00.342697    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-e1773daa/e2e-lifecycle-model-e1773daa-kserve-6b6bbfdb87-g4zzd"]
Jul 15 12:48:15.366407 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:48:15.366279    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-e1773daa/e2e-lifecycle-model-e1773daa-kserve-6b6bbfdb87-g4zzd" podUID="8b673fa1-c222-4654-81ce-acb8495d3c09" containerName="main" containerID="cri-o://bfab87d8456baf6d22600dd4eb2a346ded6839691e6fbc04421df3da394d9b34" gracePeriod=45
Jul 15 12:48:15.619667 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:48:15.619608    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-e1773daa/e2e-lifecycle-model-e1773daa-kserve-6b6bbfdb87-g4zzd"
Jul 15 12:48:15.762399 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:48:15.762360    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b673fa1-c222-4654-81ce-acb8495d3c09-dshm\") pod \"8b673fa1-c222-4654-81ce-acb8495d3c09\" (UID: \"8b673fa1-c222-4654-81ce-acb8495d3c09\") "
Jul 15 12:48:15.762557 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:48:15.762417    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b673fa1-c222-4654-81ce-acb8495d3c09-home\") pod \"8b673fa1-c222-4654-81ce-acb8495d3c09\" (UID: \"8b673fa1-c222-4654-81ce-acb8495d3c09\") "
Jul 15 12:48:15.762557 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:48:15.762480    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b673fa1-c222-4654-81ce-acb8495d3c09-model-cache\") pod \"8b673fa1-c222-4654-81ce-acb8495d3c09\" (UID: \"8b673fa1-c222-4654-81ce-acb8495d3c09\") "
Jul 15 12:48:15.762557 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:48:15.762508    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7nnw\" (UniqueName: \"kubernetes.io/projected/8b673fa1-c222-4654-81ce-acb8495d3c09-kube-api-access-h7nnw\") pod \"8b673fa1-c222-4654-81ce-acb8495d3c09\" (UID: \"8b673fa1-c222-4654-81ce-acb8495d3c09\") "
Jul 15 12:48:15.762557 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:48:15.762552    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b673fa1-c222-4654-81ce-acb8495d3c09-tmp-dir\") pod \"8b673fa1-c222-4654-81ce-acb8495d3c09\" (UID: \"8b673fa1-c222-4654-81ce-acb8495d3c09\") "
Jul 15 12:48:15.762720 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:48:15.762598    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b673fa1-c222-4654-81ce-acb8495d3c09-tls-certs\") pod \"8b673fa1-c222-4654-81ce-acb8495d3c09\" (UID: \"8b673fa1-c222-4654-81ce-acb8495d3c09\") "
Jul 15 12:48:15.762781 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:48:15.762721    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b673fa1-c222-4654-81ce-acb8495d3c09-home" (OuterVolumeSpecName: "home") pod "8b673fa1-c222-4654-81ce-acb8495d3c09" (UID: "8b673fa1-c222-4654-81ce-acb8495d3c09"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:48:15.762781 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:48:15.762733    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b673fa1-c222-4654-81ce-acb8495d3c09-model-cache" (OuterVolumeSpecName: "model-cache") pod "8b673fa1-c222-4654-81ce-acb8495d3c09" (UID: "8b673fa1-c222-4654-81ce-acb8495d3c09"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:48:15.762890 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:48:15.762828    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b673fa1-c222-4654-81ce-acb8495d3c09-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8b673fa1-c222-4654-81ce-acb8495d3c09" (UID: "8b673fa1-c222-4654-81ce-acb8495d3c09"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:48:15.762947 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:48:15.762920    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b673fa1-c222-4654-81ce-acb8495d3c09-home\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:48:15.762947 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:48:15.762938    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b673fa1-c222-4654-81ce-acb8495d3c09-model-cache\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:48:15.763029 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:48:15.762965    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b673fa1-c222-4654-81ce-acb8495d3c09-tmp-dir\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:48:15.764593 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:48:15.764569    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b673fa1-c222-4654-81ce-acb8495d3c09-dshm" (OuterVolumeSpecName: "dshm") pod "8b673fa1-c222-4654-81ce-acb8495d3c09" (UID: "8b673fa1-c222-4654-81ce-acb8495d3c09"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:48:15.764721 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:48:15.764622    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b673fa1-c222-4654-81ce-acb8495d3c09-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8b673fa1-c222-4654-81ce-acb8495d3c09" (UID: "8b673fa1-c222-4654-81ce-acb8495d3c09"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:48:15.764721 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:48:15.764678    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b673fa1-c222-4654-81ce-acb8495d3c09-kube-api-access-h7nnw" (OuterVolumeSpecName: "kube-api-access-h7nnw") pod "8b673fa1-c222-4654-81ce-acb8495d3c09" (UID: "8b673fa1-c222-4654-81ce-acb8495d3c09"). InnerVolumeSpecName "kube-api-access-h7nnw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:48:15.864054 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:48:15.864026    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7nnw\" (UniqueName: \"kubernetes.io/projected/8b673fa1-c222-4654-81ce-acb8495d3c09-kube-api-access-h7nnw\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:48:15.864054 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:48:15.864052    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b673fa1-c222-4654-81ce-acb8495d3c09-tls-certs\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:48:15.864228 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:48:15.864063    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b673fa1-c222-4654-81ce-acb8495d3c09-dshm\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:48:16.396163 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:48:16.396130    2560 generic.go:356] "Generic (PLEG): container finished" podID="8b673fa1-c222-4654-81ce-acb8495d3c09" containerID="bfab87d8456baf6d22600dd4eb2a346ded6839691e6fbc04421df3da394d9b34" exitCode=0
Jul 15 12:48:16.396664 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:48:16.396173    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-e1773daa/e2e-lifecycle-model-e1773daa-kserve-6b6bbfdb87-g4zzd"
Jul 15 12:48:16.396664 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:48:16.396168    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-e1773daa/e2e-lifecycle-model-e1773daa-kserve-6b6bbfdb87-g4zzd" event={"ID":"8b673fa1-c222-4654-81ce-acb8495d3c09","Type":"ContainerDied","Data":"bfab87d8456baf6d22600dd4eb2a346ded6839691e6fbc04421df3da394d9b34"}
Jul 15 12:48:16.396664 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:48:16.396284    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-e1773daa/e2e-lifecycle-model-e1773daa-kserve-6b6bbfdb87-g4zzd" event={"ID":"8b673fa1-c222-4654-81ce-acb8495d3c09","Type":"ContainerDied","Data":"e183b0c20bb5979760ef591f803d999cd61dc149f82439ed14730594aff26ccc"}
Jul 15 12:48:16.396664 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:48:16.396321    2560 scope.go:117] "RemoveContainer" containerID="bfab87d8456baf6d22600dd4eb2a346ded6839691e6fbc04421df3da394d9b34"
Jul 15 12:48:16.405333 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:48:16.405289    2560 scope.go:117] "RemoveContainer" containerID="bfab87d8456baf6d22600dd4eb2a346ded6839691e6fbc04421df3da394d9b34"
Jul 15 12:48:16.405577 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:48:16.405561    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfab87d8456baf6d22600dd4eb2a346ded6839691e6fbc04421df3da394d9b34\": container with ID starting with bfab87d8456baf6d22600dd4eb2a346ded6839691e6fbc04421df3da394d9b34 not found: ID does not exist" containerID="bfab87d8456baf6d22600dd4eb2a346ded6839691e6fbc04421df3da394d9b34"
Jul 15 12:48:16.405630 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:48:16.405588    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfab87d8456baf6d22600dd4eb2a346ded6839691e6fbc04421df3da394d9b34"} err="failed to get container status \"bfab87d8456baf6d22600dd4eb2a346ded6839691e6fbc04421df3da394d9b34\": rpc error: code = NotFound desc = could not find container \"bfab87d8456baf6d22600dd4eb2a346ded6839691e6fbc04421df3da394d9b34\": container with ID starting with bfab87d8456baf6d22600dd4eb2a346ded6839691e6fbc04421df3da394d9b34 not found: ID does not exist"
Jul 15 12:48:16.417097 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:48:16.417076    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-e1773daa/e2e-lifecycle-model-e1773daa-kserve-6b6bbfdb87-g4zzd"]
Jul 15 12:48:16.420948 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:48:16.420931    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-e1773daa/e2e-lifecycle-model-e1773daa-kserve-6b6bbfdb87-g4zzd"]
Jul 15 12:48:17.443993 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:48:17.443959    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b673fa1-c222-4654-81ce-acb8495d3c09" path="/var/lib/kubelet/pods/8b673fa1-c222-4654-81ce-acb8495d3c09/volumes"
Jul 15 12:50:19.645583 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:50:19.645552    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-99c883/test-model-99c883-kserve-557f546985-skks4"]
Jul 15 12:50:19.645982 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:50:19.645939    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b673fa1-c222-4654-81ce-acb8495d3c09" containerName="main"
Jul 15 12:50:19.645982 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:50:19.645953    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b673fa1-c222-4654-81ce-acb8495d3c09" containerName="main"
Jul 15 12:50:19.646052 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:50:19.646019    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b673fa1-c222-4654-81ce-acb8495d3c09" containerName="main"
Jul 15 12:50:19.648950 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:50:19.648932    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-99c883/test-model-99c883-kserve-557f546985-skks4"
Jul 15 12:50:19.651655 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:50:19.651633    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-99c883\"/\"kube-root-ca.crt\""
Jul 15 12:50:19.651755 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:50:19.651658    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-99c883\"/\"default-dockercfg-nmpmc\""
Jul 15 12:50:19.652938 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:50:19.652921    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-99c883\"/\"openshift-service-ca.crt\""
Jul 15 12:50:19.653004 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:50:19.652967    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-99c883\"/\"test-model-99c883-kserve-self-signed-certs\""
Jul 15 12:50:19.657918 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:50:19.657894    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-99c883/test-model-99c883-kserve-557f546985-skks4"]
Jul 15 12:50:19.729468 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:50:19.729435    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/883d11b8-73f0-47e2-b734-6e8512c80273-tls-certs\") pod \"test-model-99c883-kserve-557f546985-skks4\" (UID: \"883d11b8-73f0-47e2-b734-6e8512c80273\") " pod="ai-tenant-e2e-inf-a-99c883/test-model-99c883-kserve-557f546985-skks4"
Jul 15 12:50:19.729606 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:50:19.729549    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/883d11b8-73f0-47e2-b734-6e8512c80273-home\") pod \"test-model-99c883-kserve-557f546985-skks4\" (UID: \"883d11b8-73f0-47e2-b734-6e8512c80273\") " pod="ai-tenant-e2e-inf-a-99c883/test-model-99c883-kserve-557f546985-skks4"
Jul 15 12:50:19.729606 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:50:19.729586    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/883d11b8-73f0-47e2-b734-6e8512c80273-tmp-dir\") pod \"test-model-99c883-kserve-557f546985-skks4\" (UID: \"883d11b8-73f0-47e2-b734-6e8512c80273\") " pod="ai-tenant-e2e-inf-a-99c883/test-model-99c883-kserve-557f546985-skks4"
Jul 15 12:50:19.729706 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:50:19.729606    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/883d11b8-73f0-47e2-b734-6e8512c80273-model-cache\") pod \"test-model-99c883-kserve-557f546985-skks4\" (UID: \"883d11b8-73f0-47e2-b734-6e8512c80273\") " pod="ai-tenant-e2e-inf-a-99c883/test-model-99c883-kserve-557f546985-skks4"
Jul 15 12:50:19.729706 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:50:19.729630    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmd58\" (UniqueName: \"kubernetes.io/projected/883d11b8-73f0-47e2-b734-6e8512c80273-kube-api-access-nmd58\") pod \"test-model-99c883-kserve-557f546985-skks4\" (UID: \"883d11b8-73f0-47e2-b734-6e8512c80273\") " pod="ai-tenant-e2e-inf-a-99c883/test-model-99c883-kserve-557f546985-skks4"
Jul 15 12:50:19.729706 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:50:19.729648    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/883d11b8-73f0-47e2-b734-6e8512c80273-dshm\") pod \"test-model-99c883-kserve-557f546985-skks4\" (UID: \"883d11b8-73f0-47e2-b734-6e8512c80273\") " pod="ai-tenant-e2e-inf-a-99c883/test-model-99c883-kserve-557f546985-skks4"
Jul 15 12:50:19.830645 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:50:19.830608    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/883d11b8-73f0-47e2-b734-6e8512c80273-tmp-dir\") pod \"test-model-99c883-kserve-557f546985-skks4\" (UID: \"883d11b8-73f0-47e2-b734-6e8512c80273\") " pod="ai-tenant-e2e-inf-a-99c883/test-model-99c883-kserve-557f546985-skks4"
Jul 15 12:50:19.830645 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:50:19.830647    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/883d11b8-73f0-47e2-b734-6e8512c80273-model-cache\") pod \"test-model-99c883-kserve-557f546985-skks4\" (UID: \"883d11b8-73f0-47e2-b734-6e8512c80273\") " pod="ai-tenant-e2e-inf-a-99c883/test-model-99c883-kserve-557f546985-skks4"
Jul 15 12:50:19.830873 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:50:19.830756    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmd58\" (UniqueName: \"kubernetes.io/projected/883d11b8-73f0-47e2-b734-6e8512c80273-kube-api-access-nmd58\") pod \"test-model-99c883-kserve-557f546985-skks4\" (UID: \"883d11b8-73f0-47e2-b734-6e8512c80273\") " pod="ai-tenant-e2e-inf-a-99c883/test-model-99c883-kserve-557f546985-skks4"
Jul 15 12:50:19.830873 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:50:19.830787    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/883d11b8-73f0-47e2-b734-6e8512c80273-dshm\") pod \"test-model-99c883-kserve-557f546985-skks4\" (UID: \"883d11b8-73f0-47e2-b734-6e8512c80273\") " pod="ai-tenant-e2e-inf-a-99c883/test-model-99c883-kserve-557f546985-skks4"
Jul 15 12:50:19.830873 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:50:19.830811    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/883d11b8-73f0-47e2-b734-6e8512c80273-tls-certs\") pod \"test-model-99c883-kserve-557f546985-skks4\" (UID: \"883d11b8-73f0-47e2-b734-6e8512c80273\") " pod="ai-tenant-e2e-inf-a-99c883/test-model-99c883-kserve-557f546985-skks4"
Jul 15 12:50:19.831028 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:50:19.830960    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/883d11b8-73f0-47e2-b734-6e8512c80273-home\") pod \"test-model-99c883-kserve-557f546985-skks4\" (UID: \"883d11b8-73f0-47e2-b734-6e8512c80273\") " pod="ai-tenant-e2e-inf-a-99c883/test-model-99c883-kserve-557f546985-skks4"
Jul 15 12:50:19.831084 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:50:19.831036    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/883d11b8-73f0-47e2-b734-6e8512c80273-tmp-dir\") pod \"test-model-99c883-kserve-557f546985-skks4\" (UID: \"883d11b8-73f0-47e2-b734-6e8512c80273\") " pod="ai-tenant-e2e-inf-a-99c883/test-model-99c883-kserve-557f546985-skks4"
Jul 15 12:50:19.831084 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:50:19.831050    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/883d11b8-73f0-47e2-b734-6e8512c80273-model-cache\") pod \"test-model-99c883-kserve-557f546985-skks4\" (UID: \"883d11b8-73f0-47e2-b734-6e8512c80273\") " pod="ai-tenant-e2e-inf-a-99c883/test-model-99c883-kserve-557f546985-skks4"
Jul 15 12:50:19.831267 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:50:19.831248    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/883d11b8-73f0-47e2-b734-6e8512c80273-home\") pod \"test-model-99c883-kserve-557f546985-skks4\" (UID: \"883d11b8-73f0-47e2-b734-6e8512c80273\") " pod="ai-tenant-e2e-inf-a-99c883/test-model-99c883-kserve-557f546985-skks4"
Jul 15 12:50:19.832920 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:50:19.832899    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/883d11b8-73f0-47e2-b734-6e8512c80273-dshm\") pod \"test-model-99c883-kserve-557f546985-skks4\" (UID: \"883d11b8-73f0-47e2-b734-6e8512c80273\") " pod="ai-tenant-e2e-inf-a-99c883/test-model-99c883-kserve-557f546985-skks4"
Jul 15 12:50:19.833153 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:50:19.833136    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/883d11b8-73f0-47e2-b734-6e8512c80273-tls-certs\") pod \"test-model-99c883-kserve-557f546985-skks4\" (UID: \"883d11b8-73f0-47e2-b734-6e8512c80273\") " pod="ai-tenant-e2e-inf-a-99c883/test-model-99c883-kserve-557f546985-skks4"
Jul 15 12:50:19.838234 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:50:19.838210    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmd58\" (UniqueName: \"kubernetes.io/projected/883d11b8-73f0-47e2-b734-6e8512c80273-kube-api-access-nmd58\") pod \"test-model-99c883-kserve-557f546985-skks4\" (UID: \"883d11b8-73f0-47e2-b734-6e8512c80273\") " pod="ai-tenant-e2e-inf-a-99c883/test-model-99c883-kserve-557f546985-skks4"
Jul 15 12:50:19.958209 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:50:19.958180    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-99c883/test-model-99c883-kserve-557f546985-skks4"
Jul 15 12:50:20.087915 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:50:20.087882    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-99c883/test-model-99c883-kserve-557f546985-skks4"]
Jul 15 12:50:20.088659 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:50:20.088632    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod883d11b8_73f0_47e2_b734_6e8512c80273.slice/crio-c38e5492f40a6b6a942db675c5b59dbaf537453eba2f018fb954c1c6b972868f WatchSource:0}: Error finding container c38e5492f40a6b6a942db675c5b59dbaf537453eba2f018fb954c1c6b972868f: Status 404 returned error can't find the container with id c38e5492f40a6b6a942db675c5b59dbaf537453eba2f018fb954c1c6b972868f
Jul 15 12:50:20.999497 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:50:20.999452    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-99c883/test-model-99c883-kserve-557f546985-skks4" event={"ID":"883d11b8-73f0-47e2-b734-6e8512c80273","Type":"ContainerStarted","Data":"4edf37b6f478480d5d075b52b187e2f66bab9595356df75949e418735984ccad"}
Jul 15 12:50:20.999497 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:50:20.999500    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-99c883/test-model-99c883-kserve-557f546985-skks4" event={"ID":"883d11b8-73f0-47e2-b734-6e8512c80273","Type":"ContainerStarted","Data":"c38e5492f40a6b6a942db675c5b59dbaf537453eba2f018fb954c1c6b972868f"}
Jul 15 12:50:21.016833 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:50:21.016778    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-99c883/test-model-99c883-kserve-557f546985-skks4" podStartSLOduration=2.016757889 podStartE2EDuration="2.016757889s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:50:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:50:21.016255089 +0000 UTC m=+2368.130648823" watchObservedRunningTime="2026-07-15 12:50:21.016757889 +0000 UTC m=+2368.131151624"
Jul 15 12:50:29.959056 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:50:29.959021    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-99c883/test-model-99c883-kserve-557f546985-skks4"
Jul 15 12:50:29.959572 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:50:29.959284    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-99c883/test-model-99c883-kserve-557f546985-skks4"
Jul 15 12:50:29.971590 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:50:29.971569    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-99c883/test-model-99c883-kserve-557f546985-skks4"
Jul 15 12:50:30.050543 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:50:30.050514    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-99c883/test-model-99c883-kserve-557f546985-skks4"
Jul 15 12:50:53.552588 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:50:53.552564    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xkvbf_641b0ffa-0450-4198-8066-0241ab179822/console-operator/2.log"
Jul 15 12:50:53.561553 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:50:53.561532    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xh4rs_2de62ab2-7502-4c13-a6f0-5ebbd4982798/ovn-acl-logging/0.log"
Jul 15 12:50:53.568486 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:50:53.568469    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xkvbf_641b0ffa-0450-4198-8066-0241ab179822/console-operator/2.log"
Jul 15 12:50:53.576533 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:50:53.576517    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xh4rs_2de62ab2-7502-4c13-a6f0-5ebbd4982798/ovn-acl-logging/0.log"
Jul 15 12:51:04.350442 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:04.350406    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-0eb9b9/test-model-0eb9b9-kserve-85dcdc77b7-xwdfv"]
Jul 15 12:51:04.354130 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:04.354107    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-0eb9b9/test-model-0eb9b9-kserve-85dcdc77b7-xwdfv"
Jul 15 12:51:04.356929 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:04.356905    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-0eb9b9\"/\"openshift-service-ca.crt\""
Jul 15 12:51:04.357034 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:04.356917    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-0eb9b9\"/\"kube-root-ca.crt\""
Jul 15 12:51:04.358239 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:04.358220    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-0eb9b9\"/\"test-model-0eb9b9-kserve-self-signed-certs\""
Jul 15 12:51:04.358356 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:04.358330    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-0eb9b9\"/\"default-dockercfg-h5jng\""
Jul 15 12:51:04.362453 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:04.362433    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-0eb9b9/test-model-0eb9b9-kserve-85dcdc77b7-xwdfv"]
Jul 15 12:51:04.437011 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:04.436986    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b74c460-82a0-43a0-bc19-ed91448d0c93-tmp-dir\") pod \"test-model-0eb9b9-kserve-85dcdc77b7-xwdfv\" (UID: \"4b74c460-82a0-43a0-bc19-ed91448d0c93\") " pod="ai-tenant-e2e-inf-b-0eb9b9/test-model-0eb9b9-kserve-85dcdc77b7-xwdfv"
Jul 15 12:51:04.437178 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:04.437030    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b74c460-82a0-43a0-bc19-ed91448d0c93-model-cache\") pod \"test-model-0eb9b9-kserve-85dcdc77b7-xwdfv\" (UID: \"4b74c460-82a0-43a0-bc19-ed91448d0c93\") " pod="ai-tenant-e2e-inf-b-0eb9b9/test-model-0eb9b9-kserve-85dcdc77b7-xwdfv"
Jul 15 12:51:04.437178 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:04.437106    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b74c460-82a0-43a0-bc19-ed91448d0c93-home\") pod \"test-model-0eb9b9-kserve-85dcdc77b7-xwdfv\" (UID: \"4b74c460-82a0-43a0-bc19-ed91448d0c93\") " pod="ai-tenant-e2e-inf-b-0eb9b9/test-model-0eb9b9-kserve-85dcdc77b7-xwdfv"
Jul 15 12:51:04.437178 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:04.437162    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qllj9\" (UniqueName: \"kubernetes.io/projected/4b74c460-82a0-43a0-bc19-ed91448d0c93-kube-api-access-qllj9\") pod \"test-model-0eb9b9-kserve-85dcdc77b7-xwdfv\" (UID: \"4b74c460-82a0-43a0-bc19-ed91448d0c93\") " pod="ai-tenant-e2e-inf-b-0eb9b9/test-model-0eb9b9-kserve-85dcdc77b7-xwdfv"
Jul 15 12:51:04.437344 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:04.437213    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b74c460-82a0-43a0-bc19-ed91448d0c93-dshm\") pod \"test-model-0eb9b9-kserve-85dcdc77b7-xwdfv\" (UID: \"4b74c460-82a0-43a0-bc19-ed91448d0c93\") " pod="ai-tenant-e2e-inf-b-0eb9b9/test-model-0eb9b9-kserve-85dcdc77b7-xwdfv"
Jul 15 12:51:04.437344 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:04.437232    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b74c460-82a0-43a0-bc19-ed91448d0c93-tls-certs\") pod \"test-model-0eb9b9-kserve-85dcdc77b7-xwdfv\" (UID: \"4b74c460-82a0-43a0-bc19-ed91448d0c93\") " pod="ai-tenant-e2e-inf-b-0eb9b9/test-model-0eb9b9-kserve-85dcdc77b7-xwdfv"
Jul 15 12:51:04.537936 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:04.537904    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b74c460-82a0-43a0-bc19-ed91448d0c93-home\") pod \"test-model-0eb9b9-kserve-85dcdc77b7-xwdfv\" (UID: \"4b74c460-82a0-43a0-bc19-ed91448d0c93\") " pod="ai-tenant-e2e-inf-b-0eb9b9/test-model-0eb9b9-kserve-85dcdc77b7-xwdfv"
Jul 15 12:51:04.537936 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:04.537941    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qllj9\" (UniqueName: \"kubernetes.io/projected/4b74c460-82a0-43a0-bc19-ed91448d0c93-kube-api-access-qllj9\") pod \"test-model-0eb9b9-kserve-85dcdc77b7-xwdfv\" (UID: \"4b74c460-82a0-43a0-bc19-ed91448d0c93\") " pod="ai-tenant-e2e-inf-b-0eb9b9/test-model-0eb9b9-kserve-85dcdc77b7-xwdfv"
Jul 15 12:51:04.538167 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:04.537969    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b74c460-82a0-43a0-bc19-ed91448d0c93-dshm\") pod \"test-model-0eb9b9-kserve-85dcdc77b7-xwdfv\" (UID: \"4b74c460-82a0-43a0-bc19-ed91448d0c93\") " pod="ai-tenant-e2e-inf-b-0eb9b9/test-model-0eb9b9-kserve-85dcdc77b7-xwdfv"
Jul 15 12:51:04.538167 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:04.537993    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b74c460-82a0-43a0-bc19-ed91448d0c93-tls-certs\") pod \"test-model-0eb9b9-kserve-85dcdc77b7-xwdfv\" (UID: \"4b74c460-82a0-43a0-bc19-ed91448d0c93\") " pod="ai-tenant-e2e-inf-b-0eb9b9/test-model-0eb9b9-kserve-85dcdc77b7-xwdfv"
Jul 15 12:51:04.538167 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:04.538099    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b74c460-82a0-43a0-bc19-ed91448d0c93-tmp-dir\") pod \"test-model-0eb9b9-kserve-85dcdc77b7-xwdfv\" (UID: \"4b74c460-82a0-43a0-bc19-ed91448d0c93\") " pod="ai-tenant-e2e-inf-b-0eb9b9/test-model-0eb9b9-kserve-85dcdc77b7-xwdfv"
Jul 15 12:51:04.538167 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:04.538139    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b74c460-82a0-43a0-bc19-ed91448d0c93-model-cache\") pod \"test-model-0eb9b9-kserve-85dcdc77b7-xwdfv\" (UID: \"4b74c460-82a0-43a0-bc19-ed91448d0c93\") " pod="ai-tenant-e2e-inf-b-0eb9b9/test-model-0eb9b9-kserve-85dcdc77b7-xwdfv"
Jul 15 12:51:04.538426 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:04.538402    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b74c460-82a0-43a0-bc19-ed91448d0c93-home\") pod \"test-model-0eb9b9-kserve-85dcdc77b7-xwdfv\" (UID: \"4b74c460-82a0-43a0-bc19-ed91448d0c93\") " pod="ai-tenant-e2e-inf-b-0eb9b9/test-model-0eb9b9-kserve-85dcdc77b7-xwdfv"
Jul 15 12:51:04.538513 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:04.538486    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b74c460-82a0-43a0-bc19-ed91448d0c93-model-cache\") pod \"test-model-0eb9b9-kserve-85dcdc77b7-xwdfv\" (UID: \"4b74c460-82a0-43a0-bc19-ed91448d0c93\") " pod="ai-tenant-e2e-inf-b-0eb9b9/test-model-0eb9b9-kserve-85dcdc77b7-xwdfv"
Jul 15 12:51:04.538569 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:04.538527    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b74c460-82a0-43a0-bc19-ed91448d0c93-tmp-dir\") pod \"test-model-0eb9b9-kserve-85dcdc77b7-xwdfv\" (UID: \"4b74c460-82a0-43a0-bc19-ed91448d0c93\") " pod="ai-tenant-e2e-inf-b-0eb9b9/test-model-0eb9b9-kserve-85dcdc77b7-xwdfv"
Jul 15 12:51:04.540349 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:04.540330    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b74c460-82a0-43a0-bc19-ed91448d0c93-dshm\") pod \"test-model-0eb9b9-kserve-85dcdc77b7-xwdfv\" (UID: \"4b74c460-82a0-43a0-bc19-ed91448d0c93\") " pod="ai-tenant-e2e-inf-b-0eb9b9/test-model-0eb9b9-kserve-85dcdc77b7-xwdfv"
Jul 15 12:51:04.540724 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:04.540704    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b74c460-82a0-43a0-bc19-ed91448d0c93-tls-certs\") pod \"test-model-0eb9b9-kserve-85dcdc77b7-xwdfv\" (UID: \"4b74c460-82a0-43a0-bc19-ed91448d0c93\") " pod="ai-tenant-e2e-inf-b-0eb9b9/test-model-0eb9b9-kserve-85dcdc77b7-xwdfv"
Jul 15 12:51:04.545729 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:04.545706    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qllj9\" (UniqueName: \"kubernetes.io/projected/4b74c460-82a0-43a0-bc19-ed91448d0c93-kube-api-access-qllj9\") pod \"test-model-0eb9b9-kserve-85dcdc77b7-xwdfv\" (UID: \"4b74c460-82a0-43a0-bc19-ed91448d0c93\") " pod="ai-tenant-e2e-inf-b-0eb9b9/test-model-0eb9b9-kserve-85dcdc77b7-xwdfv"
Jul 15 12:51:04.664413 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:04.664336    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-0eb9b9/test-model-0eb9b9-kserve-85dcdc77b7-xwdfv"
Jul 15 12:51:04.791875 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:04.791850    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-0eb9b9/test-model-0eb9b9-kserve-85dcdc77b7-xwdfv"]
Jul 15 12:51:04.793671 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:51:04.793647    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4b74c460_82a0_43a0_bc19_ed91448d0c93.slice/crio-81664677527fcefcee53a302e1e35fb35dcb3d4b86d68cba15a117e9cd28017a WatchSource:0}: Error finding container 81664677527fcefcee53a302e1e35fb35dcb3d4b86d68cba15a117e9cd28017a: Status 404 returned error can't find the container with id 81664677527fcefcee53a302e1e35fb35dcb3d4b86d68cba15a117e9cd28017a
Jul 15 12:51:05.206662 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:05.206622    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-0eb9b9/test-model-0eb9b9-kserve-85dcdc77b7-xwdfv" event={"ID":"4b74c460-82a0-43a0-bc19-ed91448d0c93","Type":"ContainerStarted","Data":"13540c0f59fa6e08794f998ae89db5699d734a69444dee0c1990c5a96b0698be"}
Jul 15 12:51:05.206870 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:05.206672    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-0eb9b9/test-model-0eb9b9-kserve-85dcdc77b7-xwdfv" event={"ID":"4b74c460-82a0-43a0-bc19-ed91448d0c93","Type":"ContainerStarted","Data":"81664677527fcefcee53a302e1e35fb35dcb3d4b86d68cba15a117e9cd28017a"}
Jul 15 12:51:05.224238 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:05.224185    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-0eb9b9/test-model-0eb9b9-kserve-85dcdc77b7-xwdfv" podStartSLOduration=1.22417068 podStartE2EDuration="1.22417068s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:51:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:51:05.221451284 +0000 UTC m=+2412.335845019" watchObservedRunningTime="2026-07-15 12:51:05.22417068 +0000 UTC m=+2412.338564462"
Jul 15 12:51:14.664825 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:14.664786    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-0eb9b9/test-model-0eb9b9-kserve-85dcdc77b7-xwdfv"
Jul 15 12:51:14.665346 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:14.664838    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-0eb9b9/test-model-0eb9b9-kserve-85dcdc77b7-xwdfv"
Jul 15 12:51:14.677056 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:14.677030    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-0eb9b9/test-model-0eb9b9-kserve-85dcdc77b7-xwdfv"
Jul 15 12:51:15.271652 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:15.271577    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-0eb9b9/test-model-0eb9b9-kserve-85dcdc77b7-xwdfv"
Jul 15 12:51:21.828225 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:21.828190    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-99c883/test-model-99c883-kserve-557f546985-skks4"]
Jul 15 12:51:22.707037 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:22.706994    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-0eb9b9/test-model-0eb9b9-kserve-85dcdc77b7-xwdfv"]
Jul 15 12:51:36.848744 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:36.848692    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-99c883/test-model-99c883-kserve-557f546985-skks4" podUID="883d11b8-73f0-47e2-b734-6e8512c80273" containerName="main" containerID="cri-o://4edf37b6f478480d5d075b52b187e2f66bab9595356df75949e418735984ccad" gracePeriod=45
Jul 15 12:51:37.095231 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:37.095209    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-99c883/test-model-99c883-kserve-557f546985-skks4"
Jul 15 12:51:37.240890 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:37.240862    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/883d11b8-73f0-47e2-b734-6e8512c80273-dshm\") pod \"883d11b8-73f0-47e2-b734-6e8512c80273\" (UID: \"883d11b8-73f0-47e2-b734-6e8512c80273\") "
Jul 15 12:51:37.241040 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:37.240917    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/883d11b8-73f0-47e2-b734-6e8512c80273-model-cache\") pod \"883d11b8-73f0-47e2-b734-6e8512c80273\" (UID: \"883d11b8-73f0-47e2-b734-6e8512c80273\") "
Jul 15 12:51:37.241040 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:37.240992    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/883d11b8-73f0-47e2-b734-6e8512c80273-tls-certs\") pod \"883d11b8-73f0-47e2-b734-6e8512c80273\" (UID: \"883d11b8-73f0-47e2-b734-6e8512c80273\") "
Jul 15 12:51:37.241040 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:37.241007    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/883d11b8-73f0-47e2-b734-6e8512c80273-home\") pod \"883d11b8-73f0-47e2-b734-6e8512c80273\" (UID: \"883d11b8-73f0-47e2-b734-6e8512c80273\") "
Jul 15 12:51:37.241040 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:37.241039    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmd58\" (UniqueName: \"kubernetes.io/projected/883d11b8-73f0-47e2-b734-6e8512c80273-kube-api-access-nmd58\") pod \"883d11b8-73f0-47e2-b734-6e8512c80273\" (UID: \"883d11b8-73f0-47e2-b734-6e8512c80273\") "
Jul 15 12:51:37.241251 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:37.241057    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/883d11b8-73f0-47e2-b734-6e8512c80273-tmp-dir\") pod \"883d11b8-73f0-47e2-b734-6e8512c80273\" (UID: \"883d11b8-73f0-47e2-b734-6e8512c80273\") "
Jul 15 12:51:37.241251 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:37.241167    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/883d11b8-73f0-47e2-b734-6e8512c80273-model-cache" (OuterVolumeSpecName: "model-cache") pod "883d11b8-73f0-47e2-b734-6e8512c80273" (UID: "883d11b8-73f0-47e2-b734-6e8512c80273"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:51:37.241394 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:37.241340    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/883d11b8-73f0-47e2-b734-6e8512c80273-model-cache\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:51:37.241394 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:37.241363    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/883d11b8-73f0-47e2-b734-6e8512c80273-home" (OuterVolumeSpecName: "home") pod "883d11b8-73f0-47e2-b734-6e8512c80273" (UID: "883d11b8-73f0-47e2-b734-6e8512c80273"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:51:37.241394 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:37.241380    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/883d11b8-73f0-47e2-b734-6e8512c80273-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "883d11b8-73f0-47e2-b734-6e8512c80273" (UID: "883d11b8-73f0-47e2-b734-6e8512c80273"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:51:37.243082 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:37.243056    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/883d11b8-73f0-47e2-b734-6e8512c80273-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "883d11b8-73f0-47e2-b734-6e8512c80273" (UID: "883d11b8-73f0-47e2-b734-6e8512c80273"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:51:37.243082 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:37.243072    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/883d11b8-73f0-47e2-b734-6e8512c80273-kube-api-access-nmd58" (OuterVolumeSpecName: "kube-api-access-nmd58") pod "883d11b8-73f0-47e2-b734-6e8512c80273" (UID: "883d11b8-73f0-47e2-b734-6e8512c80273"). InnerVolumeSpecName "kube-api-access-nmd58". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:51:37.243224 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:37.243127    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/883d11b8-73f0-47e2-b734-6e8512c80273-dshm" (OuterVolumeSpecName: "dshm") pod "883d11b8-73f0-47e2-b734-6e8512c80273" (UID: "883d11b8-73f0-47e2-b734-6e8512c80273"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:51:37.341762 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:37.341737    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/883d11b8-73f0-47e2-b734-6e8512c80273-dshm\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:51:37.341762 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:37.341758    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/883d11b8-73f0-47e2-b734-6e8512c80273-tls-certs\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:51:37.341908 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:37.341768    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/883d11b8-73f0-47e2-b734-6e8512c80273-home\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:51:37.341908 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:37.341777    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmd58\" (UniqueName: \"kubernetes.io/projected/883d11b8-73f0-47e2-b734-6e8512c80273-kube-api-access-nmd58\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:51:37.341908 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:37.341786    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/883d11b8-73f0-47e2-b734-6e8512c80273-tmp-dir\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:51:37.369064 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:37.369040    2560 generic.go:356] "Generic (PLEG): container finished" podID="883d11b8-73f0-47e2-b734-6e8512c80273" containerID="4edf37b6f478480d5d075b52b187e2f66bab9595356df75949e418735984ccad" exitCode=0
Jul 15 12:51:37.369157 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:37.369077    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-99c883/test-model-99c883-kserve-557f546985-skks4" event={"ID":"883d11b8-73f0-47e2-b734-6e8512c80273","Type":"ContainerDied","Data":"4edf37b6f478480d5d075b52b187e2f66bab9595356df75949e418735984ccad"}
Jul 15 12:51:37.369157 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:37.369079    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-99c883/test-model-99c883-kserve-557f546985-skks4"
Jul 15 12:51:37.369157 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:37.369117    2560 scope.go:117] "RemoveContainer" containerID="4edf37b6f478480d5d075b52b187e2f66bab9595356df75949e418735984ccad"
Jul 15 12:51:37.369260 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:37.369107    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-99c883/test-model-99c883-kserve-557f546985-skks4" event={"ID":"883d11b8-73f0-47e2-b734-6e8512c80273","Type":"ContainerDied","Data":"c38e5492f40a6b6a942db675c5b59dbaf537453eba2f018fb954c1c6b972868f"}
Jul 15 12:51:37.377764 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:37.377748    2560 scope.go:117] "RemoveContainer" containerID="4edf37b6f478480d5d075b52b187e2f66bab9595356df75949e418735984ccad"
Jul 15 12:51:37.377994 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:51:37.377975    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4edf37b6f478480d5d075b52b187e2f66bab9595356df75949e418735984ccad\": container with ID starting with 4edf37b6f478480d5d075b52b187e2f66bab9595356df75949e418735984ccad not found: ID does not exist" containerID="4edf37b6f478480d5d075b52b187e2f66bab9595356df75949e418735984ccad"
Jul 15 12:51:37.378040 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:37.378002    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4edf37b6f478480d5d075b52b187e2f66bab9595356df75949e418735984ccad"} err="failed to get container status \"4edf37b6f478480d5d075b52b187e2f66bab9595356df75949e418735984ccad\": rpc error: code = NotFound desc = could not find container \"4edf37b6f478480d5d075b52b187e2f66bab9595356df75949e418735984ccad\": container with ID starting with 4edf37b6f478480d5d075b52b187e2f66bab9595356df75949e418735984ccad not found: ID does not exist"
Jul 15 12:51:37.391244 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:37.391222    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-99c883/test-model-99c883-kserve-557f546985-skks4"]
Jul 15 12:51:37.398193 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:37.398172    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-99c883/test-model-99c883-kserve-557f546985-skks4"]
Jul 15 12:51:37.448418 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:37.448387    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="883d11b8-73f0-47e2-b734-6e8512c80273" path="/var/lib/kubelet/pods/883d11b8-73f0-47e2-b734-6e8512c80273/volumes"
Jul 15 12:51:37.734262 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:37.734227    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-0eb9b9/test-model-0eb9b9-kserve-85dcdc77b7-xwdfv" podUID="4b74c460-82a0-43a0-bc19-ed91448d0c93" containerName="main" containerID="cri-o://13540c0f59fa6e08794f998ae89db5699d734a69444dee0c1990c5a96b0698be" gracePeriod=45
Jul 15 12:51:37.983789 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:37.983767    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-0eb9b9/test-model-0eb9b9-kserve-85dcdc77b7-xwdfv"
Jul 15 12:51:38.048915 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:38.048846    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b74c460-82a0-43a0-bc19-ed91448d0c93-tmp-dir\") pod \"4b74c460-82a0-43a0-bc19-ed91448d0c93\" (UID: \"4b74c460-82a0-43a0-bc19-ed91448d0c93\") "
Jul 15 12:51:38.048915 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:38.048904    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b74c460-82a0-43a0-bc19-ed91448d0c93-home\") pod \"4b74c460-82a0-43a0-bc19-ed91448d0c93\" (UID: \"4b74c460-82a0-43a0-bc19-ed91448d0c93\") "
Jul 15 12:51:38.049123 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:38.048923    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b74c460-82a0-43a0-bc19-ed91448d0c93-tls-certs\") pod \"4b74c460-82a0-43a0-bc19-ed91448d0c93\" (UID: \"4b74c460-82a0-43a0-bc19-ed91448d0c93\") "
Jul 15 12:51:38.049123 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:38.048943    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qllj9\" (UniqueName: \"kubernetes.io/projected/4b74c460-82a0-43a0-bc19-ed91448d0c93-kube-api-access-qllj9\") pod \"4b74c460-82a0-43a0-bc19-ed91448d0c93\" (UID: \"4b74c460-82a0-43a0-bc19-ed91448d0c93\") "
Jul 15 12:51:38.049123 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:38.049047    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b74c460-82a0-43a0-bc19-ed91448d0c93-model-cache\") pod \"4b74c460-82a0-43a0-bc19-ed91448d0c93\" (UID: \"4b74c460-82a0-43a0-bc19-ed91448d0c93\") "
Jul 15 12:51:38.049123 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:38.049091    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b74c460-82a0-43a0-bc19-ed91448d0c93-dshm\") pod \"4b74c460-82a0-43a0-bc19-ed91448d0c93\" (UID: \"4b74c460-82a0-43a0-bc19-ed91448d0c93\") "
Jul 15 12:51:38.049347 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:38.049141    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b74c460-82a0-43a0-bc19-ed91448d0c93-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4b74c460-82a0-43a0-bc19-ed91448d0c93" (UID: "4b74c460-82a0-43a0-bc19-ed91448d0c93"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:51:38.049347 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:38.049156    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b74c460-82a0-43a0-bc19-ed91448d0c93-home" (OuterVolumeSpecName: "home") pod "4b74c460-82a0-43a0-bc19-ed91448d0c93" (UID: "4b74c460-82a0-43a0-bc19-ed91448d0c93"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:51:38.049347 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:38.049272    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b74c460-82a0-43a0-bc19-ed91448d0c93-model-cache" (OuterVolumeSpecName: "model-cache") pod "4b74c460-82a0-43a0-bc19-ed91448d0c93" (UID: "4b74c460-82a0-43a0-bc19-ed91448d0c93"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:51:38.049478 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:38.049463    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b74c460-82a0-43a0-bc19-ed91448d0c93-tmp-dir\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:51:38.049516 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:38.049481    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b74c460-82a0-43a0-bc19-ed91448d0c93-home\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:51:38.049516 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:38.049491    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b74c460-82a0-43a0-bc19-ed91448d0c93-model-cache\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:51:38.051068 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:38.051040    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b74c460-82a0-43a0-bc19-ed91448d0c93-dshm" (OuterVolumeSpecName: "dshm") pod "4b74c460-82a0-43a0-bc19-ed91448d0c93" (UID: "4b74c460-82a0-43a0-bc19-ed91448d0c93"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:51:38.051178 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:38.051119    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b74c460-82a0-43a0-bc19-ed91448d0c93-kube-api-access-qllj9" (OuterVolumeSpecName: "kube-api-access-qllj9") pod "4b74c460-82a0-43a0-bc19-ed91448d0c93" (UID: "4b74c460-82a0-43a0-bc19-ed91448d0c93"). InnerVolumeSpecName "kube-api-access-qllj9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:51:38.051241 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:38.051197    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b74c460-82a0-43a0-bc19-ed91448d0c93-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4b74c460-82a0-43a0-bc19-ed91448d0c93" (UID: "4b74c460-82a0-43a0-bc19-ed91448d0c93"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:51:38.150773 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:38.150737    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b74c460-82a0-43a0-bc19-ed91448d0c93-tls-certs\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:51:38.150773 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:38.150769    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qllj9\" (UniqueName: \"kubernetes.io/projected/4b74c460-82a0-43a0-bc19-ed91448d0c93-kube-api-access-qllj9\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:51:38.150956 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:38.150781    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b74c460-82a0-43a0-bc19-ed91448d0c93-dshm\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:51:38.375437 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:38.375351    2560 generic.go:356] "Generic (PLEG): container finished" podID="4b74c460-82a0-43a0-bc19-ed91448d0c93" containerID="13540c0f59fa6e08794f998ae89db5699d734a69444dee0c1990c5a96b0698be" exitCode=0
Jul 15 12:51:38.375437 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:38.375401    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-0eb9b9/test-model-0eb9b9-kserve-85dcdc77b7-xwdfv"
Jul 15 12:51:38.375661 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:38.375439    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-0eb9b9/test-model-0eb9b9-kserve-85dcdc77b7-xwdfv" event={"ID":"4b74c460-82a0-43a0-bc19-ed91448d0c93","Type":"ContainerDied","Data":"13540c0f59fa6e08794f998ae89db5699d734a69444dee0c1990c5a96b0698be"}
Jul 15 12:51:38.375661 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:38.375491    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-0eb9b9/test-model-0eb9b9-kserve-85dcdc77b7-xwdfv" event={"ID":"4b74c460-82a0-43a0-bc19-ed91448d0c93","Type":"ContainerDied","Data":"81664677527fcefcee53a302e1e35fb35dcb3d4b86d68cba15a117e9cd28017a"}
Jul 15 12:51:38.375661 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:38.375511    2560 scope.go:117] "RemoveContainer" containerID="13540c0f59fa6e08794f998ae89db5699d734a69444dee0c1990c5a96b0698be"
Jul 15 12:51:38.384360 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:38.384277    2560 scope.go:117] "RemoveContainer" containerID="13540c0f59fa6e08794f998ae89db5699d734a69444dee0c1990c5a96b0698be"
Jul 15 12:51:38.384543 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:51:38.384527    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13540c0f59fa6e08794f998ae89db5699d734a69444dee0c1990c5a96b0698be\": container with ID starting with 13540c0f59fa6e08794f998ae89db5699d734a69444dee0c1990c5a96b0698be not found: ID does not exist" containerID="13540c0f59fa6e08794f998ae89db5699d734a69444dee0c1990c5a96b0698be"
Jul 15 12:51:38.384592 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:38.384550    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13540c0f59fa6e08794f998ae89db5699d734a69444dee0c1990c5a96b0698be"} err="failed to get container status \"13540c0f59fa6e08794f998ae89db5699d734a69444dee0c1990c5a96b0698be\": rpc error: code = NotFound desc = could not find container \"13540c0f59fa6e08794f998ae89db5699d734a69444dee0c1990c5a96b0698be\": container with ID starting with 13540c0f59fa6e08794f998ae89db5699d734a69444dee0c1990c5a96b0698be not found: ID does not exist"
Jul 15 12:51:38.396165 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:38.396137    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-0eb9b9/test-model-0eb9b9-kserve-85dcdc77b7-xwdfv"]
Jul 15 12:51:38.402051 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:38.402030    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-0eb9b9/test-model-0eb9b9-kserve-85dcdc77b7-xwdfv"]
Jul 15 12:51:39.443747 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:51:39.443708    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b74c460-82a0-43a0-bc19-ed91448d0c93" path="/var/lib/kubelet/pods/4b74c460-82a0-43a0-bc19-ed91448d0c93/volumes"
Jul 15 12:54:15.436394 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:15.436284    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-e6c75d/auth-test-model-e6c75d-kserve-757bc97d6c-sdmgq"]
Jul 15 12:54:15.436843 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:15.436668    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="883d11b8-73f0-47e2-b734-6e8512c80273" containerName="main"
Jul 15 12:54:15.436843 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:15.436679    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="883d11b8-73f0-47e2-b734-6e8512c80273" containerName="main"
Jul 15 12:54:15.436843 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:15.436699    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b74c460-82a0-43a0-bc19-ed91448d0c93" containerName="main"
Jul 15 12:54:15.436843 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:15.436704    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b74c460-82a0-43a0-bc19-ed91448d0c93" containerName="main"
Jul 15 12:54:15.436843 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:15.436762    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b74c460-82a0-43a0-bc19-ed91448d0c93" containerName="main"
Jul 15 12:54:15.436843 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:15.436770    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="883d11b8-73f0-47e2-b734-6e8512c80273" containerName="main"
Jul 15 12:54:15.439800 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:15.439771    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e6c75d/auth-test-model-e6c75d-kserve-757bc97d6c-sdmgq"
Jul 15 12:54:15.443965 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:15.443936    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-e6c75d\"/\"auth-test-model-e6c75d-kserve-self-signed-certs\""
Jul 15 12:54:15.444391 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:15.444372    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-e6c75d\"/\"default-dockercfg-qjbqq\""
Jul 15 12:54:15.444666 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:15.444644    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-e6c75d\"/\"openshift-service-ca.crt\""
Jul 15 12:54:15.445074 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:15.445056    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-e6c75d\"/\"kube-root-ca.crt\""
Jul 15 12:54:15.454116 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:15.454092    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-e6c75d/auth-test-model-e6c75d-kserve-757bc97d6c-sdmgq"]
Jul 15 12:54:15.562272 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:15.562241    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0701a840-b816-440c-aa41-767993a2f208-dshm\") pod \"auth-test-model-e6c75d-kserve-757bc97d6c-sdmgq\" (UID: \"0701a840-b816-440c-aa41-767993a2f208\") " pod="ai-tenant-e2e-shared-a-e6c75d/auth-test-model-e6c75d-kserve-757bc97d6c-sdmgq"
Jul 15 12:54:15.562451 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:15.562282    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0701a840-b816-440c-aa41-767993a2f208-tmp-dir\") pod \"auth-test-model-e6c75d-kserve-757bc97d6c-sdmgq\" (UID: \"0701a840-b816-440c-aa41-767993a2f208\") " pod="ai-tenant-e2e-shared-a-e6c75d/auth-test-model-e6c75d-kserve-757bc97d6c-sdmgq"
Jul 15 12:54:15.562451 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:15.562381    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0701a840-b816-440c-aa41-767993a2f208-model-cache\") pod \"auth-test-model-e6c75d-kserve-757bc97d6c-sdmgq\" (UID: \"0701a840-b816-440c-aa41-767993a2f208\") " pod="ai-tenant-e2e-shared-a-e6c75d/auth-test-model-e6c75d-kserve-757bc97d6c-sdmgq"
Jul 15 12:54:15.562451 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:15.562429    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0701a840-b816-440c-aa41-767993a2f208-home\") pod \"auth-test-model-e6c75d-kserve-757bc97d6c-sdmgq\" (UID: \"0701a840-b816-440c-aa41-767993a2f208\") " pod="ai-tenant-e2e-shared-a-e6c75d/auth-test-model-e6c75d-kserve-757bc97d6c-sdmgq"
Jul 15 12:54:15.562451 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:15.562448    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0701a840-b816-440c-aa41-767993a2f208-tls-certs\") pod \"auth-test-model-e6c75d-kserve-757bc97d6c-sdmgq\" (UID: \"0701a840-b816-440c-aa41-767993a2f208\") " pod="ai-tenant-e2e-shared-a-e6c75d/auth-test-model-e6c75d-kserve-757bc97d6c-sdmgq"
Jul 15 12:54:15.562593 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:15.562542    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdbzx\" (UniqueName: \"kubernetes.io/projected/0701a840-b816-440c-aa41-767993a2f208-kube-api-access-fdbzx\") pod \"auth-test-model-e6c75d-kserve-757bc97d6c-sdmgq\" (UID: \"0701a840-b816-440c-aa41-767993a2f208\") " pod="ai-tenant-e2e-shared-a-e6c75d/auth-test-model-e6c75d-kserve-757bc97d6c-sdmgq"
Jul 15 12:54:15.663911 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:15.663873    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0701a840-b816-440c-aa41-767993a2f208-dshm\") pod \"auth-test-model-e6c75d-kserve-757bc97d6c-sdmgq\" (UID: \"0701a840-b816-440c-aa41-767993a2f208\") " pod="ai-tenant-e2e-shared-a-e6c75d/auth-test-model-e6c75d-kserve-757bc97d6c-sdmgq"
Jul 15 12:54:15.664088 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:15.663920    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0701a840-b816-440c-aa41-767993a2f208-tmp-dir\") pod \"auth-test-model-e6c75d-kserve-757bc97d6c-sdmgq\" (UID: \"0701a840-b816-440c-aa41-767993a2f208\") " pod="ai-tenant-e2e-shared-a-e6c75d/auth-test-model-e6c75d-kserve-757bc97d6c-sdmgq"
Jul 15 12:54:15.664088 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:15.663958    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0701a840-b816-440c-aa41-767993a2f208-model-cache\") pod \"auth-test-model-e6c75d-kserve-757bc97d6c-sdmgq\" (UID: \"0701a840-b816-440c-aa41-767993a2f208\") " pod="ai-tenant-e2e-shared-a-e6c75d/auth-test-model-e6c75d-kserve-757bc97d6c-sdmgq"
Jul 15 12:54:15.664088 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:15.663997    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0701a840-b816-440c-aa41-767993a2f208-home\") pod \"auth-test-model-e6c75d-kserve-757bc97d6c-sdmgq\" (UID: \"0701a840-b816-440c-aa41-767993a2f208\") " pod="ai-tenant-e2e-shared-a-e6c75d/auth-test-model-e6c75d-kserve-757bc97d6c-sdmgq"
Jul 15 12:54:15.664088 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:15.664014    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0701a840-b816-440c-aa41-767993a2f208-tls-certs\") pod \"auth-test-model-e6c75d-kserve-757bc97d6c-sdmgq\" (UID: \"0701a840-b816-440c-aa41-767993a2f208\") " pod="ai-tenant-e2e-shared-a-e6c75d/auth-test-model-e6c75d-kserve-757bc97d6c-sdmgq"
Jul 15 12:54:15.664088 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:15.664061    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdbzx\" (UniqueName: \"kubernetes.io/projected/0701a840-b816-440c-aa41-767993a2f208-kube-api-access-fdbzx\") pod \"auth-test-model-e6c75d-kserve-757bc97d6c-sdmgq\" (UID: \"0701a840-b816-440c-aa41-767993a2f208\") " pod="ai-tenant-e2e-shared-a-e6c75d/auth-test-model-e6c75d-kserve-757bc97d6c-sdmgq"
Jul 15 12:54:15.664411 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:15.664391    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0701a840-b816-440c-aa41-767993a2f208-tmp-dir\") pod \"auth-test-model-e6c75d-kserve-757bc97d6c-sdmgq\" (UID: \"0701a840-b816-440c-aa41-767993a2f208\") " pod="ai-tenant-e2e-shared-a-e6c75d/auth-test-model-e6c75d-kserve-757bc97d6c-sdmgq"
Jul 15 12:54:15.664475 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:15.664436    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0701a840-b816-440c-aa41-767993a2f208-model-cache\") pod \"auth-test-model-e6c75d-kserve-757bc97d6c-sdmgq\" (UID: \"0701a840-b816-440c-aa41-767993a2f208\") " pod="ai-tenant-e2e-shared-a-e6c75d/auth-test-model-e6c75d-kserve-757bc97d6c-sdmgq"
Jul 15 12:54:15.664475 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:15.664462    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0701a840-b816-440c-aa41-767993a2f208-home\") pod \"auth-test-model-e6c75d-kserve-757bc97d6c-sdmgq\" (UID: \"0701a840-b816-440c-aa41-767993a2f208\") " pod="ai-tenant-e2e-shared-a-e6c75d/auth-test-model-e6c75d-kserve-757bc97d6c-sdmgq"
Jul 15 12:54:15.666205 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:15.666185    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0701a840-b816-440c-aa41-767993a2f208-dshm\") pod \"auth-test-model-e6c75d-kserve-757bc97d6c-sdmgq\" (UID: \"0701a840-b816-440c-aa41-767993a2f208\") " pod="ai-tenant-e2e-shared-a-e6c75d/auth-test-model-e6c75d-kserve-757bc97d6c-sdmgq"
Jul 15 12:54:15.666570 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:15.666547    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0701a840-b816-440c-aa41-767993a2f208-tls-certs\") pod \"auth-test-model-e6c75d-kserve-757bc97d6c-sdmgq\" (UID: \"0701a840-b816-440c-aa41-767993a2f208\") " pod="ai-tenant-e2e-shared-a-e6c75d/auth-test-model-e6c75d-kserve-757bc97d6c-sdmgq"
Jul 15 12:54:15.671505 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:15.671488    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdbzx\" (UniqueName: \"kubernetes.io/projected/0701a840-b816-440c-aa41-767993a2f208-kube-api-access-fdbzx\") pod \"auth-test-model-e6c75d-kserve-757bc97d6c-sdmgq\" (UID: \"0701a840-b816-440c-aa41-767993a2f208\") " pod="ai-tenant-e2e-shared-a-e6c75d/auth-test-model-e6c75d-kserve-757bc97d6c-sdmgq"
Jul 15 12:54:15.756875 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:15.756839    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e6c75d/auth-test-model-e6c75d-kserve-757bc97d6c-sdmgq"
Jul 15 12:54:15.888949 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:15.888921    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-e6c75d/auth-test-model-e6c75d-kserve-757bc97d6c-sdmgq"]
Jul 15 12:54:15.891166 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:54:15.891138    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0701a840_b816_440c_aa41_767993a2f208.slice/crio-e904b32144689737c9e870e0304b57ed90246f8c7fec05473628bcc897b05791 WatchSource:0}: Error finding container e904b32144689737c9e870e0304b57ed90246f8c7fec05473628bcc897b05791: Status 404 returned error can't find the container with id e904b32144689737c9e870e0304b57ed90246f8c7fec05473628bcc897b05791
Jul 15 12:54:16.108910 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:16.108818    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e6c75d/auth-test-model-e6c75d-kserve-757bc97d6c-sdmgq" event={"ID":"0701a840-b816-440c-aa41-767993a2f208","Type":"ContainerStarted","Data":"532bb9488704d3107831ad0c64d02c265492f4a43a4c900f0f32491fd50348ee"}
Jul 15 12:54:16.108910 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:16.108862    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e6c75d/auth-test-model-e6c75d-kserve-757bc97d6c-sdmgq" event={"ID":"0701a840-b816-440c-aa41-767993a2f208","Type":"ContainerStarted","Data":"e904b32144689737c9e870e0304b57ed90246f8c7fec05473628bcc897b05791"}
Jul 15 12:54:16.125670 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:16.125628    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-e6c75d/auth-test-model-e6c75d-kserve-757bc97d6c-sdmgq" podStartSLOduration=1.125614165 podStartE2EDuration="1.125614165s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:54:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:54:16.124488451 +0000 UTC m=+2603.238882196" watchObservedRunningTime="2026-07-15 12:54:16.125614165 +0000 UTC m=+2603.240007897"
Jul 15 12:54:25.757194 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:25.757158    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-e6c75d/auth-test-model-e6c75d-kserve-757bc97d6c-sdmgq"
Jul 15 12:54:25.757194 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:25.757202    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-e6c75d/auth-test-model-e6c75d-kserve-757bc97d6c-sdmgq"
Jul 15 12:54:25.769882 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:25.769850    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-e6c75d/auth-test-model-e6c75d-kserve-757bc97d6c-sdmgq"
Jul 15 12:54:26.169372 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:26.169258    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-e6c75d/auth-test-model-e6c75d-kserve-757bc97d6c-sdmgq"
Jul 15 12:54:35.149455 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:35.149421    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-dc94b0/auth-test-model-dc94b0-kserve-7ccbc447bc-ppf8w"]
Jul 15 12:54:35.152533 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:35.152515    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-dc94b0/auth-test-model-dc94b0-kserve-7ccbc447bc-ppf8w"
Jul 15 12:54:35.155075 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:35.155054    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-dc94b0\"/\"openshift-service-ca.crt\""
Jul 15 12:54:35.156263 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:35.156245    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-dc94b0\"/\"auth-test-model-dc94b0-kserve-self-signed-certs\""
Jul 15 12:54:35.156383 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:35.156304    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-dc94b0\"/\"kube-root-ca.crt\""
Jul 15 12:54:35.156383 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:35.156374    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-dc94b0\"/\"default-dockercfg-m7k98\""
Jul 15 12:54:35.162438 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:35.162416    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-dc94b0/auth-test-model-dc94b0-kserve-7ccbc447bc-ppf8w"]
Jul 15 12:54:35.247882 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:35.247836    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bda150d-08eb-407f-8a61-3956ceaa620d-dshm\") pod \"auth-test-model-dc94b0-kserve-7ccbc447bc-ppf8w\" (UID: \"5bda150d-08eb-407f-8a61-3956ceaa620d\") " pod="ai-tenant-e2e-shared-b-dc94b0/auth-test-model-dc94b0-kserve-7ccbc447bc-ppf8w"
Jul 15 12:54:35.247882 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:35.247888    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bda150d-08eb-407f-8a61-3956ceaa620d-tls-certs\") pod \"auth-test-model-dc94b0-kserve-7ccbc447bc-ppf8w\" (UID: \"5bda150d-08eb-407f-8a61-3956ceaa620d\") " pod="ai-tenant-e2e-shared-b-dc94b0/auth-test-model-dc94b0-kserve-7ccbc447bc-ppf8w"
Jul 15 12:54:35.248134 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:35.247957    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bda150d-08eb-407f-8a61-3956ceaa620d-tmp-dir\") pod \"auth-test-model-dc94b0-kserve-7ccbc447bc-ppf8w\" (UID: \"5bda150d-08eb-407f-8a61-3956ceaa620d\") " pod="ai-tenant-e2e-shared-b-dc94b0/auth-test-model-dc94b0-kserve-7ccbc447bc-ppf8w"
Jul 15 12:54:35.248134 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:35.248026    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bda150d-08eb-407f-8a61-3956ceaa620d-home\") pod \"auth-test-model-dc94b0-kserve-7ccbc447bc-ppf8w\" (UID: \"5bda150d-08eb-407f-8a61-3956ceaa620d\") " pod="ai-tenant-e2e-shared-b-dc94b0/auth-test-model-dc94b0-kserve-7ccbc447bc-ppf8w"
Jul 15 12:54:35.248134 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:35.248124    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bda150d-08eb-407f-8a61-3956ceaa620d-model-cache\") pod \"auth-test-model-dc94b0-kserve-7ccbc447bc-ppf8w\" (UID: \"5bda150d-08eb-407f-8a61-3956ceaa620d\") " pod="ai-tenant-e2e-shared-b-dc94b0/auth-test-model-dc94b0-kserve-7ccbc447bc-ppf8w"
Jul 15 12:54:35.248263 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:35.248148    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55qgr\" (UniqueName: \"kubernetes.io/projected/5bda150d-08eb-407f-8a61-3956ceaa620d-kube-api-access-55qgr\") pod \"auth-test-model-dc94b0-kserve-7ccbc447bc-ppf8w\" (UID: \"5bda150d-08eb-407f-8a61-3956ceaa620d\") " pod="ai-tenant-e2e-shared-b-dc94b0/auth-test-model-dc94b0-kserve-7ccbc447bc-ppf8w"
Jul 15 12:54:35.348973 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:35.348925    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bda150d-08eb-407f-8a61-3956ceaa620d-model-cache\") pod \"auth-test-model-dc94b0-kserve-7ccbc447bc-ppf8w\" (UID: \"5bda150d-08eb-407f-8a61-3956ceaa620d\") " pod="ai-tenant-e2e-shared-b-dc94b0/auth-test-model-dc94b0-kserve-7ccbc447bc-ppf8w"
Jul 15 12:54:35.348973 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:35.348979    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55qgr\" (UniqueName: \"kubernetes.io/projected/5bda150d-08eb-407f-8a61-3956ceaa620d-kube-api-access-55qgr\") pod \"auth-test-model-dc94b0-kserve-7ccbc447bc-ppf8w\" (UID: \"5bda150d-08eb-407f-8a61-3956ceaa620d\") " pod="ai-tenant-e2e-shared-b-dc94b0/auth-test-model-dc94b0-kserve-7ccbc447bc-ppf8w"
Jul 15 12:54:35.349190 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:35.349011    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bda150d-08eb-407f-8a61-3956ceaa620d-dshm\") pod \"auth-test-model-dc94b0-kserve-7ccbc447bc-ppf8w\" (UID: \"5bda150d-08eb-407f-8a61-3956ceaa620d\") " pod="ai-tenant-e2e-shared-b-dc94b0/auth-test-model-dc94b0-kserve-7ccbc447bc-ppf8w"
Jul 15 12:54:35.349190 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:35.349033    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bda150d-08eb-407f-8a61-3956ceaa620d-tls-certs\") pod \"auth-test-model-dc94b0-kserve-7ccbc447bc-ppf8w\" (UID: \"5bda150d-08eb-407f-8a61-3956ceaa620d\") " pod="ai-tenant-e2e-shared-b-dc94b0/auth-test-model-dc94b0-kserve-7ccbc447bc-ppf8w"
Jul 15 12:54:35.349190 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:35.349056    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bda150d-08eb-407f-8a61-3956ceaa620d-tmp-dir\") pod \"auth-test-model-dc94b0-kserve-7ccbc447bc-ppf8w\" (UID: \"5bda150d-08eb-407f-8a61-3956ceaa620d\") " pod="ai-tenant-e2e-shared-b-dc94b0/auth-test-model-dc94b0-kserve-7ccbc447bc-ppf8w"
Jul 15 12:54:35.349190 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:35.349078    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bda150d-08eb-407f-8a61-3956ceaa620d-home\") pod \"auth-test-model-dc94b0-kserve-7ccbc447bc-ppf8w\" (UID: \"5bda150d-08eb-407f-8a61-3956ceaa620d\") " pod="ai-tenant-e2e-shared-b-dc94b0/auth-test-model-dc94b0-kserve-7ccbc447bc-ppf8w"
Jul 15 12:54:35.349445 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:35.349421    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bda150d-08eb-407f-8a61-3956ceaa620d-model-cache\") pod \"auth-test-model-dc94b0-kserve-7ccbc447bc-ppf8w\" (UID: \"5bda150d-08eb-407f-8a61-3956ceaa620d\") " pod="ai-tenant-e2e-shared-b-dc94b0/auth-test-model-dc94b0-kserve-7ccbc447bc-ppf8w"
Jul 15 12:54:35.349534 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:35.349511    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bda150d-08eb-407f-8a61-3956ceaa620d-tmp-dir\") pod \"auth-test-model-dc94b0-kserve-7ccbc447bc-ppf8w\" (UID: \"5bda150d-08eb-407f-8a61-3956ceaa620d\") " pod="ai-tenant-e2e-shared-b-dc94b0/auth-test-model-dc94b0-kserve-7ccbc447bc-ppf8w"
Jul 15 12:54:35.349574 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:35.349537    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bda150d-08eb-407f-8a61-3956ceaa620d-home\") pod \"auth-test-model-dc94b0-kserve-7ccbc447bc-ppf8w\" (UID: \"5bda150d-08eb-407f-8a61-3956ceaa620d\") " pod="ai-tenant-e2e-shared-b-dc94b0/auth-test-model-dc94b0-kserve-7ccbc447bc-ppf8w"
Jul 15 12:54:35.351361 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:35.351333    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bda150d-08eb-407f-8a61-3956ceaa620d-dshm\") pod \"auth-test-model-dc94b0-kserve-7ccbc447bc-ppf8w\" (UID: \"5bda150d-08eb-407f-8a61-3956ceaa620d\") " pod="ai-tenant-e2e-shared-b-dc94b0/auth-test-model-dc94b0-kserve-7ccbc447bc-ppf8w"
Jul 15 12:54:35.351622 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:35.351604    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bda150d-08eb-407f-8a61-3956ceaa620d-tls-certs\") pod \"auth-test-model-dc94b0-kserve-7ccbc447bc-ppf8w\" (UID: \"5bda150d-08eb-407f-8a61-3956ceaa620d\") " pod="ai-tenant-e2e-shared-b-dc94b0/auth-test-model-dc94b0-kserve-7ccbc447bc-ppf8w"
Jul 15 12:54:35.357410 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:35.357388    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55qgr\" (UniqueName: \"kubernetes.io/projected/5bda150d-08eb-407f-8a61-3956ceaa620d-kube-api-access-55qgr\") pod \"auth-test-model-dc94b0-kserve-7ccbc447bc-ppf8w\" (UID: \"5bda150d-08eb-407f-8a61-3956ceaa620d\") " pod="ai-tenant-e2e-shared-b-dc94b0/auth-test-model-dc94b0-kserve-7ccbc447bc-ppf8w"
Jul 15 12:54:35.462410 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:35.462383    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-dc94b0/auth-test-model-dc94b0-kserve-7ccbc447bc-ppf8w"
Jul 15 12:54:35.597999 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:35.597948    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-dc94b0/auth-test-model-dc94b0-kserve-7ccbc447bc-ppf8w"]
Jul 15 12:54:35.600307 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:54:35.600261    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5bda150d_08eb_407f_8a61_3956ceaa620d.slice/crio-6c717d32c6665b15d46fd7a1204b7b7f866e6b03b99416b7de4eb58bd97dc669 WatchSource:0}: Error finding container 6c717d32c6665b15d46fd7a1204b7b7f866e6b03b99416b7de4eb58bd97dc669: Status 404 returned error can't find the container with id 6c717d32c6665b15d46fd7a1204b7b7f866e6b03b99416b7de4eb58bd97dc669
Jul 15 12:54:36.207605 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:36.207569    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-dc94b0/auth-test-model-dc94b0-kserve-7ccbc447bc-ppf8w" event={"ID":"5bda150d-08eb-407f-8a61-3956ceaa620d","Type":"ContainerStarted","Data":"aaf0d4b8e393a3a4018da7fe9995d38e8fe384bc44bc9138637410016c9a81c9"}
Jul 15 12:54:36.208016 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:36.207614    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-dc94b0/auth-test-model-dc94b0-kserve-7ccbc447bc-ppf8w" event={"ID":"5bda150d-08eb-407f-8a61-3956ceaa620d","Type":"ContainerStarted","Data":"6c717d32c6665b15d46fd7a1204b7b7f866e6b03b99416b7de4eb58bd97dc669"}
Jul 15 12:54:36.225187 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:36.225142    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-dc94b0/auth-test-model-dc94b0-kserve-7ccbc447bc-ppf8w" podStartSLOduration=1.225125745 podStartE2EDuration="1.225125745s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:54:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:54:36.22319219 +0000 UTC m=+2623.337585921" watchObservedRunningTime="2026-07-15 12:54:36.225125745 +0000 UTC m=+2623.339519477"
Jul 15 12:54:45.462599 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:45.462562    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-dc94b0/auth-test-model-dc94b0-kserve-7ccbc447bc-ppf8w"
Jul 15 12:54:45.463024 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:45.462621    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-dc94b0/auth-test-model-dc94b0-kserve-7ccbc447bc-ppf8w"
Jul 15 12:54:45.476958 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:45.476932    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-dc94b0/auth-test-model-dc94b0-kserve-7ccbc447bc-ppf8w"
Jul 15 12:54:46.268420 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:54:46.268385    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-dc94b0/auth-test-model-dc94b0-kserve-7ccbc447bc-ppf8w"
Jul 15 12:55:53.582115 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:55:53.582041    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xkvbf_641b0ffa-0450-4198-8066-0241ab179822/console-operator/2.log"
Jul 15 12:55:53.590701 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:55:53.590678    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xh4rs_2de62ab2-7502-4c13-a6f0-5ebbd4982798/ovn-acl-logging/0.log"
Jul 15 12:55:53.597750 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:55:53.597732    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xkvbf_641b0ffa-0450-4198-8066-0241ab179822/console-operator/2.log"
Jul 15 12:55:53.605662 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:55:53.605645    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xh4rs_2de62ab2-7502-4c13-a6f0-5ebbd4982798/ovn-acl-logging/0.log"
Jul 15 12:56:47.754185 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:56:47.754152    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-e6c75d/auth-test-model-e6c75d-kserve-757bc97d6c-sdmgq"]
Jul 15 12:56:48.661260 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:56:48.661226    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-dc94b0/auth-test-model-dc94b0-kserve-7ccbc447bc-ppf8w"]
Jul 15 12:56:55.562692 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:56:55.562661    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-e6c75d/sub-test-model-e6c75d-kserve-84dc6fc47-hpwfd"]
Jul 15 12:56:55.566246 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:56:55.566227    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e6c75d/sub-test-model-e6c75d-kserve-84dc6fc47-hpwfd"
Jul 15 12:56:55.569506 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:56:55.569483    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-e6c75d\"/\"sub-test-model-e6c75d-kserve-self-signed-certs\""
Jul 15 12:56:55.577970 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:56:55.577935    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-e6c75d/sub-test-model-e6c75d-kserve-84dc6fc47-hpwfd"]
Jul 15 12:56:55.651687 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:56:55.651648    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/faf7b8ba-d528-492d-888d-b84027e4d68f-tmp-dir\") pod \"sub-test-model-e6c75d-kserve-84dc6fc47-hpwfd\" (UID: \"faf7b8ba-d528-492d-888d-b84027e4d68f\") " pod="ai-tenant-e2e-shared-a-e6c75d/sub-test-model-e6c75d-kserve-84dc6fc47-hpwfd"
Jul 15 12:56:55.651908 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:56:55.651711    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/faf7b8ba-d528-492d-888d-b84027e4d68f-home\") pod \"sub-test-model-e6c75d-kserve-84dc6fc47-hpwfd\" (UID: \"faf7b8ba-d528-492d-888d-b84027e4d68f\") " pod="ai-tenant-e2e-shared-a-e6c75d/sub-test-model-e6c75d-kserve-84dc6fc47-hpwfd"
Jul 15 12:56:55.651908 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:56:55.651790    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/faf7b8ba-d528-492d-888d-b84027e4d68f-model-cache\") pod \"sub-test-model-e6c75d-kserve-84dc6fc47-hpwfd\" (UID: \"faf7b8ba-d528-492d-888d-b84027e4d68f\") " pod="ai-tenant-e2e-shared-a-e6c75d/sub-test-model-e6c75d-kserve-84dc6fc47-hpwfd"
Jul 15 12:56:55.651908 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:56:55.651868    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/faf7b8ba-d528-492d-888d-b84027e4d68f-tls-certs\") pod \"sub-test-model-e6c75d-kserve-84dc6fc47-hpwfd\" (UID: \"faf7b8ba-d528-492d-888d-b84027e4d68f\") " pod="ai-tenant-e2e-shared-a-e6c75d/sub-test-model-e6c75d-kserve-84dc6fc47-hpwfd"
Jul 15 12:56:55.652074 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:56:55.651935    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/faf7b8ba-d528-492d-888d-b84027e4d68f-dshm\") pod \"sub-test-model-e6c75d-kserve-84dc6fc47-hpwfd\" (UID: \"faf7b8ba-d528-492d-888d-b84027e4d68f\") " pod="ai-tenant-e2e-shared-a-e6c75d/sub-test-model-e6c75d-kserve-84dc6fc47-hpwfd"
Jul 15 12:56:55.652074 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:56:55.651961    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8f7zw\" (UniqueName: \"kubernetes.io/projected/faf7b8ba-d528-492d-888d-b84027e4d68f-kube-api-access-8f7zw\") pod \"sub-test-model-e6c75d-kserve-84dc6fc47-hpwfd\" (UID: \"faf7b8ba-d528-492d-888d-b84027e4d68f\") " pod="ai-tenant-e2e-shared-a-e6c75d/sub-test-model-e6c75d-kserve-84dc6fc47-hpwfd"
Jul 15 12:56:55.752597 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:56:55.752559    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/faf7b8ba-d528-492d-888d-b84027e4d68f-model-cache\") pod \"sub-test-model-e6c75d-kserve-84dc6fc47-hpwfd\" (UID: \"faf7b8ba-d528-492d-888d-b84027e4d68f\") " pod="ai-tenant-e2e-shared-a-e6c75d/sub-test-model-e6c75d-kserve-84dc6fc47-hpwfd"
Jul 15 12:56:55.752809 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:56:55.752617    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/faf7b8ba-d528-492d-888d-b84027e4d68f-tls-certs\") pod \"sub-test-model-e6c75d-kserve-84dc6fc47-hpwfd\" (UID: \"faf7b8ba-d528-492d-888d-b84027e4d68f\") " pod="ai-tenant-e2e-shared-a-e6c75d/sub-test-model-e6c75d-kserve-84dc6fc47-hpwfd"
Jul 15 12:56:55.752809 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:56:55.752667    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/faf7b8ba-d528-492d-888d-b84027e4d68f-dshm\") pod \"sub-test-model-e6c75d-kserve-84dc6fc47-hpwfd\" (UID: \"faf7b8ba-d528-492d-888d-b84027e4d68f\") " pod="ai-tenant-e2e-shared-a-e6c75d/sub-test-model-e6c75d-kserve-84dc6fc47-hpwfd"
Jul 15 12:56:55.752809 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:56:55.752685    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8f7zw\" (UniqueName: \"kubernetes.io/projected/faf7b8ba-d528-492d-888d-b84027e4d68f-kube-api-access-8f7zw\") pod \"sub-test-model-e6c75d-kserve-84dc6fc47-hpwfd\" (UID: \"faf7b8ba-d528-492d-888d-b84027e4d68f\") " pod="ai-tenant-e2e-shared-a-e6c75d/sub-test-model-e6c75d-kserve-84dc6fc47-hpwfd"
Jul 15 12:56:55.752809 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:56:55.752729    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/faf7b8ba-d528-492d-888d-b84027e4d68f-tmp-dir\") pod \"sub-test-model-e6c75d-kserve-84dc6fc47-hpwfd\" (UID: \"faf7b8ba-d528-492d-888d-b84027e4d68f\") " pod="ai-tenant-e2e-shared-a-e6c75d/sub-test-model-e6c75d-kserve-84dc6fc47-hpwfd"
Jul 15 12:56:55.752809 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:56:55.752793    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/faf7b8ba-d528-492d-888d-b84027e4d68f-home\") pod \"sub-test-model-e6c75d-kserve-84dc6fc47-hpwfd\" (UID: \"faf7b8ba-d528-492d-888d-b84027e4d68f\") " pod="ai-tenant-e2e-shared-a-e6c75d/sub-test-model-e6c75d-kserve-84dc6fc47-hpwfd"
Jul 15 12:56:55.753084 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:56:55.753049    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/faf7b8ba-d528-492d-888d-b84027e4d68f-model-cache\") pod \"sub-test-model-e6c75d-kserve-84dc6fc47-hpwfd\" (UID: \"faf7b8ba-d528-492d-888d-b84027e4d68f\") " pod="ai-tenant-e2e-shared-a-e6c75d/sub-test-model-e6c75d-kserve-84dc6fc47-hpwfd"
Jul 15 12:56:55.753127 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:56:55.753107    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/faf7b8ba-d528-492d-888d-b84027e4d68f-home\") pod \"sub-test-model-e6c75d-kserve-84dc6fc47-hpwfd\" (UID: \"faf7b8ba-d528-492d-888d-b84027e4d68f\") " pod="ai-tenant-e2e-shared-a-e6c75d/sub-test-model-e6c75d-kserve-84dc6fc47-hpwfd"
Jul 15 12:56:55.753184 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:56:55.753161    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/faf7b8ba-d528-492d-888d-b84027e4d68f-tmp-dir\") pod \"sub-test-model-e6c75d-kserve-84dc6fc47-hpwfd\" (UID: \"faf7b8ba-d528-492d-888d-b84027e4d68f\") " pod="ai-tenant-e2e-shared-a-e6c75d/sub-test-model-e6c75d-kserve-84dc6fc47-hpwfd"
Jul 15 12:56:55.754996 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:56:55.754978    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/faf7b8ba-d528-492d-888d-b84027e4d68f-dshm\") pod \"sub-test-model-e6c75d-kserve-84dc6fc47-hpwfd\" (UID: \"faf7b8ba-d528-492d-888d-b84027e4d68f\") " pod="ai-tenant-e2e-shared-a-e6c75d/sub-test-model-e6c75d-kserve-84dc6fc47-hpwfd"
Jul 15 12:56:55.755169 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:56:55.755152    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/faf7b8ba-d528-492d-888d-b84027e4d68f-tls-certs\") pod \"sub-test-model-e6c75d-kserve-84dc6fc47-hpwfd\" (UID: \"faf7b8ba-d528-492d-888d-b84027e4d68f\") " pod="ai-tenant-e2e-shared-a-e6c75d/sub-test-model-e6c75d-kserve-84dc6fc47-hpwfd"
Jul 15 12:56:55.761548 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:56:55.761522    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8f7zw\" (UniqueName: \"kubernetes.io/projected/faf7b8ba-d528-492d-888d-b84027e4d68f-kube-api-access-8f7zw\") pod \"sub-test-model-e6c75d-kserve-84dc6fc47-hpwfd\" (UID: \"faf7b8ba-d528-492d-888d-b84027e4d68f\") " pod="ai-tenant-e2e-shared-a-e6c75d/sub-test-model-e6c75d-kserve-84dc6fc47-hpwfd"
Jul 15 12:56:55.876140 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:56:55.876054    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e6c75d/sub-test-model-e6c75d-kserve-84dc6fc47-hpwfd"
Jul 15 12:56:56.010072 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:56:56.010045    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-e6c75d/sub-test-model-e6c75d-kserve-84dc6fc47-hpwfd"]
Jul 15 12:56:56.011612 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:56:56.011581    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfaf7b8ba_d528_492d_888d_b84027e4d68f.slice/crio-148383889cdc35dc16baea15b2bbba868a8f3da243fee8a8c9ba4f525492fb30 WatchSource:0}: Error finding container 148383889cdc35dc16baea15b2bbba868a8f3da243fee8a8c9ba4f525492fb30: Status 404 returned error can't find the container with id 148383889cdc35dc16baea15b2bbba868a8f3da243fee8a8c9ba4f525492fb30
Jul 15 12:56:56.883847 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:56:56.883812    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e6c75d/sub-test-model-e6c75d-kserve-84dc6fc47-hpwfd" event={"ID":"faf7b8ba-d528-492d-888d-b84027e4d68f","Type":"ContainerStarted","Data":"289cdda493ebf11c3b77c13a746c09c26b6f295916c672eb6855a857b360c753"}
Jul 15 12:56:56.884234 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:56:56.883857    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e6c75d/sub-test-model-e6c75d-kserve-84dc6fc47-hpwfd" event={"ID":"faf7b8ba-d528-492d-888d-b84027e4d68f","Type":"ContainerStarted","Data":"148383889cdc35dc16baea15b2bbba868a8f3da243fee8a8c9ba4f525492fb30"}
Jul 15 12:56:56.902093 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:56:56.902049    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-e6c75d/sub-test-model-e6c75d-kserve-84dc6fc47-hpwfd" podStartSLOduration=1.902035768 podStartE2EDuration="1.902035768s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:56:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:56:56.899915778 +0000 UTC m=+2764.014309510" watchObservedRunningTime="2026-07-15 12:56:56.902035768 +0000 UTC m=+2764.016429499"
Jul 15 12:57:02.774127 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:02.774055    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-e6c75d/auth-test-model-e6c75d-kserve-757bc97d6c-sdmgq" podUID="0701a840-b816-440c-aa41-767993a2f208" containerName="main" containerID="cri-o://532bb9488704d3107831ad0c64d02c265492f4a43a4c900f0f32491fd50348ee" gracePeriod=45
Jul 15 12:57:02.914759 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:02.914730    2560 generic.go:356] "Generic (PLEG): container finished" podID="0701a840-b816-440c-aa41-767993a2f208" containerID="532bb9488704d3107831ad0c64d02c265492f4a43a4c900f0f32491fd50348ee" exitCode=0
Jul 15 12:57:02.914882 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:02.914770    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e6c75d/auth-test-model-e6c75d-kserve-757bc97d6c-sdmgq" event={"ID":"0701a840-b816-440c-aa41-767993a2f208","Type":"ContainerDied","Data":"532bb9488704d3107831ad0c64d02c265492f4a43a4c900f0f32491fd50348ee"}
Jul 15 12:57:03.029185 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:03.029127    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e6c75d/auth-test-model-e6c75d-kserve-757bc97d6c-sdmgq"
Jul 15 12:57:03.123939 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:03.123909    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0701a840-b816-440c-aa41-767993a2f208-tls-certs\") pod \"0701a840-b816-440c-aa41-767993a2f208\" (UID: \"0701a840-b816-440c-aa41-767993a2f208\") "
Jul 15 12:57:03.123939 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:03.123943    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0701a840-b816-440c-aa41-767993a2f208-home\") pod \"0701a840-b816-440c-aa41-767993a2f208\" (UID: \"0701a840-b816-440c-aa41-767993a2f208\") "
Jul 15 12:57:03.124128 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:03.123987    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0701a840-b816-440c-aa41-767993a2f208-dshm\") pod \"0701a840-b816-440c-aa41-767993a2f208\" (UID: \"0701a840-b816-440c-aa41-767993a2f208\") "
Jul 15 12:57:03.124128 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:03.124039    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fdbzx\" (UniqueName: \"kubernetes.io/projected/0701a840-b816-440c-aa41-767993a2f208-kube-api-access-fdbzx\") pod \"0701a840-b816-440c-aa41-767993a2f208\" (UID: \"0701a840-b816-440c-aa41-767993a2f208\") "
Jul 15 12:57:03.124128 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:03.124098    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0701a840-b816-440c-aa41-767993a2f208-model-cache\") pod \"0701a840-b816-440c-aa41-767993a2f208\" (UID: \"0701a840-b816-440c-aa41-767993a2f208\") "
Jul 15 12:57:03.124285 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:03.124130    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0701a840-b816-440c-aa41-767993a2f208-tmp-dir\") pod \"0701a840-b816-440c-aa41-767993a2f208\" (UID: \"0701a840-b816-440c-aa41-767993a2f208\") "
Jul 15 12:57:03.124383 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:03.124275    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0701a840-b816-440c-aa41-767993a2f208-home" (OuterVolumeSpecName: "home") pod "0701a840-b816-440c-aa41-767993a2f208" (UID: "0701a840-b816-440c-aa41-767993a2f208"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:57:03.124440 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:03.124378    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0701a840-b816-440c-aa41-767993a2f208-model-cache" (OuterVolumeSpecName: "model-cache") pod "0701a840-b816-440c-aa41-767993a2f208" (UID: "0701a840-b816-440c-aa41-767993a2f208"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:57:03.124523 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:03.124503    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0701a840-b816-440c-aa41-767993a2f208-home\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:57:03.124580 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:03.124520    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0701a840-b816-440c-aa41-767993a2f208-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0701a840-b816-440c-aa41-767993a2f208" (UID: "0701a840-b816-440c-aa41-767993a2f208"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:57:03.124580 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:03.124528    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0701a840-b816-440c-aa41-767993a2f208-model-cache\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:57:03.126215 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:03.126185    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0701a840-b816-440c-aa41-767993a2f208-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0701a840-b816-440c-aa41-767993a2f208" (UID: "0701a840-b816-440c-aa41-767993a2f208"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:57:03.126215 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:03.126206    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0701a840-b816-440c-aa41-767993a2f208-kube-api-access-fdbzx" (OuterVolumeSpecName: "kube-api-access-fdbzx") pod "0701a840-b816-440c-aa41-767993a2f208" (UID: "0701a840-b816-440c-aa41-767993a2f208"). InnerVolumeSpecName "kube-api-access-fdbzx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:57:03.126377 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:03.126185    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0701a840-b816-440c-aa41-767993a2f208-dshm" (OuterVolumeSpecName: "dshm") pod "0701a840-b816-440c-aa41-767993a2f208" (UID: "0701a840-b816-440c-aa41-767993a2f208"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:57:03.225518 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:03.225492    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fdbzx\" (UniqueName: \"kubernetes.io/projected/0701a840-b816-440c-aa41-767993a2f208-kube-api-access-fdbzx\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:57:03.225518 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:03.225514    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0701a840-b816-440c-aa41-767993a2f208-tmp-dir\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:57:03.225670 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:03.225525    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0701a840-b816-440c-aa41-767993a2f208-tls-certs\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:57:03.225670 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:03.225532    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0701a840-b816-440c-aa41-767993a2f208-dshm\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:57:03.681824 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:03.681788    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-dc94b0/auth-test-model-dc94b0-kserve-7ccbc447bc-ppf8w" podUID="5bda150d-08eb-407f-8a61-3956ceaa620d" containerName="main" containerID="cri-o://aaf0d4b8e393a3a4018da7fe9995d38e8fe384bc44bc9138637410016c9a81c9" gracePeriod=45
Jul 15 12:57:03.921605 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:03.921571    2560 generic.go:356] "Generic (PLEG): container finished" podID="5bda150d-08eb-407f-8a61-3956ceaa620d" containerID="aaf0d4b8e393a3a4018da7fe9995d38e8fe384bc44bc9138637410016c9a81c9" exitCode=0
Jul 15 12:57:03.921965 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:03.921634    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-dc94b0/auth-test-model-dc94b0-kserve-7ccbc447bc-ppf8w" event={"ID":"5bda150d-08eb-407f-8a61-3956ceaa620d","Type":"ContainerDied","Data":"aaf0d4b8e393a3a4018da7fe9995d38e8fe384bc44bc9138637410016c9a81c9"}
Jul 15 12:57:03.921965 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:03.921676    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-dc94b0/auth-test-model-dc94b0-kserve-7ccbc447bc-ppf8w" event={"ID":"5bda150d-08eb-407f-8a61-3956ceaa620d","Type":"ContainerDied","Data":"6c717d32c6665b15d46fd7a1204b7b7f866e6b03b99416b7de4eb58bd97dc669"}
Jul 15 12:57:03.921965 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:03.921691    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6c717d32c6665b15d46fd7a1204b7b7f866e6b03b99416b7de4eb58bd97dc669"
Jul 15 12:57:03.922900 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:03.922878    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e6c75d/auth-test-model-e6c75d-kserve-757bc97d6c-sdmgq" event={"ID":"0701a840-b816-440c-aa41-767993a2f208","Type":"ContainerDied","Data":"e904b32144689737c9e870e0304b57ed90246f8c7fec05473628bcc897b05791"}
Jul 15 12:57:03.922990 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:03.922908    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e6c75d/auth-test-model-e6c75d-kserve-757bc97d6c-sdmgq"
Jul 15 12:57:03.922990 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:03.922917    2560 scope.go:117] "RemoveContainer" containerID="532bb9488704d3107831ad0c64d02c265492f4a43a4c900f0f32491fd50348ee"
Jul 15 12:57:03.936720 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:03.936701    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-dc94b0/auth-test-model-dc94b0-kserve-7ccbc447bc-ppf8w"
Jul 15 12:57:03.946203 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:03.946182    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-e6c75d/auth-test-model-e6c75d-kserve-757bc97d6c-sdmgq"]
Jul 15 12:57:03.951986 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:03.951967    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-e6c75d/auth-test-model-e6c75d-kserve-757bc97d6c-sdmgq"]
Jul 15 12:57:04.032143 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:04.032108    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bda150d-08eb-407f-8a61-3956ceaa620d-tls-certs\") pod \"5bda150d-08eb-407f-8a61-3956ceaa620d\" (UID: \"5bda150d-08eb-407f-8a61-3956ceaa620d\") "
Jul 15 12:57:04.032347 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:04.032157    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bda150d-08eb-407f-8a61-3956ceaa620d-model-cache\") pod \"5bda150d-08eb-407f-8a61-3956ceaa620d\" (UID: \"5bda150d-08eb-407f-8a61-3956ceaa620d\") "
Jul 15 12:57:04.032347 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:04.032198    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bda150d-08eb-407f-8a61-3956ceaa620d-home\") pod \"5bda150d-08eb-407f-8a61-3956ceaa620d\" (UID: \"5bda150d-08eb-407f-8a61-3956ceaa620d\") "
Jul 15 12:57:04.032347 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:04.032226    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-55qgr\" (UniqueName: \"kubernetes.io/projected/5bda150d-08eb-407f-8a61-3956ceaa620d-kube-api-access-55qgr\") pod \"5bda150d-08eb-407f-8a61-3956ceaa620d\" (UID: \"5bda150d-08eb-407f-8a61-3956ceaa620d\") "
Jul 15 12:57:04.032347 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:04.032247    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bda150d-08eb-407f-8a61-3956ceaa620d-tmp-dir\") pod \"5bda150d-08eb-407f-8a61-3956ceaa620d\" (UID: \"5bda150d-08eb-407f-8a61-3956ceaa620d\") "
Jul 15 12:57:04.032347 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:04.032284    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bda150d-08eb-407f-8a61-3956ceaa620d-dshm\") pod \"5bda150d-08eb-407f-8a61-3956ceaa620d\" (UID: \"5bda150d-08eb-407f-8a61-3956ceaa620d\") "
Jul 15 12:57:04.032632 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:04.032511    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bda150d-08eb-407f-8a61-3956ceaa620d-home" (OuterVolumeSpecName: "home") pod "5bda150d-08eb-407f-8a61-3956ceaa620d" (UID: "5bda150d-08eb-407f-8a61-3956ceaa620d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:57:04.032632 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:04.032528    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bda150d-08eb-407f-8a61-3956ceaa620d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5bda150d-08eb-407f-8a61-3956ceaa620d" (UID: "5bda150d-08eb-407f-8a61-3956ceaa620d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:57:04.032632 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:04.032547    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bda150d-08eb-407f-8a61-3956ceaa620d-model-cache" (OuterVolumeSpecName: "model-cache") pod "5bda150d-08eb-407f-8a61-3956ceaa620d" (UID: "5bda150d-08eb-407f-8a61-3956ceaa620d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:57:04.032776 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:04.032673    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bda150d-08eb-407f-8a61-3956ceaa620d-home\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:57:04.032776 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:04.032687    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bda150d-08eb-407f-8a61-3956ceaa620d-tmp-dir\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:57:04.032776 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:04.032698    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bda150d-08eb-407f-8a61-3956ceaa620d-model-cache\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:57:04.034465 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:04.034441    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bda150d-08eb-407f-8a61-3956ceaa620d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5bda150d-08eb-407f-8a61-3956ceaa620d" (UID: "5bda150d-08eb-407f-8a61-3956ceaa620d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:57:04.034599 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:04.034464    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bda150d-08eb-407f-8a61-3956ceaa620d-dshm" (OuterVolumeSpecName: "dshm") pod "5bda150d-08eb-407f-8a61-3956ceaa620d" (UID: "5bda150d-08eb-407f-8a61-3956ceaa620d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:57:04.034599 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:04.034486    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bda150d-08eb-407f-8a61-3956ceaa620d-kube-api-access-55qgr" (OuterVolumeSpecName: "kube-api-access-55qgr") pod "5bda150d-08eb-407f-8a61-3956ceaa620d" (UID: "5bda150d-08eb-407f-8a61-3956ceaa620d"). InnerVolumeSpecName "kube-api-access-55qgr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:57:04.133753 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:04.133722    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55qgr\" (UniqueName: \"kubernetes.io/projected/5bda150d-08eb-407f-8a61-3956ceaa620d-kube-api-access-55qgr\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:57:04.133753 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:04.133748    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bda150d-08eb-407f-8a61-3956ceaa620d-dshm\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:57:04.133753 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:04.133760    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bda150d-08eb-407f-8a61-3956ceaa620d-tls-certs\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:57:04.928834 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:04.928805    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-dc94b0/auth-test-model-dc94b0-kserve-7ccbc447bc-ppf8w"
Jul 15 12:57:04.950635 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:04.950607    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-dc94b0/auth-test-model-dc94b0-kserve-7ccbc447bc-ppf8w"]
Jul 15 12:57:04.954392 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:04.954366    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-dc94b0/auth-test-model-dc94b0-kserve-7ccbc447bc-ppf8w"]
Jul 15 12:57:05.444324 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:05.444277    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0701a840-b816-440c-aa41-767993a2f208" path="/var/lib/kubelet/pods/0701a840-b816-440c-aa41-767993a2f208/volumes"
Jul 15 12:57:05.444711 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:05.444696    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5bda150d-08eb-407f-8a61-3956ceaa620d" path="/var/lib/kubelet/pods/5bda150d-08eb-407f-8a61-3956ceaa620d/volumes"
Jul 15 12:57:05.876646 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:05.876615    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-e6c75d/sub-test-model-e6c75d-kserve-84dc6fc47-hpwfd"
Jul 15 12:57:05.876646 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:05.876656    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-e6c75d/sub-test-model-e6c75d-kserve-84dc6fc47-hpwfd"
Jul 15 12:57:05.888818 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:05.888792    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-e6c75d/sub-test-model-e6c75d-kserve-84dc6fc47-hpwfd"
Jul 15 12:57:05.950612 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:05.950586    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-e6c75d/sub-test-model-e6c75d-kserve-84dc6fc47-hpwfd"
Jul 15 12:57:39.953788 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:39.953707    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-dc94b0/sub-test-model-dc94b0-kserve-7948d9bc87-6rqr2"]
Jul 15 12:57:39.954235 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:39.954084    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0701a840-b816-440c-aa41-767993a2f208" containerName="main"
Jul 15 12:57:39.954235 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:39.954097    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0701a840-b816-440c-aa41-767993a2f208" containerName="main"
Jul 15 12:57:39.954235 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:39.954124    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bda150d-08eb-407f-8a61-3956ceaa620d" containerName="main"
Jul 15 12:57:39.954235 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:39.954129    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bda150d-08eb-407f-8a61-3956ceaa620d" containerName="main"
Jul 15 12:57:39.954235 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:39.954189    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0701a840-b816-440c-aa41-767993a2f208" containerName="main"
Jul 15 12:57:39.954235 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:39.954199    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bda150d-08eb-407f-8a61-3956ceaa620d" containerName="main"
Jul 15 12:57:39.961399 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:39.961363    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-dc94b0/sub-test-model-dc94b0-kserve-7948d9bc87-6rqr2"
Jul 15 12:57:39.964412 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:39.964386    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-dc94b0\"/\"openshift-service-ca.crt\""
Jul 15 12:57:39.964412 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:39.964410    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-dc94b0\"/\"default-dockercfg-m7k98\""
Jul 15 12:57:39.964412 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:39.964386    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-dc94b0\"/\"kube-root-ca.crt\""
Jul 15 12:57:39.965520 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:39.965485    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-dc94b0/sub-test-model-dc94b0-kserve-7948d9bc87-6rqr2"]
Jul 15 12:57:39.965655 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:39.965627    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-dc94b0\"/\"sub-test-model-dc94b0-kserve-self-signed-certs\""
Jul 15 12:57:40.062892 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:40.062854    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57456427-75f3-4122-a11b-a3137e7b1bcf-home\") pod \"sub-test-model-dc94b0-kserve-7948d9bc87-6rqr2\" (UID: \"57456427-75f3-4122-a11b-a3137e7b1bcf\") " pod="ai-tenant-e2e-shared-b-dc94b0/sub-test-model-dc94b0-kserve-7948d9bc87-6rqr2"
Jul 15 12:57:40.063068 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:40.062903    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57456427-75f3-4122-a11b-a3137e7b1bcf-model-cache\") pod \"sub-test-model-dc94b0-kserve-7948d9bc87-6rqr2\" (UID: \"57456427-75f3-4122-a11b-a3137e7b1bcf\") " pod="ai-tenant-e2e-shared-b-dc94b0/sub-test-model-dc94b0-kserve-7948d9bc87-6rqr2"
Jul 15 12:57:40.063068 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:40.063016    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57456427-75f3-4122-a11b-a3137e7b1bcf-dshm\") pod \"sub-test-model-dc94b0-kserve-7948d9bc87-6rqr2\" (UID: \"57456427-75f3-4122-a11b-a3137e7b1bcf\") " pod="ai-tenant-e2e-shared-b-dc94b0/sub-test-model-dc94b0-kserve-7948d9bc87-6rqr2"
Jul 15 12:57:40.063068 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:40.063063    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57456427-75f3-4122-a11b-a3137e7b1bcf-tmp-dir\") pod \"sub-test-model-dc94b0-kserve-7948d9bc87-6rqr2\" (UID: \"57456427-75f3-4122-a11b-a3137e7b1bcf\") " pod="ai-tenant-e2e-shared-b-dc94b0/sub-test-model-dc94b0-kserve-7948d9bc87-6rqr2"
Jul 15 12:57:40.063193 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:40.063112    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57456427-75f3-4122-a11b-a3137e7b1bcf-tls-certs\") pod \"sub-test-model-dc94b0-kserve-7948d9bc87-6rqr2\" (UID: \"57456427-75f3-4122-a11b-a3137e7b1bcf\") " pod="ai-tenant-e2e-shared-b-dc94b0/sub-test-model-dc94b0-kserve-7948d9bc87-6rqr2"
Jul 15 12:57:40.063193 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:40.063132    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42lvk\" (UniqueName: \"kubernetes.io/projected/57456427-75f3-4122-a11b-a3137e7b1bcf-kube-api-access-42lvk\") pod \"sub-test-model-dc94b0-kserve-7948d9bc87-6rqr2\" (UID: \"57456427-75f3-4122-a11b-a3137e7b1bcf\") " pod="ai-tenant-e2e-shared-b-dc94b0/sub-test-model-dc94b0-kserve-7948d9bc87-6rqr2"
Jul 15 12:57:40.163653 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:40.163628    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57456427-75f3-4122-a11b-a3137e7b1bcf-model-cache\") pod \"sub-test-model-dc94b0-kserve-7948d9bc87-6rqr2\" (UID: \"57456427-75f3-4122-a11b-a3137e7b1bcf\") " pod="ai-tenant-e2e-shared-b-dc94b0/sub-test-model-dc94b0-kserve-7948d9bc87-6rqr2"
Jul 15 12:57:40.163817 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:40.163685    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57456427-75f3-4122-a11b-a3137e7b1bcf-dshm\") pod \"sub-test-model-dc94b0-kserve-7948d9bc87-6rqr2\" (UID: \"57456427-75f3-4122-a11b-a3137e7b1bcf\") " pod="ai-tenant-e2e-shared-b-dc94b0/sub-test-model-dc94b0-kserve-7948d9bc87-6rqr2"
Jul 15 12:57:40.163817 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:40.163713    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57456427-75f3-4122-a11b-a3137e7b1bcf-tmp-dir\") pod \"sub-test-model-dc94b0-kserve-7948d9bc87-6rqr2\" (UID: \"57456427-75f3-4122-a11b-a3137e7b1bcf\") " pod="ai-tenant-e2e-shared-b-dc94b0/sub-test-model-dc94b0-kserve-7948d9bc87-6rqr2"
Jul 15 12:57:40.163817 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:40.163744    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57456427-75f3-4122-a11b-a3137e7b1bcf-tls-certs\") pod \"sub-test-model-dc94b0-kserve-7948d9bc87-6rqr2\" (UID: \"57456427-75f3-4122-a11b-a3137e7b1bcf\") " pod="ai-tenant-e2e-shared-b-dc94b0/sub-test-model-dc94b0-kserve-7948d9bc87-6rqr2"
Jul 15 12:57:40.163817 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:40.163765    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42lvk\" (UniqueName: \"kubernetes.io/projected/57456427-75f3-4122-a11b-a3137e7b1bcf-kube-api-access-42lvk\") pod \"sub-test-model-dc94b0-kserve-7948d9bc87-6rqr2\" (UID: \"57456427-75f3-4122-a11b-a3137e7b1bcf\") " pod="ai-tenant-e2e-shared-b-dc94b0/sub-test-model-dc94b0-kserve-7948d9bc87-6rqr2"
Jul 15 12:57:40.163957 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:40.163826    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57456427-75f3-4122-a11b-a3137e7b1bcf-home\") pod \"sub-test-model-dc94b0-kserve-7948d9bc87-6rqr2\" (UID: \"57456427-75f3-4122-a11b-a3137e7b1bcf\") " pod="ai-tenant-e2e-shared-b-dc94b0/sub-test-model-dc94b0-kserve-7948d9bc87-6rqr2"
Jul 15 12:57:40.164094 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:40.164071    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57456427-75f3-4122-a11b-a3137e7b1bcf-model-cache\") pod \"sub-test-model-dc94b0-kserve-7948d9bc87-6rqr2\" (UID: \"57456427-75f3-4122-a11b-a3137e7b1bcf\") " pod="ai-tenant-e2e-shared-b-dc94b0/sub-test-model-dc94b0-kserve-7948d9bc87-6rqr2"
Jul 15 12:57:40.164141 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:40.164107    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57456427-75f3-4122-a11b-a3137e7b1bcf-tmp-dir\") pod \"sub-test-model-dc94b0-kserve-7948d9bc87-6rqr2\" (UID: \"57456427-75f3-4122-a11b-a3137e7b1bcf\") " pod="ai-tenant-e2e-shared-b-dc94b0/sub-test-model-dc94b0-kserve-7948d9bc87-6rqr2"
Jul 15 12:57:40.164209 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:40.164148    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57456427-75f3-4122-a11b-a3137e7b1bcf-home\") pod \"sub-test-model-dc94b0-kserve-7948d9bc87-6rqr2\" (UID: \"57456427-75f3-4122-a11b-a3137e7b1bcf\") " pod="ai-tenant-e2e-shared-b-dc94b0/sub-test-model-dc94b0-kserve-7948d9bc87-6rqr2"
Jul 15 12:57:40.165977 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:40.165955    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57456427-75f3-4122-a11b-a3137e7b1bcf-dshm\") pod \"sub-test-model-dc94b0-kserve-7948d9bc87-6rqr2\" (UID: \"57456427-75f3-4122-a11b-a3137e7b1bcf\") " pod="ai-tenant-e2e-shared-b-dc94b0/sub-test-model-dc94b0-kserve-7948d9bc87-6rqr2"
Jul 15 12:57:40.166151 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:40.166131    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57456427-75f3-4122-a11b-a3137e7b1bcf-tls-certs\") pod \"sub-test-model-dc94b0-kserve-7948d9bc87-6rqr2\" (UID: \"57456427-75f3-4122-a11b-a3137e7b1bcf\") " pod="ai-tenant-e2e-shared-b-dc94b0/sub-test-model-dc94b0-kserve-7948d9bc87-6rqr2"
Jul 15 12:57:40.172221 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:40.172199    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42lvk\" (UniqueName: \"kubernetes.io/projected/57456427-75f3-4122-a11b-a3137e7b1bcf-kube-api-access-42lvk\") pod \"sub-test-model-dc94b0-kserve-7948d9bc87-6rqr2\" (UID: \"57456427-75f3-4122-a11b-a3137e7b1bcf\") " pod="ai-tenant-e2e-shared-b-dc94b0/sub-test-model-dc94b0-kserve-7948d9bc87-6rqr2"
Jul 15 12:57:40.272648 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:40.272566    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-dc94b0/sub-test-model-dc94b0-kserve-7948d9bc87-6rqr2"
Jul 15 12:57:40.403690 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:40.403668    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-dc94b0/sub-test-model-dc94b0-kserve-7948d9bc87-6rqr2"]
Jul 15 12:57:40.405813 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:57:40.405785    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod57456427_75f3_4122_a11b_a3137e7b1bcf.slice/crio-add8dc7728ef1bc2677f5de289b4d421ca68a05616f86b5966275d6f1436a9b2 WatchSource:0}: Error finding container add8dc7728ef1bc2677f5de289b4d421ca68a05616f86b5966275d6f1436a9b2: Status 404 returned error can't find the container with id add8dc7728ef1bc2677f5de289b4d421ca68a05616f86b5966275d6f1436a9b2
Jul 15 12:57:41.109670 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:41.109640    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-dc94b0/sub-test-model-dc94b0-kserve-7948d9bc87-6rqr2" event={"ID":"57456427-75f3-4122-a11b-a3137e7b1bcf","Type":"ContainerStarted","Data":"ae01436075ba60c28aef7efac77e87974059259bae98e77cd389d7e6680474f5"}
Jul 15 12:57:41.109670 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:41.109680    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-dc94b0/sub-test-model-dc94b0-kserve-7948d9bc87-6rqr2" event={"ID":"57456427-75f3-4122-a11b-a3137e7b1bcf","Type":"ContainerStarted","Data":"add8dc7728ef1bc2677f5de289b4d421ca68a05616f86b5966275d6f1436a9b2"}
Jul 15 12:57:41.128759 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:41.128708    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-dc94b0/sub-test-model-dc94b0-kserve-7948d9bc87-6rqr2" podStartSLOduration=2.128693266 podStartE2EDuration="2.128693266s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:57:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:57:41.125883982 +0000 UTC m=+2808.240277724" watchObservedRunningTime="2026-07-15 12:57:41.128693266 +0000 UTC m=+2808.243086998"
Jul 15 12:57:50.272907 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:50.272875    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-dc94b0/sub-test-model-dc94b0-kserve-7948d9bc87-6rqr2"
Jul 15 12:57:50.273470 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:50.272946    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-dc94b0/sub-test-model-dc94b0-kserve-7948d9bc87-6rqr2"
Jul 15 12:57:50.285453 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:50.285427    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-dc94b0/sub-test-model-dc94b0-kserve-7948d9bc87-6rqr2"
Jul 15 12:57:51.174602 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:57:51.174573    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-dc94b0/sub-test-model-dc94b0-kserve-7948d9bc87-6rqr2"
Jul 15 12:58:33.437108 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:33.437073    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-e6c75d/sub-test-model-e6c75d-kserve-84dc6fc47-hpwfd"]
Jul 15 12:58:34.237794 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:34.237754    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-dc94b0/sub-test-model-dc94b0-kserve-7948d9bc87-6rqr2"]
Jul 15 12:58:48.457992 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:48.457885    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-e6c75d/sub-test-model-e6c75d-kserve-84dc6fc47-hpwfd" podUID="faf7b8ba-d528-492d-888d-b84027e4d68f" containerName="main" containerID="cri-o://289cdda493ebf11c3b77c13a746c09c26b6f295916c672eb6855a857b360c753" gracePeriod=45
Jul 15 12:58:48.707021 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:48.706997    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e6c75d/sub-test-model-e6c75d-kserve-84dc6fc47-hpwfd"
Jul 15 12:58:48.880553 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:48.880472    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8f7zw\" (UniqueName: \"kubernetes.io/projected/faf7b8ba-d528-492d-888d-b84027e4d68f-kube-api-access-8f7zw\") pod \"faf7b8ba-d528-492d-888d-b84027e4d68f\" (UID: \"faf7b8ba-d528-492d-888d-b84027e4d68f\") "
Jul 15 12:58:48.880553 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:48.880525    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/faf7b8ba-d528-492d-888d-b84027e4d68f-model-cache\") pod \"faf7b8ba-d528-492d-888d-b84027e4d68f\" (UID: \"faf7b8ba-d528-492d-888d-b84027e4d68f\") "
Jul 15 12:58:48.880777 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:48.880608    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/faf7b8ba-d528-492d-888d-b84027e4d68f-dshm\") pod \"faf7b8ba-d528-492d-888d-b84027e4d68f\" (UID: \"faf7b8ba-d528-492d-888d-b84027e4d68f\") "
Jul 15 12:58:48.880777 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:48.880636    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/faf7b8ba-d528-492d-888d-b84027e4d68f-home\") pod \"faf7b8ba-d528-492d-888d-b84027e4d68f\" (UID: \"faf7b8ba-d528-492d-888d-b84027e4d68f\") "
Jul 15 12:58:48.880777 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:48.880695    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/faf7b8ba-d528-492d-888d-b84027e4d68f-tls-certs\") pod \"faf7b8ba-d528-492d-888d-b84027e4d68f\" (UID: \"faf7b8ba-d528-492d-888d-b84027e4d68f\") "
Jul 15 12:58:48.880777 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:48.880717    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/faf7b8ba-d528-492d-888d-b84027e4d68f-tmp-dir\") pod \"faf7b8ba-d528-492d-888d-b84027e4d68f\" (UID: \"faf7b8ba-d528-492d-888d-b84027e4d68f\") "
Jul 15 12:58:48.880995 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:48.880823    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/faf7b8ba-d528-492d-888d-b84027e4d68f-model-cache" (OuterVolumeSpecName: "model-cache") pod "faf7b8ba-d528-492d-888d-b84027e4d68f" (UID: "faf7b8ba-d528-492d-888d-b84027e4d68f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:58:48.880995 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:48.880871    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/faf7b8ba-d528-492d-888d-b84027e4d68f-home" (OuterVolumeSpecName: "home") pod "faf7b8ba-d528-492d-888d-b84027e4d68f" (UID: "faf7b8ba-d528-492d-888d-b84027e4d68f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:58:48.881112 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:48.881025    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/faf7b8ba-d528-492d-888d-b84027e4d68f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "faf7b8ba-d528-492d-888d-b84027e4d68f" (UID: "faf7b8ba-d528-492d-888d-b84027e4d68f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:58:48.881112 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:48.881085    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/faf7b8ba-d528-492d-888d-b84027e4d68f-home\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:58:48.881112 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:48.881103    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/faf7b8ba-d528-492d-888d-b84027e4d68f-model-cache\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:58:48.882662 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:48.882628    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/faf7b8ba-d528-492d-888d-b84027e4d68f-dshm" (OuterVolumeSpecName: "dshm") pod "faf7b8ba-d528-492d-888d-b84027e4d68f" (UID: "faf7b8ba-d528-492d-888d-b84027e4d68f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:58:48.882778 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:48.882698    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/faf7b8ba-d528-492d-888d-b84027e4d68f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "faf7b8ba-d528-492d-888d-b84027e4d68f" (UID: "faf7b8ba-d528-492d-888d-b84027e4d68f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:58:48.882778 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:48.882727    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/faf7b8ba-d528-492d-888d-b84027e4d68f-kube-api-access-8f7zw" (OuterVolumeSpecName: "kube-api-access-8f7zw") pod "faf7b8ba-d528-492d-888d-b84027e4d68f" (UID: "faf7b8ba-d528-492d-888d-b84027e4d68f"). InnerVolumeSpecName "kube-api-access-8f7zw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:58:48.982638 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:48.982605    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/faf7b8ba-d528-492d-888d-b84027e4d68f-tls-certs\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:58:48.982638 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:48.982634    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/faf7b8ba-d528-492d-888d-b84027e4d68f-tmp-dir\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:58:48.982638 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:48.982644    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8f7zw\" (UniqueName: \"kubernetes.io/projected/faf7b8ba-d528-492d-888d-b84027e4d68f-kube-api-access-8f7zw\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:58:48.982867 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:48.982652    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/faf7b8ba-d528-492d-888d-b84027e4d68f-dshm\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:58:49.261429 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:49.261392    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-dc94b0/sub-test-model-dc94b0-kserve-7948d9bc87-6rqr2" podUID="57456427-75f3-4122-a11b-a3137e7b1bcf" containerName="main" containerID="cri-o://ae01436075ba60c28aef7efac77e87974059259bae98e77cd389d7e6680474f5" gracePeriod=45
Jul 15 12:58:49.448435 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:49.448398    2560 generic.go:356] "Generic (PLEG): container finished" podID="faf7b8ba-d528-492d-888d-b84027e4d68f" containerID="289cdda493ebf11c3b77c13a746c09c26b6f295916c672eb6855a857b360c753" exitCode=0
Jul 15 12:58:49.448600 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:49.448444    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e6c75d/sub-test-model-e6c75d-kserve-84dc6fc47-hpwfd"
Jul 15 12:58:49.448600 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:49.448460    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e6c75d/sub-test-model-e6c75d-kserve-84dc6fc47-hpwfd" event={"ID":"faf7b8ba-d528-492d-888d-b84027e4d68f","Type":"ContainerDied","Data":"289cdda493ebf11c3b77c13a746c09c26b6f295916c672eb6855a857b360c753"}
Jul 15 12:58:49.448600 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:49.448509    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e6c75d/sub-test-model-e6c75d-kserve-84dc6fc47-hpwfd" event={"ID":"faf7b8ba-d528-492d-888d-b84027e4d68f","Type":"ContainerDied","Data":"148383889cdc35dc16baea15b2bbba868a8f3da243fee8a8c9ba4f525492fb30"}
Jul 15 12:58:49.448600 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:49.448531    2560 scope.go:117] "RemoveContainer" containerID="289cdda493ebf11c3b77c13a746c09c26b6f295916c672eb6855a857b360c753"
Jul 15 12:58:49.451139 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:49.451107    2560 generic.go:356] "Generic (PLEG): container finished" podID="57456427-75f3-4122-a11b-a3137e7b1bcf" containerID="ae01436075ba60c28aef7efac77e87974059259bae98e77cd389d7e6680474f5" exitCode=0
Jul 15 12:58:49.451261 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:49.451178    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-dc94b0/sub-test-model-dc94b0-kserve-7948d9bc87-6rqr2" event={"ID":"57456427-75f3-4122-a11b-a3137e7b1bcf","Type":"ContainerDied","Data":"ae01436075ba60c28aef7efac77e87974059259bae98e77cd389d7e6680474f5"}
Jul 15 12:58:49.459599 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:49.459410    2560 scope.go:117] "RemoveContainer" containerID="289cdda493ebf11c3b77c13a746c09c26b6f295916c672eb6855a857b360c753"
Jul 15 12:58:49.459875 ip-10-0-133-186 kubenswrapper[2560]: E0715 12:58:49.459737    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"289cdda493ebf11c3b77c13a746c09c26b6f295916c672eb6855a857b360c753\": container with ID starting with 289cdda493ebf11c3b77c13a746c09c26b6f295916c672eb6855a857b360c753 not found: ID does not exist" containerID="289cdda493ebf11c3b77c13a746c09c26b6f295916c672eb6855a857b360c753"
Jul 15 12:58:49.459875 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:49.459776    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"289cdda493ebf11c3b77c13a746c09c26b6f295916c672eb6855a857b360c753"} err="failed to get container status \"289cdda493ebf11c3b77c13a746c09c26b6f295916c672eb6855a857b360c753\": rpc error: code = NotFound desc = could not find container \"289cdda493ebf11c3b77c13a746c09c26b6f295916c672eb6855a857b360c753\": container with ID starting with 289cdda493ebf11c3b77c13a746c09c26b6f295916c672eb6855a857b360c753 not found: ID does not exist"
Jul 15 12:58:49.473986 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:49.473962    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-e6c75d/sub-test-model-e6c75d-kserve-84dc6fc47-hpwfd"]
Jul 15 12:58:49.478345 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:49.478323    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-e6c75d/sub-test-model-e6c75d-kserve-84dc6fc47-hpwfd"]
Jul 15 12:58:49.511362 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:49.511334    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-dc94b0/sub-test-model-dc94b0-kserve-7948d9bc87-6rqr2"
Jul 15 12:58:49.688628 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:49.688539    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57456427-75f3-4122-a11b-a3137e7b1bcf-model-cache\") pod \"57456427-75f3-4122-a11b-a3137e7b1bcf\" (UID: \"57456427-75f3-4122-a11b-a3137e7b1bcf\") "
Jul 15 12:58:49.688628 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:49.688593    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57456427-75f3-4122-a11b-a3137e7b1bcf-dshm\") pod \"57456427-75f3-4122-a11b-a3137e7b1bcf\" (UID: \"57456427-75f3-4122-a11b-a3137e7b1bcf\") "
Jul 15 12:58:49.688628 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:49.688613    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57456427-75f3-4122-a11b-a3137e7b1bcf-tls-certs\") pod \"57456427-75f3-4122-a11b-a3137e7b1bcf\" (UID: \"57456427-75f3-4122-a11b-a3137e7b1bcf\") "
Jul 15 12:58:49.688916 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:49.688632    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57456427-75f3-4122-a11b-a3137e7b1bcf-home\") pod \"57456427-75f3-4122-a11b-a3137e7b1bcf\" (UID: \"57456427-75f3-4122-a11b-a3137e7b1bcf\") "
Jul 15 12:58:49.688916 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:49.688693    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57456427-75f3-4122-a11b-a3137e7b1bcf-tmp-dir\") pod \"57456427-75f3-4122-a11b-a3137e7b1bcf\" (UID: \"57456427-75f3-4122-a11b-a3137e7b1bcf\") "
Jul 15 12:58:49.688916 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:49.688721    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42lvk\" (UniqueName: \"kubernetes.io/projected/57456427-75f3-4122-a11b-a3137e7b1bcf-kube-api-access-42lvk\") pod \"57456427-75f3-4122-a11b-a3137e7b1bcf\" (UID: \"57456427-75f3-4122-a11b-a3137e7b1bcf\") "
Jul 15 12:58:49.688916 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:49.688890    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57456427-75f3-4122-a11b-a3137e7b1bcf-model-cache" (OuterVolumeSpecName: "model-cache") pod "57456427-75f3-4122-a11b-a3137e7b1bcf" (UID: "57456427-75f3-4122-a11b-a3137e7b1bcf"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:58:49.689076 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:49.688925    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57456427-75f3-4122-a11b-a3137e7b1bcf-home" (OuterVolumeSpecName: "home") pod "57456427-75f3-4122-a11b-a3137e7b1bcf" (UID: "57456427-75f3-4122-a11b-a3137e7b1bcf"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:58:49.689076 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:49.688941    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57456427-75f3-4122-a11b-a3137e7b1bcf-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "57456427-75f3-4122-a11b-a3137e7b1bcf" (UID: "57456427-75f3-4122-a11b-a3137e7b1bcf"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:58:49.690661 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:49.690643    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57456427-75f3-4122-a11b-a3137e7b1bcf-dshm" (OuterVolumeSpecName: "dshm") pod "57456427-75f3-4122-a11b-a3137e7b1bcf" (UID: "57456427-75f3-4122-a11b-a3137e7b1bcf"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:58:49.690768 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:49.690753    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57456427-75f3-4122-a11b-a3137e7b1bcf-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "57456427-75f3-4122-a11b-a3137e7b1bcf" (UID: "57456427-75f3-4122-a11b-a3137e7b1bcf"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:58:49.690844 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:49.690822    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57456427-75f3-4122-a11b-a3137e7b1bcf-kube-api-access-42lvk" (OuterVolumeSpecName: "kube-api-access-42lvk") pod "57456427-75f3-4122-a11b-a3137e7b1bcf" (UID: "57456427-75f3-4122-a11b-a3137e7b1bcf"). InnerVolumeSpecName "kube-api-access-42lvk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:58:49.789441 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:49.789399    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57456427-75f3-4122-a11b-a3137e7b1bcf-home\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:58:49.789602 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:49.789461    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57456427-75f3-4122-a11b-a3137e7b1bcf-tmp-dir\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:58:49.789602 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:49.789477    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42lvk\" (UniqueName: \"kubernetes.io/projected/57456427-75f3-4122-a11b-a3137e7b1bcf-kube-api-access-42lvk\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:58:49.789602 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:49.789490    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57456427-75f3-4122-a11b-a3137e7b1bcf-model-cache\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:58:49.789602 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:49.789501    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57456427-75f3-4122-a11b-a3137e7b1bcf-dshm\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:58:49.789602 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:49.789511    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57456427-75f3-4122-a11b-a3137e7b1bcf-tls-certs\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 12:58:50.458562 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:50.458534    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-dc94b0/sub-test-model-dc94b0-kserve-7948d9bc87-6rqr2"
Jul 15 12:58:50.458737 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:50.458565    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-dc94b0/sub-test-model-dc94b0-kserve-7948d9bc87-6rqr2" event={"ID":"57456427-75f3-4122-a11b-a3137e7b1bcf","Type":"ContainerDied","Data":"add8dc7728ef1bc2677f5de289b4d421ca68a05616f86b5966275d6f1436a9b2"}
Jul 15 12:58:50.458737 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:50.458606    2560 scope.go:117] "RemoveContainer" containerID="ae01436075ba60c28aef7efac77e87974059259bae98e77cd389d7e6680474f5"
Jul 15 12:58:50.479324 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:50.479280    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-dc94b0/sub-test-model-dc94b0-kserve-7948d9bc87-6rqr2"]
Jul 15 12:58:50.483277 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:50.483256    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-dc94b0/sub-test-model-dc94b0-kserve-7948d9bc87-6rqr2"]
Jul 15 12:58:51.446051 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:51.446015    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57456427-75f3-4122-a11b-a3137e7b1bcf" path="/var/lib/kubelet/pods/57456427-75f3-4122-a11b-a3137e7b1bcf/volumes"
Jul 15 12:58:51.446567 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:51.446549    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="faf7b8ba-d528-492d-888d-b84027e4d68f" path="/var/lib/kubelet/pods/faf7b8ba-d528-492d-888d-b84027e4d68f/volumes"
Jul 15 12:58:51.957828 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:51.957790    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-e6c75d/rate-test-model-e6c75d-kserve-5dfd468947-wp7gp"]
Jul 15 12:58:51.958352 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:51.958334    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57456427-75f3-4122-a11b-a3137e7b1bcf" containerName="main"
Jul 15 12:58:51.958447 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:51.958355    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="57456427-75f3-4122-a11b-a3137e7b1bcf" containerName="main"
Jul 15 12:58:51.958447 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:51.958371    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="faf7b8ba-d528-492d-888d-b84027e4d68f" containerName="main"
Jul 15 12:58:51.958447 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:51.958381    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="faf7b8ba-d528-492d-888d-b84027e4d68f" containerName="main"
Jul 15 12:58:51.958608 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:51.958508    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="57456427-75f3-4122-a11b-a3137e7b1bcf" containerName="main"
Jul 15 12:58:51.958608 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:51.958521    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="faf7b8ba-d528-492d-888d-b84027e4d68f" containerName="main"
Jul 15 12:58:51.962967 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:51.962945    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e6c75d/rate-test-model-e6c75d-kserve-5dfd468947-wp7gp"
Jul 15 12:58:51.965657 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:51.965639    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-e6c75d\"/\"kube-root-ca.crt\""
Jul 15 12:58:51.967060 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:51.967035    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-e6c75d\"/\"default-dockercfg-qjbqq\""
Jul 15 12:58:51.967208 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:51.967173    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-e6c75d\"/\"openshift-service-ca.crt\""
Jul 15 12:58:51.967801 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:51.967241    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-e6c75d\"/\"rate-test-model-e6c75d-kserve-self-signed-certs\""
Jul 15 12:58:51.969979 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:51.969946    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-e6c75d/rate-test-model-e6c75d-kserve-5dfd468947-wp7gp"]
Jul 15 12:58:52.112621 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:52.112582    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08dfd676-5f8c-4740-9066-bae189524cf1-dshm\") pod \"rate-test-model-e6c75d-kserve-5dfd468947-wp7gp\" (UID: \"08dfd676-5f8c-4740-9066-bae189524cf1\") " pod="ai-tenant-e2e-shared-a-e6c75d/rate-test-model-e6c75d-kserve-5dfd468947-wp7gp"
Jul 15 12:58:52.112821 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:52.112668    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08dfd676-5f8c-4740-9066-bae189524cf1-home\") pod \"rate-test-model-e6c75d-kserve-5dfd468947-wp7gp\" (UID: \"08dfd676-5f8c-4740-9066-bae189524cf1\") " pod="ai-tenant-e2e-shared-a-e6c75d/rate-test-model-e6c75d-kserve-5dfd468947-wp7gp"
Jul 15 12:58:52.112821 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:52.112728    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08dfd676-5f8c-4740-9066-bae189524cf1-tmp-dir\") pod \"rate-test-model-e6c75d-kserve-5dfd468947-wp7gp\" (UID: \"08dfd676-5f8c-4740-9066-bae189524cf1\") " pod="ai-tenant-e2e-shared-a-e6c75d/rate-test-model-e6c75d-kserve-5dfd468947-wp7gp"
Jul 15 12:58:52.112821 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:52.112776    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08dfd676-5f8c-4740-9066-bae189524cf1-model-cache\") pod \"rate-test-model-e6c75d-kserve-5dfd468947-wp7gp\" (UID: \"08dfd676-5f8c-4740-9066-bae189524cf1\") " pod="ai-tenant-e2e-shared-a-e6c75d/rate-test-model-e6c75d-kserve-5dfd468947-wp7gp"
Jul 15 12:58:52.112963 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:52.112820    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08dfd676-5f8c-4740-9066-bae189524cf1-tls-certs\") pod \"rate-test-model-e6c75d-kserve-5dfd468947-wp7gp\" (UID: \"08dfd676-5f8c-4740-9066-bae189524cf1\") " pod="ai-tenant-e2e-shared-a-e6c75d/rate-test-model-e6c75d-kserve-5dfd468947-wp7gp"
Jul 15 12:58:52.112963 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:52.112855    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hggs\" (UniqueName: \"kubernetes.io/projected/08dfd676-5f8c-4740-9066-bae189524cf1-kube-api-access-2hggs\") pod \"rate-test-model-e6c75d-kserve-5dfd468947-wp7gp\" (UID: \"08dfd676-5f8c-4740-9066-bae189524cf1\") " pod="ai-tenant-e2e-shared-a-e6c75d/rate-test-model-e6c75d-kserve-5dfd468947-wp7gp"
Jul 15 12:58:52.213593 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:52.213515    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08dfd676-5f8c-4740-9066-bae189524cf1-tmp-dir\") pod \"rate-test-model-e6c75d-kserve-5dfd468947-wp7gp\" (UID: \"08dfd676-5f8c-4740-9066-bae189524cf1\") " pod="ai-tenant-e2e-shared-a-e6c75d/rate-test-model-e6c75d-kserve-5dfd468947-wp7gp"
Jul 15 12:58:52.213593 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:52.213559    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08dfd676-5f8c-4740-9066-bae189524cf1-model-cache\") pod \"rate-test-model-e6c75d-kserve-5dfd468947-wp7gp\" (UID: \"08dfd676-5f8c-4740-9066-bae189524cf1\") " pod="ai-tenant-e2e-shared-a-e6c75d/rate-test-model-e6c75d-kserve-5dfd468947-wp7gp"
Jul 15 12:58:52.213593 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:52.213582    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08dfd676-5f8c-4740-9066-bae189524cf1-tls-certs\") pod \"rate-test-model-e6c75d-kserve-5dfd468947-wp7gp\" (UID: \"08dfd676-5f8c-4740-9066-bae189524cf1\") " pod="ai-tenant-e2e-shared-a-e6c75d/rate-test-model-e6c75d-kserve-5dfd468947-wp7gp"
Jul 15 12:58:52.213888 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:52.213606    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hggs\" (UniqueName: \"kubernetes.io/projected/08dfd676-5f8c-4740-9066-bae189524cf1-kube-api-access-2hggs\") pod \"rate-test-model-e6c75d-kserve-5dfd468947-wp7gp\" (UID: \"08dfd676-5f8c-4740-9066-bae189524cf1\") " pod="ai-tenant-e2e-shared-a-e6c75d/rate-test-model-e6c75d-kserve-5dfd468947-wp7gp"
Jul 15 12:58:52.213888 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:52.213653    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08dfd676-5f8c-4740-9066-bae189524cf1-dshm\") pod \"rate-test-model-e6c75d-kserve-5dfd468947-wp7gp\" (UID: \"08dfd676-5f8c-4740-9066-bae189524cf1\") " pod="ai-tenant-e2e-shared-a-e6c75d/rate-test-model-e6c75d-kserve-5dfd468947-wp7gp"
Jul 15 12:58:52.213888 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:52.213722    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08dfd676-5f8c-4740-9066-bae189524cf1-home\") pod \"rate-test-model-e6c75d-kserve-5dfd468947-wp7gp\" (UID: \"08dfd676-5f8c-4740-9066-bae189524cf1\") " pod="ai-tenant-e2e-shared-a-e6c75d/rate-test-model-e6c75d-kserve-5dfd468947-wp7gp"
Jul 15 12:58:52.214048 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:52.213951    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08dfd676-5f8c-4740-9066-bae189524cf1-tmp-dir\") pod \"rate-test-model-e6c75d-kserve-5dfd468947-wp7gp\" (UID: \"08dfd676-5f8c-4740-9066-bae189524cf1\") " pod="ai-tenant-e2e-shared-a-e6c75d/rate-test-model-e6c75d-kserve-5dfd468947-wp7gp"
Jul 15 12:58:52.214048 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:52.214001    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08dfd676-5f8c-4740-9066-bae189524cf1-model-cache\") pod \"rate-test-model-e6c75d-kserve-5dfd468947-wp7gp\" (UID: \"08dfd676-5f8c-4740-9066-bae189524cf1\") " pod="ai-tenant-e2e-shared-a-e6c75d/rate-test-model-e6c75d-kserve-5dfd468947-wp7gp"
Jul 15 12:58:52.214048 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:52.214018    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08dfd676-5f8c-4740-9066-bae189524cf1-home\") pod \"rate-test-model-e6c75d-kserve-5dfd468947-wp7gp\" (UID: \"08dfd676-5f8c-4740-9066-bae189524cf1\") " pod="ai-tenant-e2e-shared-a-e6c75d/rate-test-model-e6c75d-kserve-5dfd468947-wp7gp"
Jul 15 12:58:52.215851 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:52.215831    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08dfd676-5f8c-4740-9066-bae189524cf1-dshm\") pod \"rate-test-model-e6c75d-kserve-5dfd468947-wp7gp\" (UID: \"08dfd676-5f8c-4740-9066-bae189524cf1\") " pod="ai-tenant-e2e-shared-a-e6c75d/rate-test-model-e6c75d-kserve-5dfd468947-wp7gp"
Jul 15 12:58:52.216124 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:52.216105    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08dfd676-5f8c-4740-9066-bae189524cf1-tls-certs\") pod \"rate-test-model-e6c75d-kserve-5dfd468947-wp7gp\" (UID: \"08dfd676-5f8c-4740-9066-bae189524cf1\") " pod="ai-tenant-e2e-shared-a-e6c75d/rate-test-model-e6c75d-kserve-5dfd468947-wp7gp"
Jul 15 12:58:52.222067 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:52.222039    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hggs\" (UniqueName: \"kubernetes.io/projected/08dfd676-5f8c-4740-9066-bae189524cf1-kube-api-access-2hggs\") pod \"rate-test-model-e6c75d-kserve-5dfd468947-wp7gp\" (UID: \"08dfd676-5f8c-4740-9066-bae189524cf1\") " pod="ai-tenant-e2e-shared-a-e6c75d/rate-test-model-e6c75d-kserve-5dfd468947-wp7gp"
Jul 15 12:58:52.274059 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:52.274026    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e6c75d/rate-test-model-e6c75d-kserve-5dfd468947-wp7gp"
Jul 15 12:58:52.403836 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:52.403814    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-e6c75d/rate-test-model-e6c75d-kserve-5dfd468947-wp7gp"]
Jul 15 12:58:52.405854 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:58:52.405826    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod08dfd676_5f8c_4740_9066_bae189524cf1.slice/crio-cf7de10697454241ba3f6d3b7b657f07d682c5526a5e95835301a45f4e55276f WatchSource:0}: Error finding container cf7de10697454241ba3f6d3b7b657f07d682c5526a5e95835301a45f4e55276f: Status 404 returned error can't find the container with id cf7de10697454241ba3f6d3b7b657f07d682c5526a5e95835301a45f4e55276f
Jul 15 12:58:52.478072 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:52.477978    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e6c75d/rate-test-model-e6c75d-kserve-5dfd468947-wp7gp" event={"ID":"08dfd676-5f8c-4740-9066-bae189524cf1","Type":"ContainerStarted","Data":"04b10c4d4df04ac26d051b232a9006dd4ed2bde3b5f91f86d7ea01d506088a56"}
Jul 15 12:58:52.478072 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:52.478031    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e6c75d/rate-test-model-e6c75d-kserve-5dfd468947-wp7gp" event={"ID":"08dfd676-5f8c-4740-9066-bae189524cf1","Type":"ContainerStarted","Data":"cf7de10697454241ba3f6d3b7b657f07d682c5526a5e95835301a45f4e55276f"}
Jul 15 12:58:52.497732 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:58:52.497685    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-e6c75d/rate-test-model-e6c75d-kserve-5dfd468947-wp7gp" podStartSLOduration=1.497668951 podStartE2EDuration="1.497668951s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:58:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:58:52.4958339 +0000 UTC m=+2879.610227650" watchObservedRunningTime="2026-07-15 12:58:52.497668951 +0000 UTC m=+2879.612062686"
Jul 15 12:59:02.275167 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:59:02.275121    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-e6c75d/rate-test-model-e6c75d-kserve-5dfd468947-wp7gp"
Jul 15 12:59:02.275685 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:59:02.275278    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-e6c75d/rate-test-model-e6c75d-kserve-5dfd468947-wp7gp"
Jul 15 12:59:02.288013 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:59:02.287985    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-e6c75d/rate-test-model-e6c75d-kserve-5dfd468947-wp7gp"
Jul 15 12:59:02.537023 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:59:02.536945    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-e6c75d/rate-test-model-e6c75d-kserve-5dfd468947-wp7gp"
Jul 15 12:59:11.956605 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:59:11.956564    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-dc94b0/rate-test-model-dc94b0-kserve-5c98b779c9-x2kxm"]
Jul 15 12:59:11.960415 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:59:11.960391    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-dc94b0/rate-test-model-dc94b0-kserve-5c98b779c9-x2kxm"
Jul 15 12:59:11.963252 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:59:11.963230    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-dc94b0\"/\"openshift-service-ca.crt\""
Jul 15 12:59:11.964228 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:59:11.964206    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-dc94b0\"/\"kube-root-ca.crt\""
Jul 15 12:59:11.964356 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:59:11.964239    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-dc94b0\"/\"default-dockercfg-m7k98\""
Jul 15 12:59:11.964411 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:59:11.964356    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-dc94b0\"/\"rate-test-model-dc94b0-kserve-self-signed-certs\""
Jul 15 12:59:11.970038 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:59:11.970005    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-dc94b0/rate-test-model-dc94b0-kserve-5c98b779c9-x2kxm"]
Jul 15 12:59:12.089065 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:59:12.089021    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c78e49b-7a06-4a60-b3cf-d338a9267a68-home\") pod \"rate-test-model-dc94b0-kserve-5c98b779c9-x2kxm\" (UID: \"9c78e49b-7a06-4a60-b3cf-d338a9267a68\") " pod="ai-tenant-e2e-shared-b-dc94b0/rate-test-model-dc94b0-kserve-5c98b779c9-x2kxm"
Jul 15 12:59:12.089065 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:59:12.089075    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfrvl\" (UniqueName: \"kubernetes.io/projected/9c78e49b-7a06-4a60-b3cf-d338a9267a68-kube-api-access-bfrvl\") pod \"rate-test-model-dc94b0-kserve-5c98b779c9-x2kxm\" (UID: \"9c78e49b-7a06-4a60-b3cf-d338a9267a68\") " pod="ai-tenant-e2e-shared-b-dc94b0/rate-test-model-dc94b0-kserve-5c98b779c9-x2kxm"
Jul 15 12:59:12.089269 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:59:12.089141    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c78e49b-7a06-4a60-b3cf-d338a9267a68-dshm\") pod \"rate-test-model-dc94b0-kserve-5c98b779c9-x2kxm\" (UID: \"9c78e49b-7a06-4a60-b3cf-d338a9267a68\") " pod="ai-tenant-e2e-shared-b-dc94b0/rate-test-model-dc94b0-kserve-5c98b779c9-x2kxm"
Jul 15 12:59:12.089269 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:59:12.089200    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c78e49b-7a06-4a60-b3cf-d338a9267a68-tls-certs\") pod \"rate-test-model-dc94b0-kserve-5c98b779c9-x2kxm\" (UID: \"9c78e49b-7a06-4a60-b3cf-d338a9267a68\") " pod="ai-tenant-e2e-shared-b-dc94b0/rate-test-model-dc94b0-kserve-5c98b779c9-x2kxm"
Jul 15 12:59:12.089269 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:59:12.089251    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c78e49b-7a06-4a60-b3cf-d338a9267a68-tmp-dir\") pod \"rate-test-model-dc94b0-kserve-5c98b779c9-x2kxm\" (UID: \"9c78e49b-7a06-4a60-b3cf-d338a9267a68\") " pod="ai-tenant-e2e-shared-b-dc94b0/rate-test-model-dc94b0-kserve-5c98b779c9-x2kxm"
Jul 15 12:59:12.089391 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:59:12.089276    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c78e49b-7a06-4a60-b3cf-d338a9267a68-model-cache\") pod \"rate-test-model-dc94b0-kserve-5c98b779c9-x2kxm\" (UID: \"9c78e49b-7a06-4a60-b3cf-d338a9267a68\") " pod="ai-tenant-e2e-shared-b-dc94b0/rate-test-model-dc94b0-kserve-5c98b779c9-x2kxm"
Jul 15 12:59:12.189925 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:59:12.189881    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c78e49b-7a06-4a60-b3cf-d338a9267a68-home\") pod \"rate-test-model-dc94b0-kserve-5c98b779c9-x2kxm\" (UID: \"9c78e49b-7a06-4a60-b3cf-d338a9267a68\") " pod="ai-tenant-e2e-shared-b-dc94b0/rate-test-model-dc94b0-kserve-5c98b779c9-x2kxm"
Jul 15 12:59:12.189925 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:59:12.189936    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfrvl\" (UniqueName: \"kubernetes.io/projected/9c78e49b-7a06-4a60-b3cf-d338a9267a68-kube-api-access-bfrvl\") pod \"rate-test-model-dc94b0-kserve-5c98b779c9-x2kxm\" (UID: \"9c78e49b-7a06-4a60-b3cf-d338a9267a68\") " pod="ai-tenant-e2e-shared-b-dc94b0/rate-test-model-dc94b0-kserve-5c98b779c9-x2kxm"
Jul 15 12:59:12.190184 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:59:12.189964    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c78e49b-7a06-4a60-b3cf-d338a9267a68-dshm\") pod \"rate-test-model-dc94b0-kserve-5c98b779c9-x2kxm\" (UID: \"9c78e49b-7a06-4a60-b3cf-d338a9267a68\") " pod="ai-tenant-e2e-shared-b-dc94b0/rate-test-model-dc94b0-kserve-5c98b779c9-x2kxm"
Jul 15 12:59:12.190184 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:59:12.189987    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c78e49b-7a06-4a60-b3cf-d338a9267a68-tls-certs\") pod \"rate-test-model-dc94b0-kserve-5c98b779c9-x2kxm\" (UID: \"9c78e49b-7a06-4a60-b3cf-d338a9267a68\") " pod="ai-tenant-e2e-shared-b-dc94b0/rate-test-model-dc94b0-kserve-5c98b779c9-x2kxm"
Jul 15 12:59:12.190184 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:59:12.190026    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c78e49b-7a06-4a60-b3cf-d338a9267a68-tmp-dir\") pod \"rate-test-model-dc94b0-kserve-5c98b779c9-x2kxm\" (UID: \"9c78e49b-7a06-4a60-b3cf-d338a9267a68\") " pod="ai-tenant-e2e-shared-b-dc94b0/rate-test-model-dc94b0-kserve-5c98b779c9-x2kxm"
Jul 15 12:59:12.190184 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:59:12.190056    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c78e49b-7a06-4a60-b3cf-d338a9267a68-model-cache\") pod \"rate-test-model-dc94b0-kserve-5c98b779c9-x2kxm\" (UID: \"9c78e49b-7a06-4a60-b3cf-d338a9267a68\") " pod="ai-tenant-e2e-shared-b-dc94b0/rate-test-model-dc94b0-kserve-5c98b779c9-x2kxm"
Jul 15 12:59:12.190442 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:59:12.190383    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c78e49b-7a06-4a60-b3cf-d338a9267a68-home\") pod \"rate-test-model-dc94b0-kserve-5c98b779c9-x2kxm\" (UID: \"9c78e49b-7a06-4a60-b3cf-d338a9267a68\") " pod="ai-tenant-e2e-shared-b-dc94b0/rate-test-model-dc94b0-kserve-5c98b779c9-x2kxm"
Jul 15 12:59:12.190482 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:59:12.190434    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c78e49b-7a06-4a60-b3cf-d338a9267a68-tmp-dir\") pod \"rate-test-model-dc94b0-kserve-5c98b779c9-x2kxm\" (UID: \"9c78e49b-7a06-4a60-b3cf-d338a9267a68\") " pod="ai-tenant-e2e-shared-b-dc94b0/rate-test-model-dc94b0-kserve-5c98b779c9-x2kxm"
Jul 15 12:59:12.190482 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:59:12.190460    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c78e49b-7a06-4a60-b3cf-d338a9267a68-model-cache\") pod \"rate-test-model-dc94b0-kserve-5c98b779c9-x2kxm\" (UID: \"9c78e49b-7a06-4a60-b3cf-d338a9267a68\") " pod="ai-tenant-e2e-shared-b-dc94b0/rate-test-model-dc94b0-kserve-5c98b779c9-x2kxm"
Jul 15 12:59:12.192390 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:59:12.192365    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c78e49b-7a06-4a60-b3cf-d338a9267a68-dshm\") pod \"rate-test-model-dc94b0-kserve-5c98b779c9-x2kxm\" (UID: \"9c78e49b-7a06-4a60-b3cf-d338a9267a68\") " pod="ai-tenant-e2e-shared-b-dc94b0/rate-test-model-dc94b0-kserve-5c98b779c9-x2kxm"
Jul 15 12:59:12.192522 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:59:12.192471    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c78e49b-7a06-4a60-b3cf-d338a9267a68-tls-certs\") pod \"rate-test-model-dc94b0-kserve-5c98b779c9-x2kxm\" (UID: \"9c78e49b-7a06-4a60-b3cf-d338a9267a68\") " pod="ai-tenant-e2e-shared-b-dc94b0/rate-test-model-dc94b0-kserve-5c98b779c9-x2kxm"
Jul 15 12:59:12.198256 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:59:12.198236    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfrvl\" (UniqueName: \"kubernetes.io/projected/9c78e49b-7a06-4a60-b3cf-d338a9267a68-kube-api-access-bfrvl\") pod \"rate-test-model-dc94b0-kserve-5c98b779c9-x2kxm\" (UID: \"9c78e49b-7a06-4a60-b3cf-d338a9267a68\") " pod="ai-tenant-e2e-shared-b-dc94b0/rate-test-model-dc94b0-kserve-5c98b779c9-x2kxm"
Jul 15 12:59:12.271514 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:59:12.271445    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-dc94b0/rate-test-model-dc94b0-kserve-5c98b779c9-x2kxm"
Jul 15 12:59:12.402062 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:59:12.402036    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-dc94b0/rate-test-model-dc94b0-kserve-5c98b779c9-x2kxm"]
Jul 15 12:59:12.404510 ip-10-0-133-186 kubenswrapper[2560]: W0715 12:59:12.404479    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9c78e49b_7a06_4a60_b3cf_d338a9267a68.slice/crio-54e5d865d6142ca210ac20e3653b63dacd6ce22301d1ea4750ace639b2965fb1 WatchSource:0}: Error finding container 54e5d865d6142ca210ac20e3653b63dacd6ce22301d1ea4750ace639b2965fb1: Status 404 returned error can't find the container with id 54e5d865d6142ca210ac20e3653b63dacd6ce22301d1ea4750ace639b2965fb1
Jul 15 12:59:12.576417 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:59:12.576330    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-dc94b0/rate-test-model-dc94b0-kserve-5c98b779c9-x2kxm" event={"ID":"9c78e49b-7a06-4a60-b3cf-d338a9267a68","Type":"ContainerStarted","Data":"6ea8c0d7ea2fdcc651aebcfaac27660c60e57854db276e8779332bf18c8c7c94"}
Jul 15 12:59:12.576417 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:59:12.576371    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-dc94b0/rate-test-model-dc94b0-kserve-5c98b779c9-x2kxm" event={"ID":"9c78e49b-7a06-4a60-b3cf-d338a9267a68","Type":"ContainerStarted","Data":"54e5d865d6142ca210ac20e3653b63dacd6ce22301d1ea4750ace639b2965fb1"}
Jul 15 12:59:12.593849 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:59:12.593791    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-dc94b0/rate-test-model-dc94b0-kserve-5c98b779c9-x2kxm" podStartSLOduration=1.593770981 podStartE2EDuration="1.593770981s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:59:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:59:12.59319767 +0000 UTC m=+2899.707591406" watchObservedRunningTime="2026-07-15 12:59:12.593770981 +0000 UTC m=+2899.708164713"
Jul 15 12:59:22.271595 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:59:22.271556    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-dc94b0/rate-test-model-dc94b0-kserve-5c98b779c9-x2kxm"
Jul 15 12:59:22.272066 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:59:22.271611    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-dc94b0/rate-test-model-dc94b0-kserve-5c98b779c9-x2kxm"
Jul 15 12:59:22.289066 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:59:22.289041    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-dc94b0/rate-test-model-dc94b0-kserve-5c98b779c9-x2kxm"
Jul 15 12:59:22.636420 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:59:22.636340    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-dc94b0/rate-test-model-dc94b0-kserve-5c98b779c9-x2kxm"
Jul 15 12:59:56.541942 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:59:56.541910    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-e6c75d/rate-test-model-e6c75d-kserve-5dfd468947-wp7gp"]
Jul 15 12:59:57.464477 ip-10-0-133-186 kubenswrapper[2560]: I0715 12:59:57.464433    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-dc94b0/rate-test-model-dc94b0-kserve-5c98b779c9-x2kxm"]
Jul 15 13:00:11.561744 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:11.561705    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-e6c75d/rate-test-model-e6c75d-kserve-5dfd468947-wp7gp" podUID="08dfd676-5f8c-4740-9066-bae189524cf1" containerName="main" containerID="cri-o://04b10c4d4df04ac26d051b232a9006dd4ed2bde3b5f91f86d7ea01d506088a56" gracePeriod=45
Jul 15 13:00:11.816160 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:11.816107    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e6c75d/rate-test-model-e6c75d-kserve-5dfd468947-wp7gp"
Jul 15 13:00:11.864876 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:11.864844    2560 generic.go:356] "Generic (PLEG): container finished" podID="08dfd676-5f8c-4740-9066-bae189524cf1" containerID="04b10c4d4df04ac26d051b232a9006dd4ed2bde3b5f91f86d7ea01d506088a56" exitCode=0
Jul 15 13:00:11.865021 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:11.864886    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e6c75d/rate-test-model-e6c75d-kserve-5dfd468947-wp7gp"
Jul 15 13:00:11.865021 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:11.864925    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e6c75d/rate-test-model-e6c75d-kserve-5dfd468947-wp7gp" event={"ID":"08dfd676-5f8c-4740-9066-bae189524cf1","Type":"ContainerDied","Data":"04b10c4d4df04ac26d051b232a9006dd4ed2bde3b5f91f86d7ea01d506088a56"}
Jul 15 13:00:11.865021 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:11.864969    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e6c75d/rate-test-model-e6c75d-kserve-5dfd468947-wp7gp" event={"ID":"08dfd676-5f8c-4740-9066-bae189524cf1","Type":"ContainerDied","Data":"cf7de10697454241ba3f6d3b7b657f07d682c5526a5e95835301a45f4e55276f"}
Jul 15 13:00:11.865021 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:11.864989    2560 scope.go:117] "RemoveContainer" containerID="04b10c4d4df04ac26d051b232a9006dd4ed2bde3b5f91f86d7ea01d506088a56"
Jul 15 13:00:11.873539 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:11.873521    2560 scope.go:117] "RemoveContainer" containerID="04b10c4d4df04ac26d051b232a9006dd4ed2bde3b5f91f86d7ea01d506088a56"
Jul 15 13:00:11.873801 ip-10-0-133-186 kubenswrapper[2560]: E0715 13:00:11.873775    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04b10c4d4df04ac26d051b232a9006dd4ed2bde3b5f91f86d7ea01d506088a56\": container with ID starting with 04b10c4d4df04ac26d051b232a9006dd4ed2bde3b5f91f86d7ea01d506088a56 not found: ID does not exist" containerID="04b10c4d4df04ac26d051b232a9006dd4ed2bde3b5f91f86d7ea01d506088a56"
Jul 15 13:00:11.873857 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:11.873801    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04b10c4d4df04ac26d051b232a9006dd4ed2bde3b5f91f86d7ea01d506088a56"} err="failed to get container status \"04b10c4d4df04ac26d051b232a9006dd4ed2bde3b5f91f86d7ea01d506088a56\": rpc error: code = NotFound desc = could not find container \"04b10c4d4df04ac26d051b232a9006dd4ed2bde3b5f91f86d7ea01d506088a56\": container with ID starting with 04b10c4d4df04ac26d051b232a9006dd4ed2bde3b5f91f86d7ea01d506088a56 not found: ID does not exist"
Jul 15 13:00:11.931514 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:11.931495    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08dfd676-5f8c-4740-9066-bae189524cf1-home\") pod \"08dfd676-5f8c-4740-9066-bae189524cf1\" (UID: \"08dfd676-5f8c-4740-9066-bae189524cf1\") "
Jul 15 13:00:11.931641 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:11.931527    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hggs\" (UniqueName: \"kubernetes.io/projected/08dfd676-5f8c-4740-9066-bae189524cf1-kube-api-access-2hggs\") pod \"08dfd676-5f8c-4740-9066-bae189524cf1\" (UID: \"08dfd676-5f8c-4740-9066-bae189524cf1\") "
Jul 15 13:00:11.931641 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:11.931605    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08dfd676-5f8c-4740-9066-bae189524cf1-tmp-dir\") pod \"08dfd676-5f8c-4740-9066-bae189524cf1\" (UID: \"08dfd676-5f8c-4740-9066-bae189524cf1\") "
Jul 15 13:00:11.931641 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:11.931635    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08dfd676-5f8c-4740-9066-bae189524cf1-dshm\") pod \"08dfd676-5f8c-4740-9066-bae189524cf1\" (UID: \"08dfd676-5f8c-4740-9066-bae189524cf1\") "
Jul 15 13:00:11.931779 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:11.931657    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08dfd676-5f8c-4740-9066-bae189524cf1-model-cache\") pod \"08dfd676-5f8c-4740-9066-bae189524cf1\" (UID: \"08dfd676-5f8c-4740-9066-bae189524cf1\") "
Jul 15 13:00:11.931779 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:11.931749    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08dfd676-5f8c-4740-9066-bae189524cf1-tls-certs\") pod \"08dfd676-5f8c-4740-9066-bae189524cf1\" (UID: \"08dfd676-5f8c-4740-9066-bae189524cf1\") "
Jul 15 13:00:11.931891 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:11.931761    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08dfd676-5f8c-4740-9066-bae189524cf1-home" (OuterVolumeSpecName: "home") pod "08dfd676-5f8c-4740-9066-bae189524cf1" (UID: "08dfd676-5f8c-4740-9066-bae189524cf1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:00:11.931891 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:11.931839    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08dfd676-5f8c-4740-9066-bae189524cf1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "08dfd676-5f8c-4740-9066-bae189524cf1" (UID: "08dfd676-5f8c-4740-9066-bae189524cf1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:00:11.932002 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:11.931953    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08dfd676-5f8c-4740-9066-bae189524cf1-model-cache" (OuterVolumeSpecName: "model-cache") pod "08dfd676-5f8c-4740-9066-bae189524cf1" (UID: "08dfd676-5f8c-4740-9066-bae189524cf1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:00:11.932108 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:11.932090    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08dfd676-5f8c-4740-9066-bae189524cf1-model-cache\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 13:00:11.932185 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:11.932114    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08dfd676-5f8c-4740-9066-bae189524cf1-home\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 13:00:11.932185 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:11.932128    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08dfd676-5f8c-4740-9066-bae189524cf1-tmp-dir\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 13:00:11.933679 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:11.933660    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08dfd676-5f8c-4740-9066-bae189524cf1-dshm" (OuterVolumeSpecName: "dshm") pod "08dfd676-5f8c-4740-9066-bae189524cf1" (UID: "08dfd676-5f8c-4740-9066-bae189524cf1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:00:11.933775 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:11.933712    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08dfd676-5f8c-4740-9066-bae189524cf1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "08dfd676-5f8c-4740-9066-bae189524cf1" (UID: "08dfd676-5f8c-4740-9066-bae189524cf1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:00:11.933828 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:11.933786    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08dfd676-5f8c-4740-9066-bae189524cf1-kube-api-access-2hggs" (OuterVolumeSpecName: "kube-api-access-2hggs") pod "08dfd676-5f8c-4740-9066-bae189524cf1" (UID: "08dfd676-5f8c-4740-9066-bae189524cf1"). InnerVolumeSpecName "kube-api-access-2hggs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:00:12.033120 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:12.033089    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08dfd676-5f8c-4740-9066-bae189524cf1-tls-certs\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 13:00:12.033120 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:12.033116    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hggs\" (UniqueName: \"kubernetes.io/projected/08dfd676-5f8c-4740-9066-bae189524cf1-kube-api-access-2hggs\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 13:00:12.033315 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:12.033129    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08dfd676-5f8c-4740-9066-bae189524cf1-dshm\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 13:00:12.187395 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:12.187366    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-e6c75d/rate-test-model-e6c75d-kserve-5dfd468947-wp7gp"]
Jul 15 13:00:12.199190 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:12.194082    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-e6c75d/rate-test-model-e6c75d-kserve-5dfd468947-wp7gp"]
Jul 15 13:00:12.484709 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:12.484668    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-dc94b0/rate-test-model-dc94b0-kserve-5c98b779c9-x2kxm" podUID="9c78e49b-7a06-4a60-b3cf-d338a9267a68" containerName="main" containerID="cri-o://6ea8c0d7ea2fdcc651aebcfaac27660c60e57854db276e8779332bf18c8c7c94" gracePeriod=45
Jul 15 13:00:12.626330 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:12.626269    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-shared-b-dc94b0/rate-test-model-dc94b0-kserve-5c98b779c9-x2kxm" podUID="9c78e49b-7a06-4a60-b3cf-d338a9267a68" containerName="main" probeResult="failure" output="Get \"https://10.132.0.45:8000/ready\": dial tcp 10.132.0.45:8000: connect: connection refused"
Jul 15 13:00:12.733957 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:12.733934    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-dc94b0/rate-test-model-dc94b0-kserve-5c98b779c9-x2kxm"
Jul 15 13:00:12.841446 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:12.841363    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c78e49b-7a06-4a60-b3cf-d338a9267a68-tmp-dir\") pod \"9c78e49b-7a06-4a60-b3cf-d338a9267a68\" (UID: \"9c78e49b-7a06-4a60-b3cf-d338a9267a68\") "
Jul 15 13:00:12.841446 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:12.841440    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c78e49b-7a06-4a60-b3cf-d338a9267a68-home\") pod \"9c78e49b-7a06-4a60-b3cf-d338a9267a68\" (UID: \"9c78e49b-7a06-4a60-b3cf-d338a9267a68\") "
Jul 15 13:00:12.841664 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:12.841468    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c78e49b-7a06-4a60-b3cf-d338a9267a68-tls-certs\") pod \"9c78e49b-7a06-4a60-b3cf-d338a9267a68\" (UID: \"9c78e49b-7a06-4a60-b3cf-d338a9267a68\") "
Jul 15 13:00:12.841664 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:12.841493    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c78e49b-7a06-4a60-b3cf-d338a9267a68-dshm\") pod \"9c78e49b-7a06-4a60-b3cf-d338a9267a68\" (UID: \"9c78e49b-7a06-4a60-b3cf-d338a9267a68\") "
Jul 15 13:00:12.841664 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:12.841522    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c78e49b-7a06-4a60-b3cf-d338a9267a68-model-cache\") pod \"9c78e49b-7a06-4a60-b3cf-d338a9267a68\" (UID: \"9c78e49b-7a06-4a60-b3cf-d338a9267a68\") "
Jul 15 13:00:12.841664 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:12.841562    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bfrvl\" (UniqueName: \"kubernetes.io/projected/9c78e49b-7a06-4a60-b3cf-d338a9267a68-kube-api-access-bfrvl\") pod \"9c78e49b-7a06-4a60-b3cf-d338a9267a68\" (UID: \"9c78e49b-7a06-4a60-b3cf-d338a9267a68\") "
Jul 15 13:00:12.841875 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:12.841662    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c78e49b-7a06-4a60-b3cf-d338a9267a68-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9c78e49b-7a06-4a60-b3cf-d338a9267a68" (UID: "9c78e49b-7a06-4a60-b3cf-d338a9267a68"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:00:12.841875 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:12.841766    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c78e49b-7a06-4a60-b3cf-d338a9267a68-home" (OuterVolumeSpecName: "home") pod "9c78e49b-7a06-4a60-b3cf-d338a9267a68" (UID: "9c78e49b-7a06-4a60-b3cf-d338a9267a68"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:00:12.841984 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:12.841855    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c78e49b-7a06-4a60-b3cf-d338a9267a68-model-cache" (OuterVolumeSpecName: "model-cache") pod "9c78e49b-7a06-4a60-b3cf-d338a9267a68" (UID: "9c78e49b-7a06-4a60-b3cf-d338a9267a68"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:00:12.841984 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:12.841972    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c78e49b-7a06-4a60-b3cf-d338a9267a68-model-cache\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 13:00:12.842063 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:12.842012    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c78e49b-7a06-4a60-b3cf-d338a9267a68-tmp-dir\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 13:00:12.842063 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:12.842026    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c78e49b-7a06-4a60-b3cf-d338a9267a68-home\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 13:00:12.843566 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:12.843545    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c78e49b-7a06-4a60-b3cf-d338a9267a68-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9c78e49b-7a06-4a60-b3cf-d338a9267a68" (UID: "9c78e49b-7a06-4a60-b3cf-d338a9267a68"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:00:12.844035 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:12.844015    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c78e49b-7a06-4a60-b3cf-d338a9267a68-kube-api-access-bfrvl" (OuterVolumeSpecName: "kube-api-access-bfrvl") pod "9c78e49b-7a06-4a60-b3cf-d338a9267a68" (UID: "9c78e49b-7a06-4a60-b3cf-d338a9267a68"). InnerVolumeSpecName "kube-api-access-bfrvl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:00:12.844104 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:12.844016    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c78e49b-7a06-4a60-b3cf-d338a9267a68-dshm" (OuterVolumeSpecName: "dshm") pod "9c78e49b-7a06-4a60-b3cf-d338a9267a68" (UID: "9c78e49b-7a06-4a60-b3cf-d338a9267a68"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:00:12.870539 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:12.870513    2560 generic.go:356] "Generic (PLEG): container finished" podID="9c78e49b-7a06-4a60-b3cf-d338a9267a68" containerID="6ea8c0d7ea2fdcc651aebcfaac27660c60e57854db276e8779332bf18c8c7c94" exitCode=0
Jul 15 13:00:12.870650 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:12.870557    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-dc94b0/rate-test-model-dc94b0-kserve-5c98b779c9-x2kxm"
Jul 15 13:00:12.870650 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:12.870600    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-dc94b0/rate-test-model-dc94b0-kserve-5c98b779c9-x2kxm" event={"ID":"9c78e49b-7a06-4a60-b3cf-d338a9267a68","Type":"ContainerDied","Data":"6ea8c0d7ea2fdcc651aebcfaac27660c60e57854db276e8779332bf18c8c7c94"}
Jul 15 13:00:12.870650 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:12.870645    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-dc94b0/rate-test-model-dc94b0-kserve-5c98b779c9-x2kxm" event={"ID":"9c78e49b-7a06-4a60-b3cf-d338a9267a68","Type":"ContainerDied","Data":"54e5d865d6142ca210ac20e3653b63dacd6ce22301d1ea4750ace639b2965fb1"}
Jul 15 13:00:12.870774 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:12.870666    2560 scope.go:117] "RemoveContainer" containerID="6ea8c0d7ea2fdcc651aebcfaac27660c60e57854db276e8779332bf18c8c7c94"
Jul 15 13:00:12.879847 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:12.879831    2560 scope.go:117] "RemoveContainer" containerID="6ea8c0d7ea2fdcc651aebcfaac27660c60e57854db276e8779332bf18c8c7c94"
Jul 15 13:00:12.880073 ip-10-0-133-186 kubenswrapper[2560]: E0715 13:00:12.880057    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ea8c0d7ea2fdcc651aebcfaac27660c60e57854db276e8779332bf18c8c7c94\": container with ID starting with 6ea8c0d7ea2fdcc651aebcfaac27660c60e57854db276e8779332bf18c8c7c94 not found: ID does not exist" containerID="6ea8c0d7ea2fdcc651aebcfaac27660c60e57854db276e8779332bf18c8c7c94"
Jul 15 13:00:12.880128 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:12.880086    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ea8c0d7ea2fdcc651aebcfaac27660c60e57854db276e8779332bf18c8c7c94"} err="failed to get container status \"6ea8c0d7ea2fdcc651aebcfaac27660c60e57854db276e8779332bf18c8c7c94\": rpc error: code = NotFound desc = could not find container \"6ea8c0d7ea2fdcc651aebcfaac27660c60e57854db276e8779332bf18c8c7c94\": container with ID starting with 6ea8c0d7ea2fdcc651aebcfaac27660c60e57854db276e8779332bf18c8c7c94 not found: ID does not exist"
Jul 15 13:00:12.891477 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:12.891457    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-dc94b0/rate-test-model-dc94b0-kserve-5c98b779c9-x2kxm"]
Jul 15 13:00:12.895397 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:12.895377    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-dc94b0/rate-test-model-dc94b0-kserve-5c98b779c9-x2kxm"]
Jul 15 13:00:12.942608 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:12.942582    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c78e49b-7a06-4a60-b3cf-d338a9267a68-tls-certs\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 13:00:12.942608 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:12.942604    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c78e49b-7a06-4a60-b3cf-d338a9267a68-dshm\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 13:00:12.942737 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:12.942617    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bfrvl\" (UniqueName: \"kubernetes.io/projected/9c78e49b-7a06-4a60-b3cf-d338a9267a68-kube-api-access-bfrvl\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\""
Jul 15 13:00:13.444902 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:13.444869    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08dfd676-5f8c-4740-9066-bae189524cf1" path="/var/lib/kubelet/pods/08dfd676-5f8c-4740-9066-bae189524cf1/volumes"
Jul 15 13:00:13.445279 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:13.445265    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c78e49b-7a06-4a60-b3cf-d338a9267a68" path="/var/lib/kubelet/pods/9c78e49b-7a06-4a60-b3cf-d338a9267a68/volumes"
Jul 15 13:00:53.611438 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:53.611364    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xkvbf_641b0ffa-0450-4198-8066-0241ab179822/console-operator/2.log"
Jul 15 13:00:53.620219 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:53.620191    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xh4rs_2de62ab2-7502-4c13-a6f0-5ebbd4982798/ovn-acl-logging/0.log"
Jul 15 13:00:53.633180 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:53.633151    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xkvbf_641b0ffa-0450-4198-8066-0241ab179822/console-operator/2.log"
Jul 15 13:00:53.641766 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:53.641746    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xh4rs_2de62ab2-7502-4c13-a6f0-5ebbd4982798/ovn-acl-logging/0.log"
Jul 15 13:00:53.677821 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:00:53.677790    2560 scope.go:117] "RemoveContainer" containerID="aaf0d4b8e393a3a4018da7fe9995d38e8fe384bc44bc9138637410016c9a81c9"
Jul 15 13:01:10.197605 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:10.197534    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-65c66d9785-79hcq_9b097ec9-054f-4ab8-be07-683ab679141d/authorino/0.log"
Jul 15 13:01:15.838510 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:15.838486    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85d97db8bc-h9msx_2c5cd648-2957-4f58-9db5-c9cd2c3b4f5d/copy-manifests/0.log"
Jul 15 13:01:15.850555 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:15.850526    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85d97db8bc-h9msx_2c5cd648-2957-4f58-9db5-c9cd2c3b4f5d/manager/0.log"
Jul 15 13:01:18.144942 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:18.144911    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-k6vx7_bb8380c8-6d6a-4b76-a85d-ab7597cc3d19/postgres/0.log"
Jul 15 13:01:19.455995 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:19.455968    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-65c66d9785-79hcq_9b097ec9-054f-4ab8-be07-683ab679141d/authorino/0.log"
Jul 15 13:01:19.577841 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:19.577812    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-2wzgf_47c78219-bc6b-4bce-b399-e5b00a305a82/manager/0.log"
Jul 15 13:01:21.029018 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:21.028986    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6795b9c646-z72mt_7c20d6a6-94a5-4493-8c88-bf232c67ef6f/kube-auth-proxy/0.log"
Jul 15 13:01:21.393185 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:21.393108    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-zwgxg_a15d81cf-d6e3-4a6b-a620-a84a2637e048/payload-processing/0.log"
Jul 15 13:01:22.090951 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:22.090918    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-tzlm6_c1bb891d-9f79-47ab-965c-e9f1a034cbd9/main/0.log"
Jul 15 13:01:22.207410 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:22.207383    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6884f_535603e7-58e2-4207-a31a-19bb75f95d92/main/0.log"
Jul 15 13:01:22.432906 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:22.432828    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-snspz_1a1e14e3-2950-44ab-879f-88d1c2c67c5a/main/0.log"
Jul 15 13:01:28.825114 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:28.825087    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-b2c8x_48797460-a1a5-43f2-9841-61f8adce425d/global-pull-secret-syncer/0.log"
Jul 15 13:01:28.977473 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:28.977442    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gwfk8_c1e0b090-dace-4704-82e6-0c756006f902/konnectivity-agent/0.log"
Jul 15 13:01:29.045586 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:29.045557    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-186.ec2.internal_b44d4f1a13a5598713990a6a605902da/haproxy/0.log"
Jul 15 13:01:33.907408 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:33.907373    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-65c66d9785-79hcq_9b097ec9-054f-4ab8-be07-683ab679141d/authorino/0.log"
Jul 15 13:01:33.940999 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:33.940967    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-2wzgf_47c78219-bc6b-4bce-b399-e5b00a305a82/manager/0.log"
Jul 15 13:01:36.335488 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:36.335441    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-xhbdq_58b72f47-2df3-465d-9676-2c78f1af5579/kube-state-metrics/0.log"
Jul 15 13:01:36.352367 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:36.352343    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-xhbdq_58b72f47-2df3-465d-9676-2c78f1af5579/kube-rbac-proxy-main/0.log"
Jul 15 13:01:36.370932 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:36.370907    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-xhbdq_58b72f47-2df3-465d-9676-2c78f1af5579/kube-rbac-proxy-self/0.log"
Jul 15 13:01:36.396409 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:36.396382    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-785c48688d-c9ktm_1edd91c2-6b3b-4fbf-8741-a8c5aef90d19/metrics-server/0.log"
Jul 15 13:01:36.542821 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:36.542790    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pr5kb_131ed49e-dd84-420f-b401-d8632035f0e8/node-exporter/0.log"
Jul 15 13:01:36.564853 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:36.564831    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pr5kb_131ed49e-dd84-420f-b401-d8632035f0e8/kube-rbac-proxy/0.log"
Jul 15 13:01:36.584854 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:36.584831    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pr5kb_131ed49e-dd84-420f-b401-d8632035f0e8/init-textfile/0.log"
Jul 15 13:01:36.761514 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:36.761483    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a0d241a6-8ddc-4d97-8ed0-e26a89049442/prometheus/0.log"
Jul 15 13:01:36.781064 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:36.781037    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a0d241a6-8ddc-4d97-8ed0-e26a89049442/config-reloader/0.log"
Jul 15 13:01:36.801156 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:36.801084    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a0d241a6-8ddc-4d97-8ed0-e26a89049442/thanos-sidecar/0.log"
Jul 15 13:01:36.819948 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:36.819923    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a0d241a6-8ddc-4d97-8ed0-e26a89049442/kube-rbac-proxy-web/0.log"
Jul 15 13:01:36.842173 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:36.842149    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a0d241a6-8ddc-4d97-8ed0-e26a89049442/kube-rbac-proxy/0.log"
Jul 15 13:01:36.862173 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:36.862147    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a0d241a6-8ddc-4d97-8ed0-e26a89049442/kube-rbac-proxy-thanos/0.log"
Jul 15 13:01:36.882618 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:36.882598    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a0d241a6-8ddc-4d97-8ed0-e26a89049442/init-config-reloader/0.log"
Jul 15 13:01:36.915625 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:36.915600    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-hvqgh_cbd017f6-cc49-41c7-bf54-e608baa47768/prometheus-operator/0.log"
Jul 15 13:01:36.933498 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:36.933472    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-hvqgh_cbd017f6-cc49-41c7-bf54-e608baa47768/kube-rbac-proxy/0.log"
Jul 15 13:01:36.990255 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:36.990225    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6c949778c8-hcsbr_2f5d3954-3ef3-4f63-8574-74b146786b83/telemeter-client/0.log"
Jul 15 13:01:37.021913 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:37.021887    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6c949778c8-hcsbr_2f5d3954-3ef3-4f63-8574-74b146786b83/reload/0.log"
Jul 15 13:01:37.042585 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:37.042555    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6c949778c8-hcsbr_2f5d3954-3ef3-4f63-8574-74b146786b83/kube-rbac-proxy/0.log"
Jul 15 13:01:38.342483 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:38.342454    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-cs8bw_2b930a70-91ac-47df-abbe-c3c2ec0ac1d4/networking-console-plugin/0.log"
Jul 15 13:01:38.921954 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:38.921922    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xkvbf_641b0ffa-0450-4198-8066-0241ab179822/console-operator/2.log"
Jul 15 13:01:38.925583 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:38.925561    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xkvbf_641b0ffa-0450-4198-8066-0241ab179822/console-operator/3.log"
Jul 15 13:01:39.322288 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:39.322252    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vl8nl/perf-node-gather-daemonset-kl2ww"]
Jul 15 13:01:39.322697 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:39.322679    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08dfd676-5f8c-4740-9066-bae189524cf1" containerName="main"
Jul 15 13:01:39.322780 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:39.322701    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="08dfd676-5f8c-4740-9066-bae189524cf1" containerName="main"
Jul 15 13:01:39.322780 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:39.322756    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c78e49b-7a06-4a60-b3cf-d338a9267a68" containerName="main"
Jul 15 13:01:39.322780 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:39.322766    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c78e49b-7a06-4a60-b3cf-d338a9267a68" containerName="main"
Jul 15 13:01:39.322936 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:39.322839    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c78e49b-7a06-4a60-b3cf-d338a9267a68" containerName="main"
Jul 15 13:01:39.322936 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:39.322849    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="08dfd676-5f8c-4740-9066-bae189524cf1" containerName="main"
Jul 15 13:01:39.325966 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:39.325946    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vl8nl/perf-node-gather-daemonset-kl2ww"
Jul 15 13:01:39.328554 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:39.328537    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vl8nl\"/\"kube-root-ca.crt\""
Jul 15 13:01:39.328647 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:39.328562    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vl8nl\"/\"openshift-service-ca.crt\""
Jul 15 13:01:39.329932 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:39.329907    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vl8nl\"/\"default-dockercfg-fdrbd\""
Jul 15 13:01:39.335355 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:39.335332    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vl8nl/perf-node-gather-daemonset-kl2ww"]
Jul 15 13:01:39.445056 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:39.445026    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b4f452c9-c813-434d-a782-abc6a79904f9-sys\") pod \"perf-node-gather-daemonset-kl2ww\" (UID: \"b4f452c9-c813-434d-a782-abc6a79904f9\") " pod="openshift-must-gather-vl8nl/perf-node-gather-daemonset-kl2ww"
Jul 15 13:01:39.445497 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:39.445062    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8jv4\" (UniqueName: \"kubernetes.io/projected/b4f452c9-c813-434d-a782-abc6a79904f9-kube-api-access-x8jv4\") pod \"perf-node-gather-daemonset-kl2ww\" (UID: \"b4f452c9-c813-434d-a782-abc6a79904f9\") " pod="openshift-must-gather-vl8nl/perf-node-gather-daemonset-kl2ww"
Jul 15 13:01:39.445497 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:39.445100    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b4f452c9-c813-434d-a782-abc6a79904f9-podres\") pod \"perf-node-gather-daemonset-kl2ww\" (UID: \"b4f452c9-c813-434d-a782-abc6a79904f9\") " pod="openshift-must-gather-vl8nl/perf-node-gather-daemonset-kl2ww"
Jul 15 13:01:39.445497 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:39.445117    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b4f452c9-c813-434d-a782-abc6a79904f9-lib-modules\") pod \"perf-node-gather-daemonset-kl2ww\" (UID: \"b4f452c9-c813-434d-a782-abc6a79904f9\") " pod="openshift-must-gather-vl8nl/perf-node-gather-daemonset-kl2ww"
Jul 15 13:01:39.445497 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:39.445151    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b4f452c9-c813-434d-a782-abc6a79904f9-proc\") pod \"perf-node-gather-daemonset-kl2ww\" (UID: \"b4f452c9-c813-434d-a782-abc6a79904f9\") " pod="openshift-must-gather-vl8nl/perf-node-gather-daemonset-kl2ww"
Jul 15 13:01:39.546617 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:39.546577    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b4f452c9-c813-434d-a782-abc6a79904f9-podres\") pod \"perf-node-gather-daemonset-kl2ww\" (UID: \"b4f452c9-c813-434d-a782-abc6a79904f9\") " pod="openshift-must-gather-vl8nl/perf-node-gather-daemonset-kl2ww"
Jul 15 13:01:39.546617 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:39.546618    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b4f452c9-c813-434d-a782-abc6a79904f9-lib-modules\") pod \"perf-node-gather-daemonset-kl2ww\" (UID: \"b4f452c9-c813-434d-a782-abc6a79904f9\") " pod="openshift-must-gather-vl8nl/perf-node-gather-daemonset-kl2ww"
Jul 15 13:01:39.546866 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:39.546666    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b4f452c9-c813-434d-a782-abc6a79904f9-proc\") pod \"perf-node-gather-daemonset-kl2ww\" (UID: \"b4f452c9-c813-434d-a782-abc6a79904f9\") " pod="openshift-must-gather-vl8nl/perf-node-gather-daemonset-kl2ww"
Jul 15 13:01:39.546866 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:39.546753    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b4f452c9-c813-434d-a782-abc6a79904f9-sys\") pod \"perf-node-gather-daemonset-kl2ww\" (UID: \"b4f452c9-c813-434d-a782-abc6a79904f9\") " pod="openshift-must-gather-vl8nl/perf-node-gather-daemonset-kl2ww"
Jul 15 13:01:39.546866 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:39.546773    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b4f452c9-c813-434d-a782-abc6a79904f9-lib-modules\") pod \"perf-node-gather-daemonset-kl2ww\" (UID: \"b4f452c9-c813-434d-a782-abc6a79904f9\") " pod="openshift-must-gather-vl8nl/perf-node-gather-daemonset-kl2ww"
Jul 15 13:01:39.546866 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:39.546786    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8jv4\" (UniqueName: \"kubernetes.io/projected/b4f452c9-c813-434d-a782-abc6a79904f9-kube-api-access-x8jv4\") pod \"perf-node-gather-daemonset-kl2ww\" (UID: \"b4f452c9-c813-434d-a782-abc6a79904f9\") " pod="openshift-must-gather-vl8nl/perf-node-gather-daemonset-kl2ww"
Jul 15 13:01:39.546866 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:39.546792    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b4f452c9-c813-434d-a782-abc6a79904f9-proc\") pod \"perf-node-gather-daemonset-kl2ww\" (UID: \"b4f452c9-c813-434d-a782-abc6a79904f9\") " pod="openshift-must-gather-vl8nl/perf-node-gather-daemonset-kl2ww"
Jul 15 13:01:39.546866 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:39.546751    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b4f452c9-c813-434d-a782-abc6a79904f9-podres\") pod \"perf-node-gather-daemonset-kl2ww\" (UID: \"b4f452c9-c813-434d-a782-abc6a79904f9\") " pod="openshift-must-gather-vl8nl/perf-node-gather-daemonset-kl2ww"
Jul 15 13:01:39.546866 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:39.546812    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b4f452c9-c813-434d-a782-abc6a79904f9-sys\") pod \"perf-node-gather-daemonset-kl2ww\" (UID: \"b4f452c9-c813-434d-a782-abc6a79904f9\") " pod="openshift-must-gather-vl8nl/perf-node-gather-daemonset-kl2ww"
Jul 15 13:01:39.555160 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:39.555138    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8jv4\" (UniqueName: \"kubernetes.io/projected/b4f452c9-c813-434d-a782-abc6a79904f9-kube-api-access-x8jv4\") pod \"perf-node-gather-daemonset-kl2ww\" (UID: \"b4f452c9-c813-434d-a782-abc6a79904f9\") " pod="openshift-must-gather-vl8nl/perf-node-gather-daemonset-kl2ww"
Jul 15 13:01:39.637063 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:39.636971    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vl8nl/perf-node-gather-daemonset-kl2ww"
Jul 15 13:01:39.769609 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:39.769585    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vl8nl/perf-node-gather-daemonset-kl2ww"]
Jul 15 13:01:39.771749 ip-10-0-133-186 kubenswrapper[2560]: W0715 13:01:39.771708    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb4f452c9_c813_434d_a782_abc6a79904f9.slice/crio-e521837635fe8125c75233d1443fe6985f508a3b7b4bcf1f2ef38f4e783ca357 WatchSource:0}: Error finding container e521837635fe8125c75233d1443fe6985f508a3b7b4bcf1f2ef38f4e783ca357: Status 404 returned error can't find the container with id e521837635fe8125c75233d1443fe6985f508a3b7b4bcf1f2ef38f4e783ca357
Jul 15 13:01:40.287994 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:40.287961    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vl8nl/perf-node-gather-daemonset-kl2ww" event={"ID":"b4f452c9-c813-434d-a782-abc6a79904f9","Type":"ContainerStarted","Data":"86acd455c976cc7da17ce7fed90b201731bc70f2d63d0a9786062552ac4549ec"}
Jul 15 13:01:40.288208 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:40.288010    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vl8nl/perf-node-gather-daemonset-kl2ww" event={"ID":"b4f452c9-c813-434d-a782-abc6a79904f9","Type":"ContainerStarted","Data":"e521837635fe8125c75233d1443fe6985f508a3b7b4bcf1f2ef38f4e783ca357"}
Jul 15 13:01:40.288208 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:40.288096    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-vl8nl/perf-node-gather-daemonset-kl2ww"
Jul 15 13:01:40.304238 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:40.304181    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vl8nl/perf-node-gather-daemonset-kl2ww" podStartSLOduration=1.304160391 podStartE2EDuration="1.304160391s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:01:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:01:40.303792519 +0000 UTC m=+3047.418186252" watchObservedRunningTime="2026-07-15 13:01:40.304160391 +0000 UTC m=+3047.418554126"
Jul 15 13:01:41.339028 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:41.338983    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sfm96_b9a23fbe-f3c1-4d56-84a9-37025a59b3e4/dns/0.log"
Jul 15 13:01:41.376841 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:41.376787    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sfm96_b9a23fbe-f3c1-4d56-84a9-37025a59b3e4/kube-rbac-proxy/0.log"
Jul 15 13:01:41.466549 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:41.466516    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zcdxd_fe1a8d7e-70d9-4b84-8ccd-64e1fc8f803b/dns-node-resolver/0.log"
Jul 15 13:01:42.023409 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:42.023384    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4tr78_aab771cb-07af-462f-ac09-166b75eaab99/node-ca/0.log"
Jul 15 13:01:43.111979 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:43.111923    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6795b9c646-z72mt_7c20d6a6-94a5-4493-8c88-bf232c67ef6f/kube-auth-proxy/0.log"
Jul 15 13:01:43.256775 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:43.256741    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-zwgxg_a15d81cf-d6e3-4a6b-a620-a84a2637e048/payload-processing/0.log"
Jul 15 13:01:43.919334 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:43.919267    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7ktfc_636b4e9e-64bd-41fb-a053-18d469b82593/serve-healthcheck-canary/0.log"
Jul 15 13:01:44.407181 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:44.407150    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-vl5tg_72392327-8bf2-4751-a503-370287b57cbb/insights-operator/0.log"
Jul 15 13:01:44.407855 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:44.407638    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-vl5tg_72392327-8bf2-4751-a503-370287b57cbb/insights-operator/1.log"
Jul 15 13:01:44.428015 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:44.427993    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5knhr_e2048642-6a69-4294-b0e4-cc80432a8625/kube-rbac-proxy/0.log"
Jul 15 13:01:44.447047 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:44.447030    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5knhr_e2048642-6a69-4294-b0e4-cc80432a8625/exporter/0.log"
Jul 15 13:01:44.466995 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:44.466976    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5knhr_e2048642-6a69-4294-b0e4-cc80432a8625/extractor/0.log"
Jul 15 13:01:46.302485 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:46.302412    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-vl8nl/perf-node-gather-daemonset-kl2ww"
Jul 15 13:01:47.191735 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:47.191695    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85d97db8bc-h9msx_2c5cd648-2957-4f58-9db5-c9cd2c3b4f5d/manager/0.log"
Jul 15 13:01:47.211525 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:47.211500    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85d97db8bc-h9msx_2c5cd648-2957-4f58-9db5-c9cd2c3b4f5d/copy-manifests/0.log"
Jul 15 13:01:48.543226 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:48.543157    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-786df675f-f5pjb_06a08dfe-3dff-4f02-909e-66ebcddb1ba0/manager/0.log"
Jul 15 13:01:49.886522 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:49.886496    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6795b9c646-z72mt_7c20d6a6-94a5-4493-8c88-bf232c67ef6f/kube-auth-proxy/0.log"
Jul 15 13:01:50.020286 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:50.020258    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-zwgxg_a15d81cf-d6e3-4a6b-a620-a84a2637e048/payload-processing/0.log"
Jul 15 13:01:51.389167 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:51.389086    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6795b9c646-z72mt_7c20d6a6-94a5-4493-8c88-bf232c67ef6f/kube-auth-proxy/0.log"
Jul 15 13:01:51.520538 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:51.520509    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-zwgxg_a15d81cf-d6e3-4a6b-a620-a84a2637e048/payload-processing/0.log"
Jul 15 13:01:53.762817 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:53.762786    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-rggjh_59863960-64df-4b84-bd4f-40d3be3982a6/migrator/0.log"
Jul 15 13:01:53.787827 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:53.787797    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-rggjh_59863960-64df-4b84-bd4f-40d3be3982a6/graceful-termination/0.log"
Jul 15 13:01:54.124783 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:54.124707    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-pgjww_f428cec4-6a61-47e3-b3bc-0ebed3a86af4/kube-storage-version-migrator-operator/1.log"
Jul 15 13:01:54.125565 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:54.125543    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-pgjww_f428cec4-6a61-47e3-b3bc-0ebed3a86af4/kube-storage-version-migrator-operator/0.log"
Jul 15 13:01:55.166093 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:55.166061    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-htv2v_4c29b692-3631-4562-96d0-83dad331764b/kube-multus-additional-cni-plugins/0.log"
Jul 15 13:01:55.187842 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:55.187812    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-htv2v_4c29b692-3631-4562-96d0-83dad331764b/egress-router-binary-copy/0.log"
Jul 15 13:01:55.207485 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:55.207460    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-htv2v_4c29b692-3631-4562-96d0-83dad331764b/cni-plugins/0.log"
Jul 15 13:01:55.227189 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:55.227162    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-htv2v_4c29b692-3631-4562-96d0-83dad331764b/bond-cni-plugin/0.log"
Jul 15 13:01:55.246687 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:55.246662    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-htv2v_4c29b692-3631-4562-96d0-83dad331764b/routeoverride-cni/0.log"
Jul 15 13:01:55.268734 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:55.268708    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-htv2v_4c29b692-3631-4562-96d0-83dad331764b/whereabouts-cni-bincopy/0.log"
Jul 15 13:01:55.285842 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:55.285811    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-htv2v_4c29b692-3631-4562-96d0-83dad331764b/whereabouts-cni/0.log"
Jul 15 13:01:55.599650 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:55.599613    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jt4gv_3060ca16-de32-4034-8fb1-bda91f17b97d/kube-multus/0.log"
Jul 15 13:01:55.703462 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:55.703433    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-spl8b_19938f5e-4b2c-45f8-9077-4fb510687262/network-metrics-daemon/0.log"
Jul 15 13:01:55.721521 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:55.721495    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-spl8b_19938f5e-4b2c-45f8-9077-4fb510687262/kube-rbac-proxy/0.log"
Jul 15 13:01:56.947631 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:56.947601    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xh4rs_2de62ab2-7502-4c13-a6f0-5ebbd4982798/ovn-controller/0.log"
Jul 15 13:01:56.963889 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:56.963861    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xh4rs_2de62ab2-7502-4c13-a6f0-5ebbd4982798/ovn-acl-logging/0.log"
Jul 15 13:01:56.963889 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:56.963874    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xh4rs_2de62ab2-7502-4c13-a6f0-5ebbd4982798/ovn-acl-logging/1.log"
Jul 15 13:01:56.983499 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:56.983473    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xh4rs_2de62ab2-7502-4c13-a6f0-5ebbd4982798/kube-rbac-proxy-node/0.log"
Jul 15 13:01:57.004564 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:57.004538    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xh4rs_2de62ab2-7502-4c13-a6f0-5ebbd4982798/kube-rbac-proxy-ovn-metrics/0.log"
Jul 15 13:01:57.023894 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:57.023870    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xh4rs_2de62ab2-7502-4c13-a6f0-5ebbd4982798/northd/0.log"
Jul 15 13:01:57.042808 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:57.042785    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xh4rs_2de62ab2-7502-4c13-a6f0-5ebbd4982798/nbdb/0.log"
Jul 15 13:01:57.064315 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:57.064275    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xh4rs_2de62ab2-7502-4c13-a6f0-5ebbd4982798/sbdb/0.log"
Jul 15 13:01:57.117857 ip-10-0-133-186 kubenswrapper[2560]: I0715 13:01:57.117824    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xh4rs_2de62ab2-7502-4c13-a6f0-5ebbd4982798/ovnkube-controller/0.log"